Oracle Exadata Storage Server X7-2 EF, Service Manual

Page 1: ...Oracle Exadata Storage Server X7 2 EF and HC Service Manual Part No E72479 06 May 2018 ...

Page 2: ......

Page 3: ...riety of information management applications It is not developed or intended for use in any inherently dangerous applications including applications that may create a risk of personal injury If you use this software or hardware in dangerous applications then you shall be responsible to take all appropriate fail safe backup redundancy and other measures to ensure its safe use Oracle Corporation and...

Page 4: ...n des informations Ce logiciel ou matériel n est pas conçu ni n est destiné à être utilisé dans des applications à risque notamment dans des applications pouvant causer un risque de dommages corporels Si vous utilisez ce logiciel ou ce matériel dans le cadre d applications dangereuses il est de votre responsabilité de prendre toutes les mesures de secours de sauvegarde de redondance et autres mesu...

Page 5: ...ts Breakdown 22 Replaceable Units 23 Troubleshooting and Diagnostics 25 Troubleshooting Server Component Hardware Faults 25 Troubleshooting Server Hardware Faults 25 Managing Server Hardware Faults Through the Oracle ILOM Fault Management Shell 29 Troubleshooting and Diagnostic Information 29 Troubleshooting Using the Server Front and Back Panel Status Indicators 30 Troubleshooting System Cooling ...

Page 6: ...c Discharge Safety 50 Key Identity Properties KIP Automated Update 51 Required Tools 52 Preparing the Server for Component Replacement 52 Powering Down the Server 53 Disconnect Cables From the Server 59 Extend the Server to the Maintenance Position 60 Remove the Server From the Rack 62 Take Antistatic Measures 63 Remove the Server Top Cover 64 Servicing Storage Drives 67 Storage Drives Hot Plug Co...

Page 7: ... Flash SSD 93 Servicing the Air Baffle 95 Remove the Air Baffle 95 Install the Air Baffle 97 Servicing the DIMMs 101 DIMM and Processor Physical Layout 102 DIMM Population Scenarios 103 DIMM Population Rules 103 DIMM Operating Speeds 104 Inconsistencies Between DIMM Fault Indicators and the BIOS Isolation of Faulty DIMMs 104 Using the Server Fault Remind Button 104 Identify and Remove a DIMM 105 I...

Page 8: ... Install the Temperature Sensor 156 Servicing the Internal HBA Card and HBA Super Capacitor 159 Remove the Internal HBA Card and HBA Super Capacitor 159 Install the Internal HBA Card and HBA Super Capacitor 163 Servicing SAS Cables 167 Remove SAS Storage Drive Cables 167 Install SAS Storage Drive Cables 170 Servicing the Motherboard Assembly 173 Remove the Motherboard Assembly 173 Install the Moth...

Page 9: ...Menus 202 BIOS Key Mappings 202 Access BIOS Setup Utility Menus 203 Navigate BIOS Setup Utility Menus 204 Using UEFI BIOS 206 Configuration Utilities for Add In Cards 206 Configure and Manage BIOS Using Oracle ILOM 206 UEFI Secure Boot 207 Trusted Execution Technology 207 Common BIOS Setup Utility Tasks 207 Verify BIOS Factory Default Settings 208 Select a Temporary Boot Device 209 Configure TPM S...

Page 10: ...ings Options 248 BIOS Advanced Menu Disk Freeze Lock Settings Options 249 BIOS IO Menu Selections 249 BIOS IO Menu PCI Subsystem Settings Options 250 BIOS IO Menu IO Virtualization Options 251 BIOS IO Menu IOAT Configuration Options 252 BIOS IO Menu Internal Devices Options 252 BIOS IO Menu Add in Cards Options 252 BIOS IO Menu PCIE Hardware Slot Configuration Options 253 BIOS Boot Menu Selections...

Page 11: ...Contents Identifying SNMP Trap Messages 268 Environmental Events 268 Hard Disk Drive Events 270 Power Events 271 Fan Events 275 Memory Events 276 Entity Presence Events 277 Index 279 11 ...

Page 12: ...12 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 13: ...structed on the hazards within the equipment and are qualified to remove and replace hardware Required knowledge Advanced experience troubleshooting and replacing hardware Product Documentation Library Documentation and resources for this product and related products are available at https www oracle com goto x7 2l docs Feedback Provide feedback about this documentation at http www oracle com goto...

Page 14: ...14 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 15: ...nit 2U server that is available in two configurations Extreme Flash EF and High Capacity HC They both use the same server but they are provisioned differently as described in the following table System Components Two Intel Xeon 4114 10 core 2 2 GHz 85W processors Twelve 16 GB 2666 MT sec DDR4 DIMMs 192 GB Optionally customers can expand system memory by upgrading to twelve 64 GB DDR4 DIMMs 768 GB ...

Page 16: ... chip Front and Back Panel Components The following sections describe the controls indicators connectors and drives located on the front and back panels EF Front Panel Components on page 17 EF Back Panel Components and Cable Connections on page 18 HC Front Panel Components on page 19 HC Back Panel Components and Cable Connections on page 20 Related Information System Components on page 21 Illustra...

Page 17: ... LED white 3 Fault Service Action Required LED amber 4 System OK LED green 5 On Standby button 6 Fault Service Required LED Top Fan Module amber 7 Fault Service Required LED Rear Power Supply amber 8 Fault Service Required LED Overtemp Icon System Over Temperature Warning amber 9 SP OK LED green 10 DO NOT SERVICE LED white About the Oracle Exadata Storage Server X7 2 17 ...

Page 18: ... 5 Oracle Flash Accelerator F640 10 PCIe slot 6 Oracle Flash Accelerator F640 11 Serial management SER MGT RJ 45 serial port 12 Oracle Integrated Lights Out Manager ILOM service processor SP network management NET MGT RJ 45 10 100 1000BASE T port 13 Network NET 100 1000BASE T RJ 45 Gigabit Ethernet GbE port NET 0 14 USB 3 0 connector 15 System status LEDs Locate Button LED white Fault Service Requ...

Page 19: ...ation RFID tag 2 Locate Button LED white 3 Fault Service Action Required LED amber 4 System OK LED green 5 On Standby button 6 Fault Service Required LED Top Fan Module amber 7 Fault Service Required LED Rear Power Supply amber 8 Fault Service Required LED Overtemp Icon System Over Temperature Warning amber 9 SP OK LED green 10 DO NOT SERVICE LED white 11 Storage drive 0 HDD About the Oracle Exada...

Page 20: ...8 HDD 20 Storage drive 9 HDD 21 Storage drive 10 HDD 22 Storage drive 11 HDD HC Back Panel Components and Cable Connections Callout Description 1 Power supply PS 1 2 PS 1 status indicators Fault Service Required LED amber AC OK LED green 3 Power supply PS 0 4 PS 0 status indicators Fault Service Required LED amber AC OK LED green 5 PCIe slot 1 6 PCIe slot 2 20 Oracle Exadata Storage Server X7 2 EF...

Page 21: ...System OK green 16 PCIe slot 7 Oracle Dual Port QDR InfiniBand Adapter M4 17 PCIe slot 8 18 PCIe slot 9 19 PCIe slot 10 Oracle Flash Accelerator F640 20 PCIe slot 11 Oracle Storage 12 Gb SAS PCIe RAID HBA Internal card Related Information Back Panel Connector Locations on page 42 Back Panel Pinhole Switches on page 45 Troubleshooting Using the Server Front and Back Panel Status Indicators on page ...

Page 22: ...nly slots with filler panels EF only 2 Disk backplane 3 System chassis 4 Front LED indicator module 5 Fan modules 6 Fan tray 7 Motherboard assembly 8 Processors and heatsinks 9 Internal M 2 flash SSDs 10 Top cover 11 Optional Oracle Storage 12 Gb SAS PCIe RAID HBA Internal card and super capacitor HC only 22 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 23: ... Add or replace memory modules in the system Servicing the DIMMs on page 101 Storage drives HC only hot service Storage drive configuration supports up to twelve 3 5 inch hot pluggable 10 TB HDDs Servicing Storage Drives on page 67 Internal M 2 flash SSDs Supports up to two internal M 2 flash SSDs Servicing the Internal M 2 Flash SSDs on page 87 Fan modules hot service Four fan modules for cooling...

Page 24: ... Storage 12 Gb SAS PCIe RAID HBA Internal card manages SAS storage drives HC only Servicing the Internal HBA Card and HBA Super Capacitor on page 159 Front LED indicator module Contains the push button circuitry and LEDs that are displayed on the bezel of the chassis Servicing the Front LED Indicator Module on page 145 Motherboard assembly Provides connectors for the DIMMs processors PCIe risers a...

Page 25: ...his section contains maintenance related information and procedures to troubleshoot and repair server hardware issues The following topics are covered Troubleshooting Server Hardware Faults on page 25 Troubleshooting and Diagnostic Information on page 29 Troubleshooting Using the Server Front and Back Panel Status Indicators on page 30 Troubleshooting System Cooling Issues on page 36 Troubleshooti...

Page 26: ... Oracle ILOM Prepare for hot service if the component supports it To hot service components such as storage drives fan modules and power supplies see the removal installation and replacement procedures in this document Prepare for cold service if hot service is not supported for the component Use Oracle to power off the system or server module Use Oracle ILOM to set the OK to Remove status for a s...

Page 27: ... Oracle ILOM web interface and if necessary prepare the server for service Note This procedure provides one basic approach to troubleshooting hardware faults It uses the Oracle ILOM web interface However you can perform procedure using the Oracle ILOM command line interface CLI For more information about the Oracle ILOM web interface and CLI refer to the Oracle ILOM documentation 1 Log in to the s...

Page 28: ...tus page shows that the Processor subsystem requires service which indicates that a hardware component in the subsystem is in a fault state 3 To identify the component in the Status section click Processors The Oracle ILOM Processors page appears The following example shows the Processors subsystem section which indicates that CPU 0 has a fault 28 Oracle Exadata Storage Server X7 2 EF and HC Servi...

Page 29: ...duct Notes go to http www oracle com goto x7 2l docs The Product Notes contain up to date information about the server including hardware related issues 6 To prepare the server for service see Preparing for Service on page 49 After servicing the component you might need to clear the fault in Oracle ILOM For more information refer to the service procedure for the component 7 Service the component M...

Page 30: ...tors on page 31 Server Fan Status Indicators on page 33 Storage Drive Status Indicators on page 33 Power Supply Status Indicators on page 34 Network Management Port Status Indicators on page 34 Ethernet Port Status Indicators on page 34 Motherboard Status Indicators on page 35 Related Information EF Front Panel Components on page 17 EF Back Panel Components and Cable Connections on page 18 HC Fron...

Page 31: ...e are seven system level status indicators LEDs some of which are located on both the server front panel and the back panel For the location of the status indicators see Front and Back Panel Components on page 16 The following table describes these indicators Status Indicator Name Icon Color State and Meaning Locate Button LED White Indicates the location of the server OFF Server is operating norm...

Page 32: ...the state of the service processor OFF Service processor SP is not running SLOW BLINK SP is booting STEADY ON SP is fully operational Top Fan Amber Indicates that one or more of the internal fan modules failed OFF Indicates steady state no service is required STEADY ON Indicates service required Back Power Supply Fault Back Amber Indicates that one of the server power supplies failed OFF Indicates...

Page 33: ... TOP FAN LED and the front and back panel Fault Service Required LEDs are also lit if the system detects a fan module fault Storage Drive Status Indicators There are three status indicators LEDs on each drive which applies to only the HC server Status Indicator Name Icon Color State and Meaning OK Activity Green OFF Power is off or installed drive is not recognized by the system STEADY ON The driv...

Page 34: ...e power supply PS detected a PS fan failure PS overtemperature PS over current or PS over or under voltage Network Management Port Status Indicators The server has one 10 100 1000BASE T Ethernet management domain interface labeled NET MGT There are two status indicators LEDs on this port These indicators are visible from the back of the server Status Indicator Name Location Color State and Meaning...

Page 35: ...he failed processors For more information on processor fault status indicators and the location of the Fault Remind button see Servicing Processors on page 123 Fault Remind Status Indicator This status indicator LED is located next to the Fault Remind button and is powered from the super capacitor that powers the fault LEDs on the motherboard This LED lights to indicate that the fault remind circu...

Page 36: ...fans to pull cool air in from the server front intake vents and exhaust warm air out the server back panel vents If the front or back vents are blocked the airflow through the server is disrupted and the cooling system fails to function properly causing the server internal temperature to rise Inspect the server front and back panel vents for blockage from dust or debris Additionally inspect the se...

Page 37: ...tioning component can continue to maintain the subsystem For example power supplies serve a dual function they provide both power and airflow If one power supply fails the other functioning power supply can maintain both the power and the cooling subsystems Investigate the cause of the overtemperature event and replace failed components immediately For hardware troubleshooting information see Trou...

Page 38: ...not power on Note Use the Velcro straps on the back of the server to secure the power cord connectors to the back of the power supplies The Velcro retaining straps minimize the risk of accidental disconnection Verify that the AC cables are connected to both power supplies Verify that the power supplies are operational the PSU indicator panel must have a lit green AC OK indicator Ensure that the po...

Page 39: ...racle com goto ilom docs Troubleshooting With Diagnostic Tools The server and its accompanying software and firmware contain diagnostic tools and features that can help you isolate component problems monitor the status of a functioning system and exercise one or more subsystems to disclose more subtle or intermittent hardware related problems Each diagnostic tool has its own strength and applicati...

Page 40: ...is not running Local but can be accessed through Oracle ILOM Remote System Console Plus UEFI Diagnostics SP firmware UEFI diagnostics can test and detect problems on all processors memory disk drives and network ports You can use either the Oracle ILOM web interface or the command line interface CLI to run UEFI diagnostics Remote access through Oracle ILOM Remote System Console Plus HWdiag SP firm...

Page 41: ...entation https docs oracle com cd E83848_01 Attaching Devices to the Server The following sections contain procedural information for attaching devices to the server so you can access diagnostic tools when troubleshooting and servicing the server Attach Devices to the Server on page 41 Back Panel Connector Locations on page 42 Configuring Serial Port Sharing on page 43 Ethernet Device Naming on pa...

Page 42: ...he RJ 45 cable to a terminal or terminal emulator log on to Oracle ILOM and type start HOST console See Back Panel Connector Locations on page 42 Back Panel Connector Locations The following illustration shows and describes the locations of the back panel connectors Use this information to set up the server access diagnostic tools and manage the server during service No Cable Port or Expansion Slo...

Page 43: ... terminal or emulator to provide access to the Oracle ILOM command line interface CLI Using Oracle ILOM you can configure it to connect to the system console Note This port does not support network connections Configuring Serial Port Sharing By default the service processor SP controls the serial management SER MGT port and uses it to redirect the host serial console output Using Oracle ILOM you c...

Page 44: ...ng owner host Note The serial port sharing value by default is owner SP 3 Connect a serial host to the server Assign Serial Port Output Using the Oracle ILOM Web Interface 1 Log in to the SP Oracle ILOM web interface Open a web browser and direct it using the IP address of the server SP Log in as root or a user with administrator privileges Refer to Accessing Oracle ILOM in the Oracle X7 Series Se...

Page 45: ...ms The following table shows the BIOS physical and operating system logical naming convention for the interface This naming convention might vary depending on the conventions of your operating system and which devices are installed in the server Note Naming used by the interfaces might vary from that listed below depending on which devices are installed in the system Port Solaris Linux Windows NET...

Page 46: ...ing Help The following sections describe how to get additional help to resolve server problems Contacting Support on page 47 Locating the System Serial Number on page 47 Locating the Exadata Database Machine Rack Serial Numbers and JobID Label on page 48 46 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 47: ...here the system is located Superuser password Summary of the problem and the work being done when the problem occurred Other Useful Information IP address Server name system host name Network or internet domain name Proxy server configuration Related Information Locating the System Serial Number on page 47 Locating the System Serial Number When you ask for service on your system you might need to ...

Page 48: ...from the Exadata Database Machine rack Record these numbers for future use You can find the system serial numbers and JobID label in the following physical locations Look for the Large System Serial Number label and JobID label on the front of the rack inside the door on the left vertical strut starting at rack unit 23 U23 and going down Look for the Small System Serial Number label on the top lef...

Page 49: ...erve the following safety precautions when setting up your equipment Follow all standard cautions warnings and instructions marked on the equipment and described in the Oracle Engineered System Safety and Compliance Guide Compliance Model No ESY27 and Important Safety Information for Oracle s Hardware Systems Ensure that the voltage and frequency of your power source match the voltage and frequenc...

Page 50: ...charge Safety Devices that are sensitive to electrostatic discharge ESD such as the motherboard PCIe cards drives processors and memory DIMMs require special handling See Contacting Support on page 47 Caution The boards and drives contain electronic components that are extremely sensitive to static electricity Ordinary amounts of static electricity from clothing or the work environment can destroy...

Page 51: ...ent parts or optional system components Related Information Safety Precautions on page 49 Safety Symbols on page 50 Preparing the Server for Component Replacement on page 52 Returning the Server to Operation on page 187 Key Identity Properties KIP Automated Update Oracle ILOM includes a key identity properties KIP auto update feature that ensures product information that is used for service entitl...

Page 52: ... Required Tools The server can be serviced with the following tools Antistatic wrist strap Antistatic mat No 2 Phillips screwdriver Torx 6 lobe T15 T25 and T30 screwdrivers 12 0 in lbs ft inch pounds foot torque driver Related Information Preparing for Service on page 49 Preparing the Server for Component Replacement Note When you replace the storage drives or power supplies not all of these proce...

Page 53: ... powered down when performing service procedures Description Link Power down the server gracefully to prevent data from being corrupted Performing a graceful shutdown ensures that the system is ready for restart Power Down the Server Gracefully Using the Oracle ILOM CLI on page 54 Power Down the Server Gracefully Using the Oracle ILOM Web Interface on page 55 Power Down the Server Gracefully Using...

Page 54: ...e interface CLI using an Administrator account For instructions refer to the Oracle Exadata Database Machine Installation and Configuration Guide at https docs oracle com cd E80920_01 index htm 5 At the Oracle ILOM prompt shut down the operating system stop System Note The stop System command does not guarantee a system shutdown This command is only a request to the host operating system OS to per...

Page 55: ...he system is ready for restart 1 Log in to the server as superuser or equivalent Depending on the nature of the problem you might want to view the system status or the log files or run diagnostics before you shut down the system For log file information refer to the Oracle Integrated Lights Out Manager ILOM 4 0 Documentation Collection at http www oracle com goto ilom docs 2 Notify affected users ...

Page 56: ... the On Standby Button on page 59 Power On the Server on page 193 Power Down the Server Gracefully Using the On Standby Button 1 Press and quickly release the On Standby button on the front panel This action causes ACPI enabled operating systems to perform an orderly shutdown of the operating system Servers not running ACPI enabled operating systems shut down to Standby power mode immediately When...

Page 57: ...e default command prompt indicating that you have successfully logged in to Oracle ILOM 2 From the CLI prompt type the following command stop f System The server powers down immediately to Standby power mode and the System OK LED on the front panel begins blinking See Server System Level Status Indicators on page 31 3 Disconnect the power and data cables from the server See Disconnect Cables From ...

Page 58: ...er Off 3 Click Save and click OK The server powers down immediately to Standby power mode and the System OK LED on the front panel begins blinking See Server System Level Status Indicators on page 31 4 Disconnect the power and data cables from the server See Disconnect Cables From the Server on page 59 Caution When you power down the server using Oracle ILOM the server enters Standby power mode Po...

Page 59: ...ver System Level Status Indicators on page 31 2 Disconnect the power cords and data cables from the server See Disconnect Cables From the Server on page 59 Caution When you power down the server using the On Standby button the server enters Standby power mode Power is still directed to the service processor remote management subsystem and power supply fans To completely power off the server you mu...

Page 60: ...ve the server from the rack Related Information EF Back Panel Components and Cable Connections on page 18 Powering Down the Server on page 53 Extend the Server to the Maintenance Position on page 60 Remove the Server From the Rack on page 62 Reconnect Power and Data Cables on page 192 Extend the Server to the Maintenance Position You can service the following components with the server in the main...

Page 61: ...ml 2 Verify that no cables are damaged or are going to interfere when the server is extended Although the cable management arm CMA that is supplied with the server is hinged to accommodate extending the server ensure that all cables and cords are capable of extending 3 From the front of the server open and hold the left and right release latch covers in the open position When in an open position t...

Page 62: ...d carry the chassis 1 Disconnect all the cables and power cords from the server 2 Remove the cable management arm CMA For instructions for removing the CMA see the Remove the Cable Management Arm in Oracle Exadata Storage Server X7 2 EF and HC Installation Guide 3 Extend the server to the maintenance position See Extend the Server to the Maintenance Position on page 60 4 From the front of the serv...

Page 63: ... during removal and installation Place electrostatic discharge ESD sensitive components on an antistatic mat You can use the following items as an antistatic mat An antistatic bag used to wrap a replacement part An Oracle ESD mat orderable item A disposable ESD mat shipped with some replacement parts or optional system components 2 Attach an antistatic wrist strap When servicing or removing server...

Page 64: ...rom the Rack on page 62 Remove the Server Top Cover on page 64 Remove Antistatic Measures on page 190 Remove the Server Top Cover Note Servicing some components requires that the top cover be removed 1 Ensure that AC power cords are disconnected from the server power supplies Note Fan modules and M 2 flash SSDs are hot pluggable and do not require AC power cables to be disconnected from the server...

Page 65: ...urn the release button latch clockwise to the unlocked position 3 Unlatch the top cover 1 Lift up on the release button on top of the server cover Lifting the release button causes the server cover to slide toward the rear of the chassis for easy removal 4 Lift up and remove the top cover 2 Preparing for Service 65 ...

Page 66: ...Remove the Server Top Cover Related Information Take Antistatic Measures on page 63 Install the Server Top Cover on page 189 66 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 67: ... The hard disk drives HDDs that are installed in the HC server are hot pluggable but this capability depends on how you configure the drives To hot plug a drive you must take the drive offline before you can remove it When you take the drive offline you prevent any application from accessing the drive and remove the logical software links to the drive The following conditions inhibit the ability t...

Page 68: ...nal system software designations for the drives For information on storage drive status indicators LEDs see Storage Drive Status Indicators on page 33 Callout Description 1 Storage drive 0 HDD 2 Storage drive 4 HDD 3 Storage drive 8 HDD 4 Storage drive 1 HDD 5 Storage drive 5 HDD 6 Storage drive 9 HDD 7 Storage drive 2 HDD 8 Storage drive 6 HDD 9 Storage drive 10 HDD 10 Storage drive 3 HDD 68 Orac...

Page 69: ... storage drive locations see Storage Drive Locations and Numbering on page 68 3 Remove the storage drive If you are removing an HDD storage drive type the required operating system commands to stop the server from using the drive otherwise proceed to the next step The exact commands required depend on the configuration of your drives Unmount file systems or issue RAID commands as needed Note The b...

Page 70: ...ive latch 1 2 Callout Description 1 Pressing the latch release button 2 Opening the latch Caution The latch is not an ejector Do not open the latch too far to the right Doing so can damage the latch 70 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 71: ...r airflow and perform administrative tasks to configure the server to operate without the drive For information on how to install a storage drive filler panel see Remove and Install Filler Panels on page 187 Related Information Storage Drive Status Indicators on page 33 Storage Drives Hot Plug Conditions on page 67 Install a Storage Drive on page 71 Install a Storage Drive 1 Remove the replacement...

Page 72: ...until the drive is fully seated 5 Close the drive latch to lock the drive in place 6 Perform administrative procedures to reconfigure the drive The procedures that you perform at this point depend on how you configured your data You might need to partition the drive create file systems load data from backups or have the drive updated from a RAID configuration Related Information Storage Drive Stat...

Page 73: ...ght away Caution When removing and replacing a fan module in the Oracle Exadata Storage Server X7 2 complete the entire procedure within 60 seconds to maintain adequate cooling within the system Remove and replace only one fan module at a time Ensure that you have obtained the replacement fan module and that is it is ready for installation before starting the replacement procedure Each fan module ...

Page 74: ...dule Each fan module has a fan status indicator LED that is located next to the module If the LED is amber the fan has failed The location of the fan status LED is shown in the following figure LED Color and State Meaning Amber The fan module is faulty The front Top Fan LED and the front and back panel Fault Service Required LEDs also are lit if the system detects a fan module fault 74 Oracle Exad...

Page 75: ...fan assembly as part of another procedure return to that procedure Otherwise continue to Install a Fan Module on page 75 Related Information Install a Fan Module on page 75 Install a Fan Module 1 Remove the replacement fan module from its packaging and place it on an antistatic mat 2 With the server top cover removed install the replacement fan module into the server Servicing Fan Modules 75 ...

Page 76: ...ront of the server and the Fault Service Required LEDs on the front and back of the server are off See Server System Level Status Indicators on page 31 for more information about identifying and interpreting system status indicators 7 Consider your next step If you installed the fan module as part of another procedure return to that procedure Otherwise if you powered off the server return the serv...

Page 77: ...eplaceable units Disk backplane SAS cables Motherboard assembly 1 Using a Torx T25 screwdriver loosen the three spring mounted screws that secure the fan tray to the server chassis 1 2 Lift the fan tray from the server 2 3 Continue with the next step in the service procedure Servicing Fan Modules 77 ...

Page 78: ... page 137 Servicing SAS Cables on page 167 Servicing the Motherboard Assembly on page 173 Install the Fan Tray Perform this procedure only when servicing the following replaceable units Disk backplane SAS cables Motherboard assembly 78 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 79: ... mounted screws that secure the fan tray to the server chassis 2 3 Continue with the next step in the service procedure Related Information Install a Fan Module on page 75 Servicing the Disk Backplane on page 137 Servicing SAS Cables on page 167 Servicing the Motherboard Assembly on page 173 Servicing Fan Modules 79 ...

Page 80: ...80 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 81: ... to the system accepting ranges from 100 240 volts AC VAC These PSUs are designed to be hot pluggable and in most cases provide fully redundant 1 1 power allowing the system to suffer the loss of a PSU or an AC feed with no loss to system availability In maximally configured systems it is possible that the worst case power consumption of the system could exceed the capacity of a single PSU The PSU...

Page 82: ...ower supply fails and you do not have a replacement available leave the failed power supply installed to ensure proper airflow in the server Related Information Troubleshooting Using the Server Front and Back Panel Status Indicators on page 30 Remove a Power Supply 1 Prepare the system for power supply removal Refer to Take Antistatic Measures on page 63 2 Identify which power supply requires repl...

Page 83: ... Documentation Library at http www oracle com goto ilom docs Note The fans of a failed power supply might still be spinning when the system is powered on The fans stop spinning when you disconnect the power cords 3 Gain access to the rear of the server where the faulty power supply is located 4 If the cable management arm CMA is installed disconnect both CMA left side connectors and move the CMA o...

Page 84: ...e server might overheat due to improper airflow 8 Continue to Install a Power Supply on page 84 Related Information EF Back Panel Components and Cable Connections on page 18 Power Supply Status Indicators on page 34 Install a Power Supply on page 84 Install a Power Supply Caution Always replace the failed power supply with the same type model of power supply 84 Oracle Exadata Storage Server X7 2 E...

Page 85: ...Fault Service Required LEDs are not lit on the front and back panels Note After you replace Power Supply 0 you might need to reset the Oracle ILOM service processor SP to propagate the key identity properties KIP data to the new power supply For instructions on resetting the SP refer to the Oracle Integrated Lights Out Manager ILOM 4 0 Configuration and Maintenance Guide Firmware Release 4 0 x at ...

Page 86: ...Management Arm Optional in Oracle Exadata Storage Server X7 2 EF and HC Installation Guide Related Information EF Back Panel Components and Cable Connections on page 18 Power Supply Status Indicators on page 34 Remove a Power Supply on page 82 86 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 87: ...ensure that you follow antistatic practices as described in Take Antistatic Measures on page 63 This section covers the following procedures Remove a Flash Riser Board on page 87 Install a Flash Riser Board on page 89 Identify and Remove an M 2 Flash SSD on page 91 Install an M 2 Flash SSD on page 93 Related Information Servicing Storage Drives on page 67 Remove a Flash Riser Board The server can ...

Page 88: ...ward as far as they go Note The green power LED on the riser board is extinguished when you open the socket ejectors b Carefully lift the riser board straight up to remove it from the sockets Place the riser board on an antistatic mat If required perform the procedures for removing the M 2 flash SSD from the flash riser board For instructions see Identify and Remove an M 2 Flash SSD on page 91 Rel...

Page 89: ...you installed an M 2 flash SSD onto the riser board before installing the riser board into the server For instructions see Install an M 2 Flash SSD on page 93 2 Install the flash riser board a Ensure that the ejector tabs are in the open position b Align the notch in the replacement riser board with the connector key in the connector socket The notch ensures that the riser board is oriented correc...

Page 90: ...t ejectors inward until the ejector tabs lock the riser board in place 3 Optional Repeat Step 2 to install a second flash riser board into the server 4 Return the server to operation a Install the server top cover See Install the Server Top Cover on page 189 b Return the server to the normal rack position See Return the Server to the Normal Rack Position on page 191 Related Information Remove a Fl...

Page 91: ...ge 64 2 Identify and note the location of the faulty M 2 flash SSD by pressing the Fault Remind button on the motherboard See Using the Server Fault Remind Button on page 104 Faulty SSDs are identified with a corresponding amber LED on the flash riser board If the SSD fault LED is off then the SSD is operating properly If the SSD fault LED is on amber then the SSD is faulty and must be replaced 1 ...

Page 92: ...iser board 1 5 Remove the plastic retainer clip from the M 2 flash SSD 6 Remove the M 2 flash SSD from the riser board 2 a Lift up on the end of the M 2 flash SSD where the plastic retainer clip was removed by one half to one inch b Gently slide the M 2 flash SSD card toward the back of the riser board and out of the connector to disengage the SSD contacts from the riser board socket Place the M 2...

Page 93: ...tic retainer clip is approximately one half to one inch above the riser board and the other end is adjacent to the riser SSD socket 1 c Gently slide the M 2 flash SSD forward and into the connector to engage the flash SSD contacts with the riser board socket 2 d Using your fingers push down on the end of the card containing the plastic retainer clip until the M 2 flash SSD snaps into place on the ...

Page 94: ...oard on page 89 4 Return the server to operation a Install the server top cover See Install the Server Top Cover on page 189 b Return the server to the normal rack position See Return the Server to the Normal Rack Position on page 191 Related Information Identify and Remove an M 2 Flash SSD on page 91 94 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 95: ... system Caution You must disconnect all power cables from the system before performing these procedures This section covers the following procedures Remove the Air Baffle on page 95 Install the Air Baffle on page 97 Related Information Servicing the DIMMs on page 101 Servicing Processors on page 123 Remove the Air Baffle 1 Prepare the server for service a Power off the server and disconnect the po...

Page 96: ...sis See Take Antistatic Measures on page 63 d Remove the server top cover See Remove the Server Top Cover on page 64 2 Release the latch for the host bus adapter HBA super capacitor tray and rotate the tray 1 in to the upright position 2 96 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 97: ... Consider your next step If you removed the air baffle as part of another procedure return to that procedure Otherwise continue to Install the Air Baffle on page 97 Related Information Install the Air Baffle on page 97 Install the Air Baffle 1 Remove the replacement air baffle from its packaging Servicing the Air Baffle 97 ...

Page 98: ...l the air baffle by placing it into the server and lowering it to its inserted position 3 Rotate the HBA super capacitor tray down and in to its closed position 98 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 99: ... Return the server to operation a Install the server top cover See Install the Server Top Cover on page 189 b Return the server to the normal rack position See Return the Server to the Normal Rack Position on page 191 c Reconnect the power cords and data cables to the server See Reconnect Power and Data Cables on page 192 d Power on the server See Power On the Server on page 193 Verify that the po...

Page 100: ...Install the Air Baffle Related Information Remove the Air Baffle on page 95 100 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 101: ...to fail To avoid damage ensure that you follow antistatic practices as described in Take Antistatic Measures on page 63 Caution Ensure that all power is removed from the server before removing or installing DIMMs or damage to the DIMMs might occur You must disconnect all power cables from the system before performing these procedures The following topics and procedures provide information to assis...

Page 102: ... processor P0 and P1 has twelve DIMM slots organized into six memory channels Each channel contains two DIMM slots a black DIMM slot channel slot 0 and a white DIMM slot channel slot 1 Related Information DIMM Population Scenarios on page 103 DIMM Population Rules on page 103 DIMM Operating Speeds on page 104 Inconsistencies Between DIMM Fault Indicators and the BIOS Isolation of Faulty DIMMs on p...

Page 103: ...sing the Server Fault Remind Button on page 104 Identify and Remove a DIMM on page 105 Install a DIMM on page 107 DIMM Population Rules The population rules for adding DIMMs to the server are as follows If your memory configuration uses only twelve DIMM slots populate only the black DIMM slot channel slot 0 within each memory channel The Oracle Exadata Storage Server X7 2 uses a fixed base configu...

Page 104: ...hen the Fault Remind button is pressed only the fault status indicator LED associated with the failed DIMM lights The fault LEDs for the other DIMMs in the memory channel remain off Therefore you can correctly identify the failed DIMM using the lit LED Using the Server Fault Remind Button When the server Fault Remind button is pressed an LED located next to the Fault Remind button lights green to ...

Page 105: ...o the Maintenance Position on page 60 c Attach an antistatic wrist strap to your wrist and then to a metal area on the chassis See Take Antistatic Measures on page 63 d Remove the server top cover See Remove the Server Top Cover on page 64 e Remove the air baffle See Remove the Air Baffle on page 95 2 Identify and note the location of the faulty DIMM by pressing the Fault Remind button on the moth...

Page 106: ...hen the DIMM is operating properly If the DIMM Fault LED is on amber then the DIMM is faulty and must be replaced 1 3 To remove the faulty DIMM do the following a Rotate both DIMM slot ejectors outward as far as they go The DIMM is partially ejected from the slot 106 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 107: ...DIMM Population Rules on page 103 Install a DIMM on page 107 Install a DIMM 1 Unpack the replacement DIMM and place it on an antistatic mat 2 Ensure that the replacement DIMM matches the size type and rank of the DIMM it is replacing You must not replace a quad rank DIMM with a dual rank DIMM and vice versa If you violate this rule the performance of the server might be adversely affected For DIMM...

Page 108: ...abs lock the DIMM in place If the DIMM does not easily seat into the connector slot verify that the notch in the DIMM is aligned with the connector key in the connector slot If the notch is not aligned damage to the DIMM might occur 4 Repeat Step 3 until all replacement DIMMs are installed 5 Return the server to operation a Install the air baffle See Install the Air Baffle on page 97 b Install the...

Page 109: ...y cleared after a new DIMM is installed If you need to manually clear DIMM faults refer to the Oracle Integrated Lights Out Manager ILOM 4 0 Documentation Library at http www oracle com goto ilom docs Note If you want to move a faulty DIMM to a new DIMM slot or re seat a DIMM for troubleshooting you must first manually clear the associated DIMM fault Otherwise the DIMM fault might follow the DIMM ...

Page 110: ...110 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 111: ...ion These procedures require that you handle components that are sensitive to electrostatic discharge This sensitivity can cause the components to fail To avoid damage ensure that you follow antistatic practices as described in Take Antistatic Measures on page 63 Caution Ensure that all power is removed from the server before removing or installing PCIe cards You must disconnect all power cables f...

Page 112: ...ly 4 PCIe slot 4 Oracle Flash Accelerator F640 EF and HC servers 5 PCIe slot 5 Oracle Flash Accelerator F640 EF and HC servers 6 PCIe slot 6 Oracle Flash Accelerator F640 EF and HC servers 7 PCIe slot 7 Oracle Dual Port QDR InfiniBand Adapter M4 EF and HC servers 8 PCIe slot 8 Oracle Flash Accelerator F640 EF server only 9 PCIe slot 9 Oracle Flash Accelerator F640 EF server only 10 PCIe slot 10 Or...

Page 113: ...server for service a If you are removing an Oracle Dual Port QDR InfiniBand Adapter M4 card power off the server and disconnect the power cords from the server power supplies Otherwise skip to Step 1b See Powering Down the Server on page 53 b Extend the server to the maintenance position See Extend the Server to the Maintenance Position on page 60 c Attach an antistatic wrist strap See Take Antist...

Page 114: ...Locations on page 112 4 If necessary record where the PCIe cards are installed 5 Rotate the PCIe card locking mechanism in to an upright position 1 and lift up on the PCIe card to disengage it from the motherboard connectors 2 6 Place the PCIe card on an antistatic mat 114 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 115: ... the replacement PCIe card and place it on an antistatic mat 2 Locate the proper PCIe slot for the card you are replacing For the EF server PCIe slots 2 3 4 5 6 8 9 and 10 are the primary slots for Oracle Flash Accelerator F640 cards For the HC server PCIe slots 4 5 6 and 10 are the primary slots for Oracle Flash Accelerator F640 cards 3 If necessary remove the PCIe filler panel from the slot Note...

Page 116: ...lot 5 Return the server to operation a Install the top cover See Install the Server Top Cover on page 189 b Return the server to the normal rack position See Return the Server to the Normal Rack Position on page 191 116 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 117: ...a PCIe card fault see the procedure Clear Faults for Undetected Replaced or Repaired Hardware Components in the Oracle ILOM User s Guide for System Monitoring and Diagnostics Firmware Release 4 0 x in the Oracle Integrated Lights Out Manager ILOM 4 0 Documentation Library at http www oracle com goto ilom docs 7 To determine whether additional steps are required to complete the installation of the ...

Page 118: ...118 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 119: ...ed to a network replace the battery Caution Ensure that all power is removed from the server before removing or installing the battery You must disconnect the power cables from the system before performing this procedure This section covers the following procedures Remove the Battery on page 119 Install the Battery on page 121 Related Information Extend the Server to the Maintenance Position on pa...

Page 120: ...er use your finger to gently push the top edge of the battery away from the retainer Note To gain access to the battery you might need to disconnect and move aside the auxiliary signal cable to the disk backplane and the SAS cables to the Internal HBA For more information see Servicing the Disk Backplane on page 137 and Servicing SAS Cables on page 167 3 Lift the battery up and out of its retainer...

Page 121: ...ata Cables on page 192 and Power On the Server on page 193 Note If the service processor is configured to synchronize with a network time server using the Network Time Protocol NTP the Oracle ILOM SP clock is reset as soon as the server is powered on and connected to the network otherwise proceed to the next step d Verify that the System OK LED is lit 4 If the service processor is not configured t...

Page 122: ...Install the Battery Related Information Remove the Battery on page 119 122 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 123: ...personnel Caution These procedures require that you handle components that are sensitive to electrostatic discharge This sensitivity can cause the component to fail To avoid damage ensure that you follow electrostatic discharge safety measures and antistatic practices See Electrostatic Discharge Safety on page 50 This section covers the following topics Identify and Remove a Processor on page 123 ...

Page 124: ... on page 95 2 Identify the location of the failed processor by pressing the Fault Remind button on the motherboard Note When you press the Fault Remind button an LED located next to the Fault Remind button lights green indicating that there is sufficient voltage in the fault remind circuit to light any fault LEDs that were lit due to a failure If this LED fails to light when you press the Fault Re...

Page 125: ...ocessor If the processor fault LED is on amber the processor failed and you must replace it Callout Description 1 Fault Remind button 2 Fault Remind LED 3 Processor 0 fault LED 4 Processor 1 fault LED Servicing Processors 125 ...

Page 126: ...ink module to the socket fully loosen nut 4 then 3 then 2 then 1 1 4 Lift the processor heatsink module from the socket 2 Always hold the processor heatsink module along the axis of the fins to prevent damage 5 Separate the processor from the heatsink 126 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 127: ...ssor heatsink module place it on a flat surface and locate the thermal interface material TIM breaker slot b While holding down the processor heatsink modules by the edges insert a flat blade screwdriver into the TIM breaker slot Servicing Processors 127 ...

Page 128: ...o the slot between the heatsink and processor carrier not between the processor and processor carrier c Use a rocking motion to gently pry the corner of the processor carrier away from the heatsink 128 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 129: ...ther components 6 If you plan on reusing either the heatsink or processor use an alcohol pad to clean the thermal grease on the underside of the heatsink and on the top of the processor If reusing a processor do not remove it from the processor carrier Caution Failure to clean thermal grease from the heatsink could result in the accidental contamination of the processor socket or other components ...

Page 130: ...sor that you removed For a description of the processors that are supported by the server see Product Description on page 15 3 Use the syringe supplied with the new or replacement processor 1 to apply 0 3 cc of thermal interface material TIM in an X pattern to the processor contact area of the heatsink 2 Note Do not distribute the TIM the pressure of the heatsink will do so for you when you instal...

Page 131: ...nd place the heatsink thermal grease side down onto the processor carrier until it snaps in place and lies flat Note The processor carrier has latching posts at each corner two that insert into heatsink holes and two that attach to the edge of the heatsink Callout Description 1 Pin 1 indicator Servicing Processors 131 ...

Page 132: ...processor heatsink module to the processor socket bolster plate on the motherboard matching the pin 1 location 1 A small pin 1 indicator triangle is near the beveled corner of the socket Callout Description 1 Pin 1 indicator 132 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 133: ...odule during installation f Ensure that the processor heatsink module lies evenly on the bolster plate and that the captive screws align with the threaded socket posts 1 g Using a 12 0 in lbs inch pounds torque driver part number 7352217 with a Torx T30 bit tighten the processor heatsink module to the socket First fully tighten captive nuts 1 and 2 Then fully tighten nuts 3 and 4 2 Servicing Proce...

Page 134: ...ify that the power supply AC OK LED is lit 6 Use Oracle ILOM to clear server processor faults Refer to the Oracle Integrated Lights Out Manager ILOM 4 0 Documentation Library at http www oracle com goto ilom docs for more information about the following steps a To show server faults log in to the server as root using the Oracle ILOM CLI and type the following command to list all known faults on th...

Page 135: ...r_fault_action true Are you sure you want to clear SYS MB P0 y n y Set clear_fault_action to true Alternatively to clear all known faults in the server log in to the Oracle Solaris OS and issue the fmadm repair command or log in to the Oracle ILOM service processor from the Oracle ILOM Fault Management Shell and issue the fmadm repair command For more information about how to use the Oracle ILOM F...

Page 136: ...136 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 137: ...er before removing or installing the disk backplane You must disconnect the power cables before performing this procedure To remove and install the disk backplane follow these procedures Remove the Disk Backplane on page 137 Install the Disk Backplane on page 141 Related Information Servicing Storage Drives on page 67 Servicing SAS Cables on page 167 Remove the Disk Backplane 1 Prepare the server ...

Page 138: ...e Remove the Fan Tray on page 77 2 Pull each storage drive out far enough to disengage it from the backplane See Remove a Storage Drive on page 69 Note It is not necessary to completely remove the storage drives from the server simply pull them out far enough to disengage them from the backplane If you do remove the storage drives from the server make a note of their locations so that you can rein...

Page 139: ...ng the connector from the disk backplane Note the cable connections in order to ease proper reconnection of the cables c Disconnect the temperature sensor cable from the disk backplane 2 d Disconnect the auxiliary signal cable from the disk backplane 2 Servicing the Disk Backplane 139 ...

Page 140: ...oosen the spring mounted screws that secure the backplane bracket to the chassis and lift the bracket from the server 4 6 Lift the disk backplane up to release it from the standoff hooks and out of the chassis 5 and 6 7 Place the disk backplane on an antistatic mat Related Information Install the Disk Backplane on page 141 140 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 141: ...disk backplane into the server and position it to engage the standoff hooks 1 and 2 2 Lower the backplane bracket into the server and using a Torx T25 screwdriver tighten the spring mounted screws to secure the bracket to the chassis 3 Servicing the Disk Backplane 141 ...

Page 142: ... 6 5 Return the server to operation a Install the fan tray See Install the Fan Tray on page 78 b Install the fan modules See Install a Fan Module on page 75 c Install the air baffle See Install the Air Baffle on page 97 d Install the server top cover See Install the Server Top Cover on page 189 e Install all storage drives into the storage drive cage See Install a Storage Drive on page 71 f Return...

Page 143: ...d by Oracle ILOM to contain the same KIP as the other quorum member components If you removed other quorum member components you might need to manually program the product serial number PSN into the new backplane For more information refer to Key Identity Properties KIP Automated Update on page 51 Related Information Remove the Disk Backplane on page 137 Servicing the Disk Backplane 143 ...

Page 144: ...144 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 145: ... a front LED indicator module You must disconnect the power cables before performing this procedure This section covers the following procedures Remove the Front LED Indicator Module on page 145 Install the Front LED Indicator Module on page 148 Related Information Troubleshooting Using the Server Front and Back Panel Status Indicators on page 30 Remove the Front LED Indicator Module 1 Prepare the...

Page 146: ...m the motherboard Note On the HC server you might need to disconnect the SAS cable connections from the Oracle Storage 12 Gb SAS PCIe RAID HBA Internal card in PCIe slot 11 to access the LED indicator module motherboard cable connection To ease removal of the LED indicator module cable slightly lift the SAS cable bundles from the cable trough along the left side of the chassis See Servicing SAS Ca...

Page 147: ...s cover slot 1 Set aside the FIM cable and Temp Sensor Access cover 5 Remove the front LED indicator module 2 a Remove the two No 2 Phillips screws that secure the LED indicator module to the server front panel b Remove the LED indicator module and cable from the server front panel Remove the LED indicator module cable by carefully pulling the cable through the cable trough along the left side of ...

Page 148: ...he Front LED Indicator Module 1 Install the front LED indicator module a Push the LED indicator module and cable through the LED housing on the server front panel 1 b Install the LED indicator module cable by carefully pulling the cable through the cable trough along the left side of the chassis 148 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 149: ... indicator module to the server front panel 1 d Install the FIM cable and Temp Sensor Access cover to the chassis by inserting it into the FIM cable and Temp Sensor Access cover slot 2 Caution Be careful not to damage the temperature sensor when installing the FIM cable and Temp Sensor Access cover to the chassis e Install the three No 2 Phillips screws to secure the FIM cable and Temp Sensor Acce...

Page 150: ...3 Return the server to operation a Install the server top cover See Install the Server Top Cover on page 189 b Return the server to the normal rack position See Return the Server to the Normal Rack Position on page 191 c Reconnect the power cords to the power supplies and power on the server See Reconnect Power and Data Cables on page 192 and Power On the Server on page 193 d Verify that the power...

Page 151: ...Install the Front LED Indicator Module Related Information Server System Level Status Indicators on page 31 Remove the Front LED Indicator Module on page 145 Servicing the Front LED Indicator Module 151 ...

Page 152: ...152 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 153: ...nsor disconnect the power cables to remove all power from the server This section covers the following procedures Remove the Temperature Sensor on page 153 Install the Temperature Sensor on page 156 Related Information Troubleshooting Using the Server Front and Back Panel Status Indicators on page 30 Remove the Temperature Sensor 1 Prepare the server for service a Power off the server and disconne...

Page 154: ...easures on page 63 d Remove the server top cover See Remove the Server Top Cover on page 64 2 Remove the fan modules and the fan tray See Remove a Fan Module on page 73 and Remove the Fan Tray on page 77 3 Disconnect the temperature sensor cable from the disk backplane 154 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 155: ...r from the FIM cable and Temp Sensor Access cover slot 2 6 Set aside the FIM cable and Temp Sensor Access cover 7 Remove the temperature sensor by carefully pulling the sensor cable rearward and through the cable trough along the left side of the chassis Then lift the temperature sensor from the chassis 3 Related Information Install the Temperature Sensor on page 156 Servicing the Temperature Sens...

Page 156: ...rough the opening and install it into the cable trough along the left side of the chassis 1 2 Install the FIM cable and Temp Sensor Access cover to the chassis by inserting it into the FIM cable and Temp Sensor Access cover slot 2 3 Install the three No 2 Phillips screws to secure the FIM cable and Temp Sensor Access cover to the chassis 3 156 Oracle Exadata Storage Server X7 2 EF and HC Service M...

Page 157: ...cover See Install the Server Top Cover on page 189 b Return the server to the normal rack position See Return the Server to the Normal Rack Position on page 191 c Reconnect the power cords to the power supplies and power on the server See Reconnect Power and Data Cables on page 192 and Power On the Server on page 193 d Verify that the power supply AC OK LED is lit Related Information Remove the Te...

Page 158: ...158 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 159: ...tml Caution Ensure that all power is removed from the server before removing or installing the internal HBA card and super capacitor You must disconnect all power cables from the system before performing these procedures Caution These procedures require that you handle components that are sensitive to electrostatic discharge This sensitivity can cause the components to fail To avoid damage ensure ...

Page 160: ...ssis Note If you are removing and replacing only the internal HBA card you do not need to remove the HBA super capacitor You can disconnect the HBA super capacitor cable from the internal HBA card and then remove the internal HBA card from the system a Grasp both ends of the cable connector press in on the release latch and unplug the connector 1 The HBA super capacitor is secured to the HBA super...

Page 161: ...Card and HBA Super Capacitor When removing the super capacitor by careful not to snag the cable on the tray wire guide Place the super capacitor on an antistatic mat Servicing the Internal HBA Card and HBA Super Capacitor 161 ...

Page 162: ...e super capacitor cable and the SAS cables from the Oracle Storage 12Gb SAS PCIe RAID HBA Internal card 1 See also Remove SAS Storage Drive Cables on page 167 5 Lift and remove the internal HBA card and super capacitor cable from the chassis 2 6 Place the internal HBA card and super capacitor cable on an antistatic mat 162 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 163: ...nstall the Internal HBA Card and HBA Super Capacitor 1 Unpack the replacement internal HBA card and super capacitor and place them on an antistatic mat 2 Insert the internal HBA card into PCIe slot 11 and rotate the PCIe locking mechanism to secure the PCIe HBA card in place 1 and 2 Servicing the Internal HBA Card and HBA Super Capacitor 163 ...

Page 164: ...naging the SAS storage drives 3 Connect the super capacitor cable to the internal HBA card and reconnect the SAS cables that you unplugged during the removal procedure 2 To ensure proper SAS cable connections see Install SAS Storage Drive Cables on page 170 4 Install the HBA super capacitor in the chassis 164 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 165: ... of the super capacitor b Align the recloseable fastener on the super capacitor with the recloseable fastener on the HBA super capacitor tray and press down 1 c Route the super capacitor cable through the tray wire guide on the HBA super capacitor tray and connect the super capacitor cable 2 5 Return the server to operation a Install the top cover See Install the Server Top Cover on page 189 Servi...

Page 166: ...CIe card fault message in Oracle ILOM is not cleared under Open Problems you must manually clear the fault using Oracle ILOM For instructions for manually clearing a PCIe card fault see the procedure Clear Faults for Undetected Replaced or Repaired Hardware Components in the Oracle ILOM User s Guide for System Monitoring and Diagnostics Firmware Release 4 0 x in the Oracle Integrated Lights Out Ma...

Page 167: ... is powered off To avoid personal injury or damage to the server you must disconnect power cords before servicing the cables This section covers the following procedures Remove SAS Storage Drive Cables on page 167 Install SAS Storage Drive Cables on page 170 Related Information Servicing Storage Drives on page 67 Servicing the Disk Backplane on page 137 Remove SAS Storage Drive Cables 1 Prepare th...

Page 168: ...sures on page 63 d Remove the server top cover See Remove the Server Top Cover on page 64 e Remove the air baffle See Remove the Air Baffle on page 95 f Remove fan modules See Remove a Fan Module on page 73 g Remove the fan tray from the server See Remove the Fan Tray on page 77 2 Disconnect the SAS cables from the disk backplane 1 168 Oracle Exadata Storage Server X7 2 EF and HC Service Manual Ma...

Page 169: ...latch and then pull out to disengage the cable from each connector See also Remove the Internal HBA Card and HBA Super Capacitor on page 159 4 Remove the SAS cables from the server 3 Carefully remove the SAS cable bundles from the server Be careful not to snag the cables on the server components Related Information Remove the Internal HBA Card and HBA Super Capacitor on page 159 Install SAS Storag...

Page 170: ...2 Plug each cable into its SAS connector until you hear an audible click To ensure proper connections see the SAS cable connections table in Step 3 See also Install the Internal HBA Card and HBA Super Capacitor on page 163 Note SAS cable kit part number 7117126 is required to connect the SAS Host Bus Adapter HBA card to the disk backplane 3 Reconnect the SAS cables to the disk backplane 3 Plug eac...

Page 171: ...an tray See Install the Fan Tray on page 78 b Install the fan modules See Install a Fan Module on page 75 c Install the air baffle See Install the Air Baffle on page 97 d Install the server top cover See Install the Server Top Cover on page 189 e Return the server to the normal rack position See Return the Server to the Normal Rack Position on page 191 f Reconnect the power cords to the power supp...

Page 172: ...172 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 173: ...on These procedures require that you handle components that are sensitive to electrostatic discharge This discharge can cause server components to fail To avoid damage ensure that you follow the antistatic practices This section covers the following procedures Remove the Motherboard Assembly on page 173 Install the Motherboard Assembly on page 181 Related Information System Components on page 21 R...

Page 174: ...ve the HBA super capacitor tray by squeezing the plastic hinges together and lifting the tray from the chassis 3 Remove the following reusable components Caution During the motherboard removal procedure it is important to label power supplies with the slot numbers from which they were removed PS0 PS1 This is required because the power supplies must be reinstalled into the slots from which they wer...

Page 175: ...pply on page 82 4 Disconnect the following cables from the motherboard Front LED indicator module ribbon cable See Servicing the Front LED Indicator Module on page 145 Disk backplane auxiliary signal cable See Servicing the Disk Backplane on page 137 Disk backplane power cable See Servicing the Disk Backplane on page 137 SER MGT RJ 45 serial cable Servicing the Motherboard Assembly 175 ...

Page 176: ...Remove the Motherboard Assembly Disconnect and remove the SER MGT RJ 45 cable between the motherboard and back panel 176 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 177: ...server with all reusable components that populate the motherboard in place 2 a Carefully slide the motherboard forward and while holding the motherboard mid wall lift it out of the chassis b Place the motherboard assembly on an antistatic mat and next to the replacement motherboard 7 Remove the following reusable components from the motherboard and install them onto the replacement motherboard Ser...

Page 178: ...slots server performance might be reduced and some DIMMs might not be used M 2 flash riser SSDs See Remove a Flash Riser Board on page 87 and Install a Flash Riser Board on page 89 8 Remove the processors from the failed motherboard See Identify and Remove a Processor on page 123 9 Remove the processor socket covers from the replacement motherboard and install the processors a Grasp the processor ...

Page 179: ... on the faulty motherboard otherwise damage might result to the processor sockets during handling and shipping a Align the processor socket cover over the processor socket alignment posts Install the processor socket cover by firmly pressing down on all four corners labeled INSTALL on the socket cover You hear an audible click when the processor socket cover is securely attached to the processor s...

Page 180: ...e perform the following steps to remove the light pipe from the faulty motherboard i Insert a flat tool such as a screwdriver or penknife blade between the light pipe housing and the light pipe Caution Equipment damage The light pipe is fragile Handle it carefully ii Twist the tool back and forth to release the light pipe from the housing iii Pull the light pipe away from the housing b Install the...

Page 181: ...ed Information System Components on page 21 Replaceable Units on page 23 Replaceable Units on page 23 Install the Motherboard Assembly on page 181 Install the Motherboard Assembly 1 Attach an antistatic wrist strap to your wrist and then to a metal area on the chassis See Take Antistatic Measures on page 63 2 Carefully lift and place the motherboard assembly into the chassis 1 Servicing the Mother...

Page 182: ...doffs Caution Be careful not to damage the rear Locate Button LED when placing the motherboard into the chassis 3 Using a Torx T25 screwdriver tighten the two captive screws to secure the motherboard mid wall to the chassis 2 4 Reconnect the following cables to the motherboard SER MGT RJ 45 serial cable Reinstall and reconnect the SER MGT RJ 45 cable between the motherboard and back panel Disk bac...

Page 183: ...on page 137 Disk backplane auxiliary signal cable See Servicing the Disk Backplane on page 137 Front LED indicator module ribbon cable See Servicing the Front LED Indicator Module on page 145 5 Reinstall the following components Servicing the Motherboard Assembly 183 ...

Page 184: ...es See Install a Fan Module on page 75 Air baffle See Install the Air Baffle on page 97 6 If present on the HC server install the Oracle Storage 12 Gb SAS PCIe RAID HBA Internal card and its associated super capacitor See Install the Internal HBA Card and HBA Super Capacitor on page 163 Note Before you install the HBA super capacitor install the HBA super capacitor tray by squeezing the plastic hi...

Page 185: ...cessary because the motherboard is a secondary member of a select group or quorum of components for maintaining the PSN for service entitlement and if you replace more than one of the quorum members during any given service procedure a secondary quorum member might need to be programmed with the PSN Related Information System Components on page 21 Replaceable Units on page 23 Replaceable Units on ...

Page 186: ...186 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 187: ...lacement filler panels for storage drives and PCIe cards These filler panels are installed at the factory and must remain in the server until you replace them with a purchased option Before you can install an optional server component into the server remove the filler panel from the location into which you intend to install the component When you remove a storage drive or a PCIe card from the serv...

Page 188: ...lide the filler panel in all the way Leave the filler panel out approximately 0 25 to 0 50 inch 6 to 12 mm from the opening 3 Using your thumb or finger press on the middle of the filler panel faceplate until the release lever engages with the chassis 4 Close the release lever until it clicks into place and is flush with the front of the server PCIe slot 1 Remove the server top cover 2 To remove t...

Page 189: ...on the cover in the correct position 3 Gently slide the cover toward the front of the chassis until it latches into place with an audible click 2 As you slide the cover toward the front of the server the release button on the top of the server automatically rotates downward to the closed position Latch the top cover by pushing down on the button until it is flush with the cover and you hear an aud...

Page 190: ... in Oracle Exadata Storage Server X7 2 EF and HC Installation Guide 2 If the cable management arm CMA is not installed that is you removed it because you removed the server completely out of the rack install the CMA For installation instructions for the CMA refer to Install the Cable Management Arm Optional in Oracle Exadata Storage Server X7 2 EF and HC Installation Guide 3 If the cables are disc...

Page 191: ...d in the following steps a Simultaneously pull and hold the two green release tabs one on each side of the slide rails on the server toward the front of the server while you push the server into the rack As you push the server into the rack verify that the cable management arm CMA retracts without binding Note To pull the green release tab place your finger in the center of the tab not on the end ...

Page 192: ...es For instructions on reconnecting cables to the back of the server see Reconnect Power and Data Cables on page 192 For details on connecting cables to the back of the server see Back Panel Connector Locations on page 42 Related Information Reconnect Power and Data Cables on page 192 Reconnect Power and Data Cables 1 Reconnect the data cables to the back of the server If the cable management arm ...

Page 193: ...ain power mode by performing one of the following actions Press the On Standby button on the front bezel Log in to the Oracle ILOM web interface click Host Management Power Control and from the Select Action list select Power On Log in to the Oracle ILOM command line interface CLI and type the following command at the Oracle ILOM prompt start System When the server is powered on to Main power mode...

Page 194: ...194 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 195: ...ver X7 2 on page 15 Gigabit Ethernet Port The server has one auto negotiating 100 1000BASE T Gigabit Ethernet GbE system domain port that uses a standard RJ 45 connector The transfer rates are shown in the following table TABLE 1 Ethernet Port Transfer Rates Connection Type IEEE Terminology Transfer Rate Fast Ethernet 100BASE T 100 Mbps Gigabit Ethernet 1000BASE T 1 000 Mbps The following figure a...

Page 196: ...Panel Components and Cable Connections on page 20 Server System Level Status Indicators on page 31 Disconnect Cables From the Server on page 59 Reconnect Power and Data Cables on page 192 Network Management Port The server has one auto negotiating 10 100 1000BASE T Ethernet management domain interface labeled NET MGT For information about configuring this port for managing the server with Oracle I...

Page 197: ...ections on page 20 Server System Level Status Indicators on page 31 Disconnect Cables From the Server on page 59 Reconnect Power and Data Cables on page 192 Serial Management Port The serial management connector labeled SER MGT is an RJ 45 connector that can be accessed from the back panel This port is the default connection to the server Oracle ILOM SP Use this port only for server management TAB...

Page 198: ...over adapter appropriate for your serial connection TABLE 6 RJ 45 to DB 9 Adapter Crossovers Wiring Reference Serial Port RJ 45 Connector DB 9 Adapter Pin Signal Description Pin Signal Description 1 RTS 8 CTS 2 DTR 6 DSR 3 TXD 2 RXD 4 Signal ground 5 Signal ground 5 Signal ground 5 Signal ground 6 RXD 3 TXD 7 DSR 4 DTR 8 CTS 7 RTS TABLE 7 RJ 45 to DB 25 Adapter Crossovers Wiring Reference Serial P...

Page 199: ... Components and Cable Connections on page 20 Disconnect Cables From the Server on page 59 Reconnect Power and Data Cables on page 192 USB Ports The server has two USB ports for attaching supported USB 3 0 compliant devices One USB port is on the back panel and one USB port is located on the motherboard The following figure and table describe the USB port pin signals TABLE 8 USB Port Signals Pin Si...

Page 200: ...elated Information EF Back Panel Components and Cable Connections on page 18 HC Back Panel Components and Cable Connections on page 20 Disconnect Cables From the Server on page 59 Reconnect Power and Data Cables on page 192 200 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 201: ...BIOS Setup Utility and Oracle ILOM For information about using these tools to manage the BIOS configuration refer to Oracle ILOM Maintaining x86 BIOS Configuration Parameters in the Oracle ILOM Administrator s Guide for Configuration and Maintenance Firmware Release 4 0 in the Oracle Integrated Lights Out Manager ILOM 4 0 Documentation Library at http www oracle com goto ilom docs BIOS Setup Utili...

Page 202: ...erver SP IO Manage configuration settings for I O devices such as I O virtualization settings and enable and disable Option ROMs Boot Configure the boot device priority Save Exit Save changes and exit discard changes and exit discard changes or restore the default BIOS settings See BIOS Setup Utility Menu Options on page 231 for examples of each of these screens Related Information Navigate BIOS S...

Page 203: ... or terminal emulator connected to a computer through the serial port on the back panel of the server Connect to the server using the Oracle ILOM Remote System Console Plus application 1 Reset or power on the server For example to reset the server From the local server press the On Standby button on the front panel of the server to power off the server and press the On Standby button again to powe...

Page 204: ...Utility Menus To navigate the menus or options listed on a menu use the arrow keys The currently selected option or sub menu is highlighted For further instructions on how to navigate and change settings in the BIOS Setup Utility refer to the online information provided on the menu 1 Access the BIOS Setup Utility See Access BIOS Setup Utility Menus on page 203 204 Oracle Exadata Storage Server X7 ...

Page 205: ...g the desired option from the pop up menus 5 Press the Esc key to return from a sub menu screen to the previous menu screen Pressing Esc from a top level menu is equivalent to selecting the Discard Changes and Exit option from the Save Exit Menu 6 Modify parameters as needed 7 Press the F10 key to save your changes and exit the BIOS Setup Utility Alternatively you can select the Save Exit menu and...

Page 206: ...part of the standard BIOS Setup Utility screens For example if the Oracle Storage 12 Gb SAS PCIe RAID HBA Internal card is installed in the HC server the configuration utility for the HBA appears as a menu selection Configure and Manage BIOS Using Oracle ILOM Oracle Integrated Lights Out Manager ILOM includes BIOS configuration and management tools You can perform the following BIOS configuration ...

Page 207: ... OS starts in a trusted environment and provides the OS with additional security capabilities not available to an untrusted OS Using cryptographic techniques TXT provides measurements of software and platform components so that system software as well as local and remote management applications may use those measurements to make trust decisions Trusted Execution Technology defends against software...

Page 208: ...ocal server press the On Standby button on the front panel of the server to power off the server and press the On Standby button again to power on the server From the Oracle ILOM web interface click Host Management Power Control and select Reset from the Select Action list Click Save and click OK From the Oracle ILOM CLI type reset System 2 After the server resets and begins the initialization pro...

Page 209: ...ffect after booting from the temporary boot device 1 Reset or power on the server For example to reset the server From the local server press the On Standby button on the front panel of the server to power off the server and press the On Standby button again to power on the server From the Oracle ILOM web interface click Host Management Power Control and select Reset from the Select Action list Cl...

Page 210: ...Setup Utility Menus on page 203 BIOS Setup Utility Menus on page 202 BIOS Key Mappings on page 202 Exit BIOS Setup Utility on page 229 Configure TPM Support If you intend to use the Trusted Platform Module TPM feature set you must configure the server to support this feature TPM support is enabled by default on Oracle Exadata Storage Server X7 2 Perform the procedure in this section to disable or ...

Page 211: ...dor 1 Access the BIOS Setup Utility menus See Access BIOS Setup Utility Menus on page 203 2 In the BIOS Setup Utility menus navigate to the Advanced Menu 3 On the Advanced Menu screen select Trusted Computing 2 0 4 On the Trusted Computing 2 0 Configuration screen select Security TPM Device Support and press Enter Do one of the following Select Disable to disable Security TPM Device Support Select...

Page 212: ...y Menus on page 203 BIOS Setup Utility Menus on page 202 Exit BIOS Setup Utility on page 229 Microsoft Windows Trusted Platform Module Management documentation Configure UEFI Driver Settings 1 Access the BIOS Setup Utility menus See Access BIOS Setup Utility Menus on page 203 2 In the BIOS Setup Utility menus navigate to the IO Menu 212 Oracle Exadata Storage Server X7 2 EF and HC Service Manual M...

Page 213: ...he IO Menu screen select either Internal Devices or Add In Cards and press Enter to display the internal device or add in card slot for which you want to enable or disable the PCI E UEFI Driver Setting Up BIOS Configuration Parameters 213 ...

Page 214: ... UEFI Driver Enable and press Enter Do one of the following Select Enabled to enable the PCI E UEFI Driver setting Select Disabled to disable the PCI E UEFI Driver setting 6 Press the F10 key to save the changes and exit the BIOS Setup Utility Related Information Access BIOS Setup Utility Menus on page 203 BIOS Setup Utility Menus on page 202 Exit BIOS Setup Utility on page 229 214 Oracle Exadata ...

Page 215: ...cation Configure I O Resource Allocation 1 Access the BIOS Setup Utility menus See Access BIOS Setup Utility Menus on page 203 2 In the BIOS Setup Utility menus navigate to the IO Menu Setting Up BIOS Configuration Parameters 215 ...

Page 216: ...Configure I O Resource Allocation 3 On the IO Menu screen select Add In Cards and press Enter to display the add in card slots 216 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 217: ...press Enter Do one of the following Select Enabled to enable I O resource allocation for the I O card Select Disabled to disable I O resource allocation for the I O card 6 Press the F10 key to save the changes and exit the BIOS Setup Utility Related Information Access BIOS Setup Utility Menus on page 203 BIOS Setup Utility Menus on page 202 Exit BIOS Setup Utility on page 229 Setting Up BIOS Confi...

Page 218: ...cure Boot 1 Access the BIOS Setup Utility menus See Access BIOS Setup Utility Menus on page 203 2 On the BIOS Setup Utility Main Menu screen select Security and press Enter 218 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 219: ... Do one of the following Select Enabled to enable UEFI Secure Boot Continue with the next step to manage policy variables Select Disabled to disable UEFI Secure Boot Continue with Step 8 to save changes and exit from the BIOS Setup Utility When enabled Secure Boot allows you to manage Secure Boot policy variables Setting Up BIOS Configuration Parameters 219 ...

Page 220: ...ory default keys on the Key Management screen select Provision Factory Defaults and press Enter Do one of the following Select Enabled to allow the provisioning of factory default Secure Boot keys when the system is in Setup Mode When enabled you can select Install 220 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 221: ...system to User Mode and install all the factory default Secure Boot keys Select Disabled to disable the provisioning of factory default Secure Boot keys When disabled you can select Delete all Secure Boot Variables to Setting Up BIOS Configuration Parameters 221 ...

Page 222: ...Configure UEFI Secure Boot remove all Secure Boot keys from the system Selecting this option also resets the system to Setup Mode 222 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 223: ...Configure UEFI Secure Boot 7 If you want to enroll an EFI image on the Key Management screen select Enroll Efi Image and press Enter Setting Up BIOS Configuration Parameters 223 ...

Page 224: ... Secure Boot a In the Select a File System dialog box scroll through the list select the file system that contains the EFI file and press Enter 224 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 225: ... through the list select the EFI file or another available file and press Enter c In the second Select File dialog box scroll through the list select the image file that you want to run in Secure Boot mode and press Enter Setting Up BIOS Configuration Parameters 225 ...

Page 226: ... file and press Enter The Secure Boot policy variables are saved to the root folder in the target file system 8 Press the F10 key to save the changes and exit the BIOS Setup Utility Related Information Access BIOS Setup Utility Menus on page 203 BIOS Setup Utility Menus on page 202 UEFI Secure Boot on page 207 Exit BIOS Setup Utility on page 229 226 Oracle Exadata Storage Server X7 2 EF and HC Ser...

Page 227: ...led on your server before enabling Trusted Execution Technology TXT See Configure TPM Support on page 210 1 Access the BIOS Setup Utility menus See Access BIOS Setup Utility Menus on page 203 2 On the Main Menu screen select Security and press Enter The Security Settings screen appears Setting Up BIOS Configuration Parameters 227 ...

Page 228: ... to enable TXT Select Disabled to disable TXT 5 Press the F10 key to save the changes and exit the BIOS Setup Utility Related Information Access BIOS Setup Utility Menus on page 203 BIOS Setup Utility Menus on page 202 Trusted Execution Technology on page 207 Configure TPM Support on page 210 Exit BIOS Setup Utility on page 229 228 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 20...

Page 229: ...to proceed and exit the BIOS Setup Utility or select No to stop the exit process Note After modifying any BIOS settings the subsequent reboot might take longer than a typical reboot where no settings were modified The additional delay is required to ensure that changes to the BIOS settings are synchronized with Oracle ILOM Related Information Access BIOS Setup Utility Menus on page 203 BIOS Setup ...

Page 230: ...230 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 231: ...e 249 BIOS Boot Menu Selections on page 253 BIOS Exit Menu Selections on page 255 Related Information Oracle X7 Series Servers Administration Guide at http www oracle com goto x86admindiag docs Setting Up BIOS Configuration Parameters on page 201 BIOS Main Menu Selections This section includes a screen of the BIOS Main Menu The options that are available from the Main Menu are described in the tab...

Page 232: ...t is XXYYZZPP which indicates XX Unique project platform code YY BIOS major release ZZ BIOS minor release PP Build number Example 42 01 04 01 System Date Current date is displayed You can change the date setting Example Thu 06 20 2017 System Time Current time is displayed You can change the time setting Example 13 38 27 UPI Link Speed R O SLOW Intel UltraPath Interconnect UPI operational speed is ...

Page 233: ...d Product Name Product name is displayed Example Oracle Server X7 2L Product Serial Number Product serial number is displayed Example 1134FML00V Board Serial Number Board serial number is displayed Example 489089M 1637E2002E CPU INFORMATION R O Attributes of a single processor CPU are defined A separate information structure is provided for each processor supported in the system Most of the values...

Page 234: ...et 1 is populated the same options as Socket 0 CPU Information are displayed Otherwise displays Not Present DIMM INFORMATION R O Memory module DIMM presence and size information are displayed Processor 0 DIMMs R O For D0 D11 if a DIMM is present memory size in gigabytes is displayed Otherwise displays Not Present Processor 1 DIMMs R O Same as Processor 0 SECURITY Configure the security settings TX...

Page 235: ...oot variables Saves all Secure Boot variables to the root folder in the chosen file system Platform Key PK Save to File Set New Erase Enrolls factory defaults or load certificates from a file Key Exchange Keys Save to File Set New Append Erase Enrolls factory defaults or load certificates from a file Authorized Signatures Save to File Set New Append Erase Enroll factory defaults or load certificat...

Page 236: ...37 BIOS Advanced Menu Gigabit Network Connection Options on page 239 BIOS Advanced Menu Driver Health Options on page 240 BIOS Advanced Menu Serial Port Console Redirection Options on page 240 BIOS Advanced Menu Network Stack Options on page 242 BIOS Advanced Menu Primary Video Selection Options on page 242 BIOS Advanced Menu Trusted Computing 2 0 Options on page 243 BIOS Advanced Menu PCH SATA Co...

Page 237: ...O can boost the performance of an application by load balancing traffic across multiple ports Internet Protocol IP4 IP6 Autoconfigure IP4 Can be set to IP4 IP6 or Autoconfigure The initiator IP address is assigned by the system to IP6 In Autoconfigure mode the iSCSI driver attempts to connect to the iSCSI target using the IPv4 stack If this fails then the iSCSI driver attempt to connect using the ...

Page 238: ...n Target Port 3260 Change target port number Boot LUN 0 Set the hexadecimal representation of the boot logical unit number LUN Example 4752 3A4F 6b7e 2F99 Authentication Type CHAP None CHAP Define the Challenge Handshake Authentication Protocol CHAP Available settings are CHAP Kerberos and None CHAP Type One Way Mutual One Way Set CHAP type to either One Way or Mutual CHAP Name NA None Set CHAP na...

Page 239: ...Driver R O NA NA Identifies the UEFI driver Adapter PBA R O NA NA Product board adapter PBA number You can use the Intel Network Adapter PBA number to search for the adapter s model number The PBA number is a nine digit number that is the last part of the adapter board serial number The PBA number is presented in this format xxxxxxx xxx for example C80222 001 Device Name R O NA NA Device name Chip...

Page 240: ...thy Intel I210 Gigabit Network Connection R O Healthy Apache Pass Driver R O Healthy Lists the health status of drivers controllers BIOS Advanced Menu Serial Port Console Redirection Options The following table describes the BIOS Advanced Menu serial port console redirection options Setup Options Options Defaults Description EMS Console Redirection Disabled Enabled Disabled Enable or disable conso...

Page 241: ... of 1s in the data bits is even Odd Parity bit is 0 if the number of 1s in the data bits is odd Mark Parity bit is always 1 Space Parity bit is always 0 Mark and Space parity do not allow for error detection They can be used as an additional data bit Stop Bits 1 2 1 Stop bits indicate the end of a serial data packet A start bit indicates the beginning of a serial data packet The standard setting i...

Page 242: ...nabled Disabled Enable or disable IPv4 HTTP Boot support If disable the IPv4 HTTP Boot Option will not be created Ipv6 PXE Support Disabled Enabled Disabled Enable or disable IPv6 PXE Boot support If disable the IPv6 PXE Boot Option will not be created Ipv6 HTTP Support Disabled Enabled Disabled Enable or disable IPv6 HTTP Boot support If disable the IPv6 HTTP Boot Option will not be created PXE b...

Page 243: ...ays active Platform Configuration Register PCR banks Available PCR banks R O N A N A Displays available Platform PCR banks SHA 1 PCR Bank R O N A N A Displays if the SHA 1 PCR bank is enabled disabled SHA256 Bank R O N A N A Displays if the SHA256 PCR bank is enabled disabled Pending Operation None TPM Clear None Schedule an operation for the security device Note Your computer reboots during resta...

Page 244: ...devices Note This option is available only if Configure SATA as is set to RAID SATA Mode Options Select SATA mode related options SATA HDD Unlock Disable Enable Enable Enable or disable SATA HDD unlock SATA LED Locate Disable Enable Enable Enable or disable SATA LED locate Support Aggressive Link Power Management Disable Enable Enable Enable or disable aggressive link power management Alternate De...

Page 245: ...able or disable the SATA port Hot Plug Disable Enable Disable Designate the port as hot pluggable Configure as eSATA Disable Enable Disable Use this option to configure the port as an external SATA eSATA device Mechanical Presence Switch Disable Enable Enable Use this option to enable disable device reporting when the device has a mechanical presence switch Spin Up Device Disable Enable Disable Us...

Page 246: ...fetcher MSR 1A4h bit 1 DCU Streamer Prefetcher Disabled Enabled Enabled Enable or disable DCU streamer prefetcher which is a L1 data cache prefetcher MSR 1A4h 2 DCP IP Prefetcher Disabled Enabled Enabled Enable DCU IP prefetcher which is a L1 data cache prefetcher MSR 1A4h 3 Intel Virtualization Technology Disabled Enabled Enabled When enabled a Virtual Machine Manager VMM can utilize the addition...

Page 247: ...e power management features EIST GV3 Disabled Enabled Enabled Disable or enable Enhanced Intel SpeedStep Technology EIST Turbo Mode Enabled Disabled Enabled Enabled mode is supported only if Turbo Mode is supported in the CPU Enabled mode also requires that Enhanced Multi Threaded Thermal Monitoring EMTTM be enabled on the CPU CPU C3 report Enabled Disabled Disabled Enable or disable the CPU C3 AC...

Page 248: ...pport The EHCI change of ownership should be claimed by the EHCI driver Port 60 64 Emulation Disabled Enabled Enabled Enable or disable I O port 60h 64h emulation support Enable this setting for the complete USB keyboard legacy support for non USB aware operating systems Rear Port Disabled Enabled Enabled Enable or disable USB Rear Port Internal Port 0 Disabled Enabled Enabled Enable or disable US...

Page 249: ...or disable disk freeze lock Enabling this setting prevents disks from being sanitized Related Information BIOS Main Menu Selections on page 231 BIOS IO Menu Selections on page 249 BIOS Boot Menu Selections on page 253 BIOS Exit Menu Selections on page 255 BIOS IO Menu Selections This section includes a screen of the BIOS IO Menu The options that are available from the IO Menu are described in the ...

Page 250: ... on page 252 BIOS IO Menu PCIE Hardware Slot Configuration Options on page 253 BIOS IO Menu PCI Subsystem Settings Options The following table describes the BIOS IO Menu PCI subsystem settings options Setup Options Options Defaults Description PCI 64 Bit Resources Allocation Disabled Enabled Enabled Enable or disable 64 bit capable devices to be decoded in above 4G address space This setting is av...

Page 251: ...ected I O VT d by reporting the I O device assignment to VMM through DMA remapping reporting DMAR Advance Configuration Power Interface ACPI tables SR IOV Support Disabled Enabled Enabled Enable or disable Single Root I O Virtualization SR IOV to configure devices into multiple virtual devices that can be used on virtual OS installations If supported by the hardware and set to enabled all devices ...

Page 252: ...e internal device settings PCI E UEFI Driver Enable Disabled Enabled Enabled Enable or disable PCI E UEFI Driver If set to enabled UEFI Driver for the card executes as normal If set to disabled UEFI Driver for the card is not copied into memory and the execution of the UEFI Driver is inhibited BIOS IO Menu Add in Cards Options The following table describes the BIOS IO Menu add in cards options Set...

Page 253: ...ays and provides options to configure hot plug functionality or FM10K bifurcation for the PCIe HBA slot PCIE Slot Hardware Configuration HotPlug Disabled HotPlug Enabled FM_10 8x8 Bifurcation HotPlug Disabled Enable or disable hot plug or FM10K bifurcation Slot 2 Slot 3 Slot 4 Slot 5 Slot 6 Slot 7 Slot 8 Slot 9 Slot 10 Slot 11 and Slot 12 See Slot 1 description Related Information BIOS Main Menu S...

Page 254: ...ror message Network Boot Failed when all PXE boots fail If set to Boot List fail over to the main Boot Options Priority list Persistent Boot Support Disabled Enabled Disabled If disabled system reverts back to the default boot handling from the next boot If enabled Persistent Boot Support allows you to fix the position of every physical slot network port and disk drive bay in the boot order list r...

Page 255: ...lections This section includes a screen of the BIOS Exit Menu The options that are available from the Exit Menu are described in the table that follows Setup Options Description Save Changes and Exit Save changes and exit the BIOS Setup Utility Discard Changes and Exit Exit the BIOS Setup Utility without saving changes Discard Changes Discard any changes made to the setup options BIOS Setup Utilit...

Page 256: ...imal default values for all of the setup options Related Information BIOS Main Menu Selections on page 231 BIOS Advanced Menu Selections on page 236 BIOS IO Menu Selections on page 249 BIOS Boot Menu Selections on page 253 256 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...

Page 257: ...interface or in the Oracle ILOM command line interface CLI you can collect system specific information about the server determine the health state of discrete components and view any open problems on the server Oracle ILOM automatically detects system hardware faults and environmental conditions on the server If a problem occurs on the server Oracle ILOM automatically does the following Illuminate...

Page 258: ...ion Describes the particular component name reference Values Defines the states of the sensor indicator or replaceable unit entity and any specific units or values that are expected if applicable Note Some component names are hidden in the Oracle ILOM user interfaces These names are marked as hidden in the tables Further as of Oracle ILOM 3 1 the Oracle ILOM 3 0 legacy targets SYS and STORAGE have...

Page 259: ...h ACPI_SOFT_OFF SYS VPS Threshold sensor Virtual power sensor Watts SYS VPS_CPUS Threshold sensor Virtual power sensor CPUs Watts SYS VPS_MEMORY Threshold sensor Virtual power sensor Memory Watts SYS VPS_FANS Threshold sensor Virtual power sensor Fans Watts SYS T_AMB Threshold sensor Ambient temperature on system motherboard Degrees Celsius SYS TEMP_FAULT Indicator Temperature Fault LED Color Ambe...

Page 260: ...r Rear Power Supply Fault LED Color Amber Location Front panel Off Normal On General power supply fault SYS FAN_FAULT Indicator Top Fan Fault LED Color Amber Location Front panel Off Normal On General fan fault SYS DO_NOT_SERVICE Indicator Do Not Service LED Color White Location Front panel Off Normal On Do not service Related Information Cooling Unit Components on page 261 Disk Backplane Componen...

Page 261: ...YS MB FM 0 3 F 0 x TACH Threshold sensor Fan module fan speed RPM SYS MB FM 0 3 SERVICE Indicator Fan Fault Service Required LED Color Amber Location Motherboard Off Normal On Fan module was diagnosed as faulty Related Information System Chassis Components on page 259 Disk Backplane Components on page 261 Memory Device Components on page 263 Power Unit Components on page 263 Processor Components o...

Page 262: ...h INSTALLED 20h SLOT_POWER_OFF SYS DBP HDD 0 x SERVICE Indicator Fault Service Required LED Color Amber Location HDD Off Normal On HDD was diagnosed as failed SYS DBP HDD 0 x OK2RM Indicator Hard disk drive OK to remove Color Blue Location HDD Off Normal On HDD is OK to remove Related Information System Chassis Components on page 259 Cooling Unit Components on page 261 Memory Device Components on ...

Page 263: ...IMM was diagnosed as faulty Related Information System Chassis Components on page 259 Cooling Unit Components on page 261 Disk Backplane Components on page 261 Power Unit Components on page 263 Processor Components on page 264 System Motherboard Components on page 265 System Firmware Components on page 266 Hard Disk Drive Components on page 267 Power Unit Components The following table lists the p...

Page 264: ...0 1 V_12V Voltage sensor 12V output voltage Volts SYS PS 0 1 V_12V_STBY Voltage sensor 12V standby output voltage Volts SYS PS 0 1 T_IN Temperature sensor PSU input temperature Degrees Celsius SYS PS 0 1 T_OUT Temperature sensor PSU output temperature Degrees Celsius Related Information System Chassis Components on page 259 Cooling Unit Components on page 261 Disk Backplane Components on page 261 ...

Page 265: ...ts on page 261 Memory Device Components on page 263 Power Unit Components on page 263 System Motherboard Components on page 265 System Firmware Components on page 266 Hard Disk Drive Components on page 267 System Motherboard Components The following table lists the system motherboard components Component Name Oracle ILOM CLI Targets IPMI Type Description Values if applicable SYS MB FRU General hos...

Page 266: ...B M2R 0 1 PRSNT Discrete sensor M 2 riser presence 01h ENTITY_ABSENT 02h ENTITY_PRESENT SYS MB M2R 0 1 SSD0 PRSNT Discrete sensor M 2 SSD drive presence 01h ENTITY_ABSENT 02h ENTITY_PRESENT SYS MB M2R 0 1 SSD0 STATE State sensor M 2 SSD drive state sensor 04h INSTALLED 20h SLOT_POWER_OFF Related Information System Chassis Components on page 259 Cooling Unit Components on page 261 Disk Backplane Co...

Page 267: ...able lists the hard disk drive HDD components Component Name Oracle ILOM CLI Targets IPMI Type Description Values if applicable SYS DBP HDD 0 x FRU Hard disk drive FRU From host SYS DBP HDD 0 x PRSNT Discrete sensor Hard disk drive presence 01h ENTITY_ABSENT 02h ENTITY_PRESENT SYS DBP HDD 0 x STATE Discrete sensor Writable multistate slot connector sensor type per IPMI 01h FAULT_STATUS 02h IDENTIT...

Page 268: ...igure Oracle ILOM to generate Simple Network Management Protocol SNMP traps when hardware problems occur For information about how to configure SNMP alert rule destinations to start receiving these traps refer to the Oracle Integrated Lights Out Manager ILOM 4 0 Documentation Library at http www oracle com goto ilom docs The tables in these sections list the set of SNMP traps that are generated fr...

Page 269: ...w a lower critical threshold setting The sunHwTrapThresholdType object indicates whether the threshold was an upper or lower threshold SYS PS 0 1 T_OUT SYS PS 0 1 T_IN SYS MB T_IN_ZONE 0 2 SYS MB T_OUT_ZONE 0 2 SNMP Trap sunHwTrapTempCritThresholdDeasserted Oracle ILOM Event Message Upper critical threshold no longer exceeded Severity and Description Informational A temperature sensor reported tha...

Page 270: ...d disk drive events Messages and Descriptions Component Name SNMP Trap sunHwTrapSlotOrConnectorError Oracle ILOM Event Message Assert Severity and Description Major A sensor associated with a slot or connector detected an error SYS DBP HDD 0 x STATE SNMP Trap sunHwTrapSlotOrConnectorOk Oracle ILOM Event Message Deassert Severity and Description Informational A sensor associated with a slot or conn...

Page 271: ...Major A power supply sensor detected an error SYS PS 0 1 STATE SNMP Trap sunHwTrapPowerSupplyOk Oracle ILOM Event Message PS_FAILURE DEASSERT Severity and Description Major A power supply sensor detected an error SYS PS 0 1 STATE SNMP Trap sunHwTrapPowerSupplyError Oracle ILOM Event Message PS_PREDICTIVE_FAILURE ASSERT Severity and Description Major A power supply sensor detected an error SYS PS 0...

Page 272: ...ription Major A power supply sensor detected an error SYS PS 0 1 STATE SNMP Trap sunHwTrapPowerSupplyOk Oracle ILOM Event Message PS_CONFIG_ERROR DEASSERT Severity and Description Major A power supply sensor detected an error SYS PS 0 1 STATE SNMP Trap sunHwTrapSensorNonCritThresholdExceeded Oracle ILOM Event Message Upper noncritical threshold exceeded Severity and Description Minor A sensor repo...

Page 273: ...wer threshold SYS PS 0 1 P_IN SYS PS 0 1 P_OUT SNMP Trap sunHwTrapSensorFatalThresholdDeasserted Oracle ILOM Event Message Lower fatal threshold no longer exceeded Severity and Description Informational A power supply sensor reported that its value went below an upper fatal threshold setting or above a lower fatal threshold setting The sunHwTrapThresholdType object indicates whether the threshold ...

Page 274: ...YS PS 0 1 V_12V SYS PS 0 1 V_12V_STBY SYS PS 0 1 V_IN SNMP Trap sunHwTrapVoltageCritThresholdDeasserted Oracle ILOM Event Message Upper critical threshold no longer exceeded Severity and Description Informational A voltage sensor reported that its value went below an upper critical threshold setting or above a lower critical threshold setting The sunHwTrapThresholdType object indicates whether the...

Page 275: ...hassis Components on page 259 Cooling Unit Components on page 261 Disk Backplane Components on page 261 Memory Device Components on page 263 Power Unit Components on page 263 Processor Components on page 264 System Motherboard Components on page 265 Hard Disk Drive Components on page 267 Fan Events The following table lists fan events Messages and Descriptions Component Name SNMP Trap sunHwTrapFan...

Page 276: ...rap sunHwTrapFanSpeedFatalThresholdDeasserted Oracle ILOM Event Message Lower fatal threshold no longer exceeded Severity and Description Informational A fan speed sensor reported that its value went below an upper fatal threshold setting or above a lower fatal threshold setting The sunHwTrapThresholdType object indicates whether the threshold was an upper or lower threshold SYS MB FM 0 3 F 0 x TA...

Page 277: ...en detected Severity and Description Major A memory component is suspected of causing a fault SYS MB SNMP Trap sunHwTrapMemoryFaultCleared Oracle ILOM Event Message event fault cpu intel quickpath unknown errcode An unknown error code from the Quickpath Interconnect QPI reference code has been detected Severity and Description Informational A memory component fault has been cleared SYS MB Related ...

Page 278: ...y and Description Major A processor sensor has detected an error Device disabled SYS MB P 0 x PRSNT SNMP Trap sunHwTrapProcessorOk Oracle ILOM Event Message ENTITY_DISABLED DEASSERT Severity and Description Major A processor sensor has returned to its normal state Device enabled SYS MB P 0 x PRSNT Related Information System Chassis Components on page 259 Cooling Unit Components on page 261 Disk Ba...

Page 279: ...ptions 204 setup screens summary 202 shortcut key sequences 202 TPM support 210 UEFI BIOS 206 board components 259 boot device selecting 209 boot drive status indicators 33 boot process power modes 30 buttons Fault Remind 124 On Standby 56 59 193 C cable part number left LED indicator module cable 149 SAS cables 170 cables connecting 192 disconnecting 59 cabling the server 41 chassis components 25...

Page 280: ...t BIOS screen 255 external cables connecting 41 F fan events 275 fan module description 23 installing 75 removing 73 status indicators 33 fan tray installing 78 removing 77 Fault Remind button identifying failed processors 124 location 104 124 using 104 Fault Service Required LED 31 firmware components 259 flash riser board installing 89 removing 87 function keys in BIOS Setup Utility 202 G Gigabi...

Page 281: ...ators Locate Button LED 31 M M 2 flash SSD installing 93 removing 91 Main BIOS screen 231 Main power 56 57 59 memory See DIMMs memory device components 263 memory events 276 menus BIOS Setup Utility 203 motherboard assembly description 23 installing 181 removing 173 status 35 N NET MGT port pinout 34 197 Network Time Protocol NTP 121 numbering storage drives 68 O OK to Remove indicator storage dri...

Page 282: ...dentifying faulty processor 124 installing 130 maximum DIMMs supported 103 physical layout 102 removing 123 PSU See power supply R removing components air baffle 95 95 antistatic measures 190 battery 119 DIMMs 105 disk backplane 137 fan module 73 fan tray 77 flash riser board 87 HBA super capacitor 159 internal HBA card 159 LED indicator module 145 M 2 flash SSD 91 motherboard assembly 173 PCIe ca...

Page 283: ... hard disk drive events 270 memory events 276 power events 271 Standby power 59 status indicators Ethernet ports 34 fan module 33 motherboard assembly 35 network management NET MGT 34 power supply 34 81 83 storage drives 33 system status 31 stop command 54 storage drive installing 71 storage drives description 23 67 hot plugging 67 identification 69 latch release button 69 removing 69 status indic...

Page 284: ...Trusted Platform Module TPM enabling and disabling 210 U UEFI driver enabling and disabling 212 UEFI Secure Boot description 207 enabling and disabling 218 USB port pinout 199 W weight of server 62 wriststrap 63 284 Oracle Exadata Storage Server X7 2 EF and HC Service Manual May 2018 ...