Oracle EXADATA X5-2, Installation And Configuration Manual

Page 1: ...Oracle Exadata Database Machine Installation and Configuration Guide 18c 18 1 E81011 08 November 2017 ...

Page 2: ...ted software any programs installed on the hardware and or documentation delivered to U S Government end users are commercial computer software pursuant to the applicable Federal Acquisition Regulation and agency specific supplemental regulations As such use duplication disclosure modification and adaptation of the programs including any operating system integrated software any programs installed ...

Page 3: ...xadata Storage Server X5 2 Servers 1 8 1 1 6 General Environmental Requirements for Oracle Exadata Database Machine X4 8 Full Rack 1 10 1 1 7 General Environmental Requirements for Oracle Exadata Database Machine X3 2 1 11 1 1 8 General Environmental Requirements for Oracle Exadata Database Machine X3 8 Full Rack with Exadata Storage Server X4 2L Servers 1 14 1 1 9 General Environmental Requiremen...

Page 4: ...Address Requirements for Oracle Exadata Database Machine 1 47 1 7 1 Network Connection Requirements for Oracle Exadata Database Machine 1 47 1 7 2 DNS Configuration for Oracle Exadata Database Machine 1 50 1 7 3 IP Address Requirements for Oracle Exadata Database Machine 1 51 1 7 3 1 Calculating the IP Address Requirements when Using Oracle VMs 1 69 1 8 Network Connection and IP Address Requiremen...

Page 5: ...X7 8 2 17 2 4 2 3 Non bonded Network Configuration for Oracle Exadata Database Machine X4 8 Full Rack 2 18 2 4 2 4 Non bonded Network Configuration for Oracle Exadata Database Machine X3 8 Full Rack and Oracle Exadata Database Machine X2 8 Full Rack 2 18 2 4 3 Additional Networks 2 19 2 5 Default IP Addresses 2 20 2 6 Port Assignments When Using a Firewall 2 33 3 Using Oracle Exadata Deployment As...

Page 6: ...4 3 2 16 Platinum Configuration Page 3 25 3 2 17 Auto Service Request Configuration Page 3 27 3 2 18 Oracle Configuration Manager Configuration Page 3 28 3 2 19 Grid Control Agent Configuration Page 3 29 3 3 OEDA Command Line Interface 3 30 3 3 1 About the OEDA Command Line Interface 3 30 3 3 2 Starting the OEDACLI Utility 3 32 3 3 2 1 Displaying Help Output for OEDACLI 3 32 3 3 2 2 Displaying Hel...

Page 7: ...ck and Oracle Exadata Database Machine Half Rack 5 4 5 2 Configuring the Cisco Ethernet Switch 5 6 5 2 1 Configuring the Cisco Catalyst 4948 Ethernet Switch 5 6 5 2 2 Configuring the Cisco Nexus 93108 1G Ethernet Switch 5 13 5 2 2 1 Performing the Initial Switch Configuration for the Cisco Nexus 93108 1G Ethernet Switch 5 14 5 2 2 2 Setting the Clock on the Cisco 93108 1G Ethernet Switch 5 17 5 3 ...

Page 8: ... Machine 5 85 5 10 Adding Additional Elastic Nodes to an Existing Rack 5 90 5 11 Loading the Configuration Information and Installing the Software 5 90 5 11 1 Configuring Oracle Exadata Database Machine Using Oracle Exadata Deployment Assistant 5 91 5 11 2 Configuring Oracle Database and Oracle ASM Instances for Oracle Exadata Database Machine Manually 5 93 5 11 2 1 Configuring the Compatible Para...

Page 9: ...B Database High Availability Checklist Index ix ...

Page 10: ... to electronic support through My Oracle Support For information visit http www oracle com pls topic lookup ctx acc id info or visit http www oracle com pls topic lookup ctx acc id trs if you are hearing impaired Related Documentation In addition to the Oracle Exadata Database Machine documentation set the following guides contain hardware information for Oracle Exadata Database Machine Oracle Exa...

Page 11: ...erly Sun Fire X4800 M2 Service Manual at http docs oracle com cd E20815_01 html E20819 index html Sun Fire X4800 Server Service Manual at http docs oracle com cd E19140 01 html 821 0282 index html Sun Fire X4270 M2 Server Service Manual at http docs oracle com cd E19245 01 E21671 index html Sun Fire X4170 M2 Server Service Manual at http docs oracle com cd E19762 01 E22369 02 index html Sun Fire X...

Page 12: ...7 data_sheet_c78 598933 html Cisco Nexus 9300 EX and 9300 FX Platform Switches Data Sheet at https www cisco com c en us products collateral switches nexus 9000 series switches datasheet c78 736651 html Conventions The following text conventions are used in this document Convention Meaning boldface Boldface type indicates graphical user interface elements associated with an action or terms defined...

Page 13: ...Racks 1 1 1 General Environmental Requirements for Oracle Exadata Database Machine X6 2 X6 8 and Later For Oracle Exadata Database Machine X6 2 and later environmental requirements such as weight acoustic level power cooling and air flow use the Oracle Exadata Configuration Assistant available on Oracle Technology Network http www oracle com technetwork database exadata oeca download 2817713 html ...

Page 14: ...1 lbs Acoustic levels 86 db A 85 db A 83 db A 83 db A Power See Also Electrical Power Requirements page 1 34 Extreme Flash drives Maximum 15 7 kVA Typical 11 0 kVA varies based on application load High capacity drives Maximum 15 6 kVA Typical 10 9 kVA varies based on application load Extreme Flash drives Maximum 8 5 kVA Typical 5 9 kVA varies based on application load High capacity drives Maximum ...

Page 15: ...Typical 8 071 BTU hour 8 515 kJ hour Air flow front to back subject to actual data center environment See Also Temperature and Humidity Requirements page 1 44 and Ventilation and Cooling Requirements page 1 45 Extreme Flash drives Maximum Approximatel y 2 434 CFM Typical Approximatel y 1 704 CFM High capacity drives Maximum Approximatel y 2 410 CFM Typical Approximatel y 1 687 CFM Extreme Flash dr...

Page 16: ... ports 8 x 10 GbE Ethernet ports At least 12 InfiniBand ports 6 x 1 GbE 10 GbE Ethernet ports 4 x 10 GbE Ethernet ports At least 12 InfiniBand ports 6 x 1 GbE 10 GbE Ethernet ports 4 x 10 GbE Ethernet ports At least 12 InfiniBand ports 1 1 3 General Environmental Requirements for Oracle Exadata Database Machine X5 8 Table 1 2 page 1 4 shows the general environmental requirements for Oracle Exadata...

Page 17: ...7 BTU hour 40 920 kJ hour Extreme Flash drives Max 32 436 BTU hour 34 220 kJ hour Typical 22 705 BTU hour 23 954 kJ hour High capacity drives Max 32 323 BTU hour 34 101 kJ hour Typical 22 626 BTU hour 23 871 kJ hour Air flow front to back subject to actual data center environment See Also Temperature and Humidity Requirements page 1 44 and Ventilation and Cooling Requirements page 1 45 Extreme Fla...

Page 18: ... drives Maximum 12 4 kVA Typical 8 7 kVA varies based on application load High capacity drives Maximum 11 4 kVA Typical 8 1 kVA varies based on application load High performance drives Maximum 6 8 kVA Typical 4 8 kVA varies based on application load High capacity drives Maximum 6 3 kVA Typical 4 4 kVA varies based on application load High performance drives Maximum 3 4 kVA Typical 2 5 kVA varies b...

Page 19: ...hour 11 200 kJ hour Typical 7 500 BTU hour 7 900 kJ hour High performance drives Maximum 10 200 BTU hour 10 700 kJ hour Typical 7 100 BTU hour 7 500 kJ hour High capacity drives Maximum 9 500 BTU hour 10 000 kJ hour Typical 6 600 BTU hour 7 000 kJ hour Air flow front to back subject to actual data center environment See Also Temperature and Humidity Requirements page 1 44 and Ventilation and Cooli...

Page 20: ... Oracle Exadata Database Machine page 1 47 Minimum of 11 network drops Minimum of 7 network drops Minimum of 5 network drops Minimum of 5 network drops External connectivity See Also Network Connection and IP Address Requirements for Oracle Exadata Database Machine page 1 47 18 x 1 GbE 10 GbE Ethernet ports 16 x 10 GbE Ethernet ports At least 12 InfiniBand ports 12 x 1 GbE 10 GbE Ethernet ports 8 ...

Page 21: ...ng Requirements page 1 45 Extreme Flash drives Maximum 57 300 BTU hour 60 452 kJ hour Typical 40 110 BTU hour 42 316 kJ hour High capacity drives Maximum 56 775 BTU hour 59 897 kJ hour Typical 39 742 BTU hour 41 928 kJ hour Extreme Flash drives Maximum 33 801 BTU hour 35 660 kJ hour Typical 23 660 BTU hour 24 962 kJ hour High capacity drives Maximum 33 688 BTU hour 35 541 kJ hour Typical 23 582 BT...

Page 22: ...Band ports 16 x 1 GbE Ethernet ports 16 x 10 GbE Ethernet SFP ports At least 12 InfiniBand ports 1 1 6 General Environmental Requirements for Oracle Exadata Database Machine X4 8 Full Rack Table 1 5 page 1 10 shows the general environmental requirements for Oracle Exadata Database Machine X4 8 Full Rack The other sections in this chapter provide detailed information Table 1 5 Environmental Require...

Page 23: ...2 280 CFM Typical Approximately 1 600 CFM IP Addresses See Also Network Connection and IP Address Requirements for Oracle Exadata Database Machine page 1 47 44 for Ethernet network assuming single cluster Up to 36 for InfiniBand network Network drops See Also Network Connection and IP Address Requirements for Oracle Exadata Database Machine page 1 47 Minimum of 5 network drops External connectivit...

Page 24: ...ives Maximum 12 1 kVA Typical 8 6 kVA varies based on application load High capacity drives Maximum 11 1 kVA Typical 7 8 kVA varies based on application load High performance drives Maximum 6 6 kVA Typical 4 7 kVA varies based on application load High capacity drives Maximum 6 1 kVA Typical 4 3 kVA varies based on application load High performance drives Maximum 3 3 kVA Typical 2 4 kVA varies base...

Page 25: ...ur 10 800 kJ hour Typical 7 200 BTU hour 7 600 kJ hour High performance drives Maximum 9 900 BTU hour 10 500 kJ hour Typical 6 800 BTU hour 7 200 kJ hour High capacity drives Maximum 9 200 BTU hour 9 700 kJ hour Typical 6 500 BTU hour 6 850 kJ hour Air flow front to back subject to actual data center environment See Also Temperature and Humidity Requirements page 1 44 and Ventilation and Cooling R...

Page 26: ...dress Requirements for Oracle Exadata Database Machine page 1 47 Minimum of 11 network drops Minimum of 7 network drops Minimum of 5 network drops Minimum of 5 network drops External connectivity See Also Network Connection and IP Address Requirements for Oracle Exadata Database Machine page 1 47 24 x 1 GbE 10 GbE Ethernet ports 16 x 10 GbE Ethernet ports At least 12 InfiniBand ports 12 x 1 GbE 10...

Page 27: ...ximum 48 500 BTU hour 51 200 kJ hour Typical 34 200 BTU hour 36 100 kJ hour Air flow front to back subject to actual data center environment See Also Temperature and Humidity Requirements page 1 44 and Ventilation and Cooling Requirements page 1 45 High performance drives Maximum Approximately 2 400 CFM Typical Approximately 1 700 CFM High capacity drives Maximum Approximately 2 250 CFM Typical Ap...

Page 28: ...d on application load High capacity drives Maximum 14 3 kVA Typical 10 0 kVA varies based on application load Cooling See Also Temperature and Humidity Requirements page 1 44 and Ventilation and Cooling Requirements page 1 45 High performance drives Maximum 51 200 BTU hour 54 000 kJ hour Typical 35 900 BTU hour 37 900 kJ hour High capacity drives Maximum 47 800 BTU hour 50 400 kJ hour Typical 33 5...

Page 29: ...hapter provide detailed information Table 1 9 Environmental Requirements for Oracle Exadata Database Machine X2 2 Environmental Component Oracle Exadata Database Machine X2 2 Full Rack Oracle Exadata Database Machine X2 2 Half Rack Oracle Exadata Database Machine X2 2 Quarter Rack Weight See Also Flooring Requirements page 1 34 966 6 kg 2131 lbs 602 8 kg 1329 lbs 409 1kg 902 lbs Acoustic levels 89...

Page 30: ...chine X2 2 with X4170 and X4275 servers 11 for InfiniBand network 23 for Ethernet network assuming single cluster 5 for InfiniBand network Network drops See Also Network Connection and IP Address Requirements for Oracle Exadata Database Machine page 1 47 Minimum of 12 network drops Minimum of 8 network drops Minimum of 6 network drops External connectivity See Also Network Connection and IP Addres...

Page 31: ...our 44 580 kJ hour Air flow front to back subject to actual data center environment See Also Temperature and Humidity Requirements page 1 44 and Ventilation and Cooling Requirements page 1 45 Maximum Approximately 2 690 CFM Typical Approximately 1 880 CFM Maximum Approximately 2 781CFM Typical Approximately 1 950 CFM IP Addresses See Also Network Connection and IP Address Requirements for Oracle E...

Page 32: ...vironmental Component Oracle Exadata Storage Expansion X5 2 Full Rack Oracle Exadata Storage Expansion X5 2 Half Rack Oracle Exadata Storage Expansion X5 2 Quarter Rack Weight Extreme Flash drives 821 kg 1810 lbs High capacity drives 915 8 kg 2019 lbs Extreme Flash drives 546 6 kg 1205 lbs High capacity drives 591 5 kg 1304 lbs Extreme Flash drives 364 5 kg 804 lbs High capacity drives 384 4 kg 84...

Page 33: ...U hour 9 019 kJ hour Air flow front to back subject to actual data center environment Extreme Flash drives Maximum Approximately 2 030 CFM Typical Approximately 1 420 CFM High capacity drives Maximum Approximately 1 975 CFM Typical Approximately 1 385 CFM Extreme Flash drives Maximum Approximately 920 CFM Typical Approximately 645 CFM High capacity drives Maximum Approximately 1 065 CFM Typical Ap...

Page 34: ...ries based on application load High performance drives Maximum 5 7 kVA Typical 4 1 kVA varies based on application load High capacity drives Maximum 5 2 kVA Typical 3 7 kVA varies based on application load High performance drives Maximum 2 9 kVA Typical 2 0 kVA varies based on application load High capacity drives Maximum 2 7 kVA Typical 2 0 kVA varies based on application load Cooling High perfor...

Page 35: ...uster 36 for InfiniBand network 24 for Ethernet network assuming single cluster 18 for InfiniBand network 13 for Ethernet network assuming single cluster 8 for InfiniBand network Network drops Minimum of 1 network drop Minimum of 1 network drop Minimum of 1 network drop External connectivity 12 InfiniBand ports 12 InfiniBand ports 12 InfiniBand ports 1 1 15 General Environmental Requirements for O...

Page 36: ...gh capacity drives Maximum 29 700 BTU hour 31 300 kJ hour Typical 20 800 BTU hour 21 950 kJ hour High performance drives Maximum 19 100 BTU hour 20 150 kJ hour Typical 13 650 BTU hour 14 400 kJ hour High capacity drives Maximum 17 100 BTU hour 18 000 kJ hour Typical 11 950 BTU hour 12 600 kJ hour High performance drives Maximum 9 500 BTU hour 10 000 kJ hour Typical 6 700 BTU hour 7 000 kJ hour Hig...

Page 37: ...s depend on the size of the system Table 1 14 page 1 25 shows the general environmental requirements for each type of Oracle Exadata Storage Expansion Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers Table 1 14 Environmental Requirements for Oracle Exadata Storage Expansion Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers Environmental Component Oracle Exadata Storage...

Page 38: ...17 General Environmental Requirements for Single Servers The environmental requirements for single servers are shown in the following tables Table 1 15 Environmental Requirements for X7 2 Single Servers Environmental Component Exadata Storage Server X7 2 Extreme Flash Exadata Storage Server X7 2 High Capacity Database Server X7 2 Weight 28 1 kg 62 lbs 33 1 kg 73 lbs 20 4 kg 45 lbs Acoustic levels ...

Page 39: ...ypical Approximately 65 CFM Maximum Approximately 105 CFM Typical Approximately 74 CFM Table 1 17 Environmental Requirements for X5 2 Single Servers Environmental Component Exadata Storage Server X5 2 Extreme Flash Exadata Storage Server X5 2 High Capacity Database Server X5 2 Weight 28 1 kg 62 lbs 33 1 kg 73 lbs 20 4 kg 45 lbs Acoustic levels 78 db A 78 db A 78 db A Power Maximum 0 6 kVA Typical ...

Page 40: ... handle to handle 48 6 inches The minimum ceiling height for the cabinet is 2914 mm 114 72 inches measured from the true floor or raised floor whichever is higher This includes an additional 914 mm 36 inches of space required above the rack height for maintenance access as described in Table 1 22 page 1 34 The space surrounding the cabinet must not restrict the movement of cool air between the air...

Page 41: ...cess route requirements for Oracle Exadata Rack Table 1 19 Rack Weights for Oracle Exadata Database Machine Type of Rack Shipping Weight Net Weight Oracle Exadata Database Machine X7 2 Full Rack Extreme Flash 974 0 kg 2147 2 lbs High Capacity 1071 1 kg 2361 4 lbs Extreme Flash 815 1 kg 1797 2 lbs High Capacity 912 4 kg 2011 4 lbs Oracle Exadata Database Machine X7 2 Half Rack Extreme Flash 698 4 k...

Page 42: ...sh drives 828 5 kg 1826 5 lbs High capacity drives 898 3 kg 1980 5 lbs Oracle Exadata Database Machine X6 8 Half Rack Extreme Flash drives 592 2 kg 1305 5 lbs High capacity drives 607 1 kg 1338 5 lbs Extreme Flash drives 525 9 kg 1159 5 lbs High capacity drives 540 9 kg 1192 5 lbs Oracle Exadata Database Machine X5 8 Half Rack Extreme Flash drives 592 4 kg 1306 1 lbs High capacity drives 607 4 kg ...

Page 43: ...929 9 kg 2050 lbs Oracle Exadata Database Machine X2 2 Full Rack 1050 1 kg 2315 lbs 966 61 kg 2131 lbs Oracle Exadata Database Machine X2 2 Half Rack 684 1 kg 1508 lbs 602 8 kg 1329 lbs Oracle Exadata Database Machine X2 2 Quarter Rack 487 6 kg 1075 lbs 409 1 kg 902 lbs Oracle Exadata Database Machine X2 8 Full Rack with Sun Fire X4800 Oracle Database Servers 1026 9 kg 2264 lbs 943 8 kg 2080 lbs O...

Page 44: ...cle Exadata Storage Expansion X5 2 Half Rack 640 9 kg 1413 lbs 591 5 kg 1304 lbs Oracle Exadata Storage Expansion X5 2 Quarter Rack 444 5 kg 980 lbs 411 kg 906 1 lbs Oracle Exadata Storage Expansion X4 2 Full Rack 903 1 kg 1991 lbs 824 2 kg 1817 1 lbs Oracle Exadata Storage Expansion X4 2 Half Rack 562 4 kg 1239 9 lbs 513 0 kg 1131 lbs Oracle Exadata Storage Expansion X4 2 Quarter Rack 380 1 kg 83...

Page 45: ...ping Pallet Minimum door height 2184 mm 86 inches 2040 mm 80 32 inches Minimum door width 1270 50 inches 640 mm 25 19 inches Minimum elevator depth 1625 6 mm 64 inches 1240 mm 48 82 inches Maximum incline 6 degrees 6 degrees Minimum elevator pallet jack and floor loading capacity 1134 kg 2500 lbs 1134 kg 2500 lbs 1 2 2 Maintenance Access Requirements The maintenance area must be large enough for O...

Page 46: ...pment including PDUs 1004 66 kg 2215 lbs 1 4 Electrical Power Requirements Oracle Exadata Racks can operate effectively over a wide range of voltages and frequencies However they must have a reliable power source Damage may occur if the ranges are exceeded Electrical disturbances such as the following may damage Oracle Exadata Rack Fluctuations caused by brownouts Wide and rapid variations in inpu...

Page 47: ...1 30 page 1 40 Low voltage 24 kVA Three Phase PDUs for North America South America Japan and Taiwan 2 PDUs per Rack Table 1 31 page 1 41 High voltage 24 kVA Three Phase PDUs for Europe the Middle East and Africa EMEA and Asia Pacific APAC except for Japan and Taiwan 2 PDUs per Rack Table 1 32 page 1 42 Low voltage 37 kVA Three Phase PDUs for North America South America Japan and Taiwan 2 PDUs per ...

Page 48: ...le Phase Power Connector Table 1 25 page 1 36 lists the requirements for low voltage three phase PDUs for North America South America Japan and Taiwan There are two PDUs per rack The following specifications are per PDU Table 1 25 Low voltage 15 kVA Three Phase PDUs for North America South America Japan and Taiwan 2 PDUs per Rack Option Requirement per PDU Voltage 190 220 VAC Frequency 50 60 Hz Cu...

Page 49: ...owing specifications are per PDU Table 1 26 High voltage 15 kVA Single Phase PDUs for Europe the Middle East and Africa EMEA and Asia Pacific APAC except for Japan and Taiwan 2 PDUs per Rack Option Requirement per PDU Voltage 220 240 VAC Frequency 50 60 Hz Current 24 A maximum per input Power rating 15 kVA Output current 72 A 3 x 24 A Outlets 42 x C13 6 x C19 Outlet groups 6 Group protection UL489...

Page 50: ...ole circuit breaker 20A Data center receptacle 15kVA three phase 5 pin IEC 60309 32A 5 pin 230 400V three phase IP44 The following are needed to connect an Oracle Exadata system to a high voltage three phase power source 2 power cords for two PDUs 25 amperes at 220 380 240 415 VAC three phase 2 receptacles to connect the PDUs to 2 IEC 60309 32A 5 pin 230 400VAC 3ph IP44 data center receptacles Fig...

Page 51: ... PDUs Figure 1 5 page 1 39 shows the low voltage 22 kVA single phase PDU power connector for North America South America Japan and Taiwan This power connector is different from the power connector for the low voltage 15 kVA single phase PDU Figure 1 5 Low voltage 22 kVA Single Phase Power Connector Table 1 29 page 1 39 lists the requirements for 22 kVA high voltage one phase PDUs for Europe the Mi...

Page 52: ...onnect an Oracle Exadata system to a high voltage one phase power source 6 power cords for two PDUs 25 amperes at 220 380 240 415 VAC 1 phase voltage 6 receptacles to connect the PDUs to 2 IEC 60309 32A 3 pin 250VAC IP44 data center receptacles and requires 22 kVA 1 phase Figure 1 3 page 1 37 shows the high voltage single phase PDU power connector for EMEA and APAC except for Japan and Taiwan Tabl...

Page 53: ...East and Africa EMEA and Asia Pacific APAC except for Japan and Taiwan 2 PDUs per Rack Option Requirement per PDU Voltage 220 380 240 415 VAC 3 phase Frequency 50 60 Hz Current 18 1 A maximum per phase Power rating 25 kVA Output current 108 6A 6 x 18 1 A Outlets 42 x C13 6 x C19 Outlet groups 6 Group protection UL489 1 pole circuit breaker 20A Data center receptacle IEC309 4P5W IP44 32A 400VAC 3ph...

Page 54: ...Figure 1 2 page 1 37 shows the low voltage 37 kVA single phase PDU power connector for North America South America Japan and Taiwan Table 1 33 page 1 42 lists the requirements for 37 kVA high voltage three phase PDUs for Oracle Exadata Database Machine X6 8 X5 8 and X4 8 with more than four database servers There are two PDUs per rack The following specifications are per PDU Table 1 33 High voltag...

Page 55: ...eters 13 12 feet long and 1 to 1 5 meters 3 3 to 4 9 feet of the cord is routed within the rack cabinet The installation site AC power receptacle must be within 2 meters 6 6 feet of the rack 1 4 3 Circuit Breaker Requirements To prevent catastrophic failures the design of your power system must ensure that adequate power is provided to the servers Use dedicated AC breaker panels for all power circ...

Page 56: ...ees Fahrenheit For optimal rack cooling data center temperatures from 21 to 23 degrees Celsius 70 to 74 degrees Fahrenheit Relative humidity 10 to 90 percent relative humidity non condensing Up to 93 percent relative humidity For optimal data center rack cooling 45 to 50 percent non condensing Altitude 3048 meters 10000 feet maximum 12000 meters 40000 feet Ambient temperature is reduced by 1 degre...

Page 57: ...objects that might prevent air from flowing through the rack Rack mountable servers and equipment typically draw cool air in through the front of the rack and let out warm air out the rear of the rack There is no air flow requirement for the left and right sides due to front to back cooling If the rack is not completely filled with components then cover the empty sections with filler panels Gaps b...

Page 58: ...M tile in front of the rack for cold air intake The tiles can be arranged in any order in front of the rack as long as cold air from the tiles can flow into the rack Inadequate cold air flow could result in a higher inlet temperature in the servers due to exhaust air recirculation The following table describes the recommended number of floor tiles Type of Oracle Exadata Database Machine or Oracle ...

Page 59: ...h in the rack to the existing management network 1 Ethernet connection for the KVM switch in the rack to the existing management network Client access network connection requirements One Ethernet connection per database server to the client access network The number depends on the system type Oracle Exadata Database Machine Full Rack Oracle Exadata Database Machine Half Rack or Oracle Exadata Data...

Page 60: ...during deployment Oracle Exadata Database Machine X2 8 Full Rack has a total of 16 Ethernet ports per server The additional networks for Oracle Exadata Database Machine X2 8 Full Rack are NET2 through NET15 The following table shows examples of connection requirements for different sample environments The table applies to two socket x86 Oracle Exadata Database Machine X3 2 and later Table 1 35 Exa...

Page 61: ...s of connection requirements for different sample environments with Oracle Exadata Database Machine X2 2 Table 1 36 Examples of Network Configurations and Connection Requirements for Oracle Exadata Database Machine X2 2 Scenario Network Requirements Oracle Exadata Database Machine X2 2 Full Rack using a bonded network configuration and connected to a dedicated backup network Requires 28 connection...

Page 62: ...Machine Deployment Assistant The assistant generates a file to be used when setting up the system The host names and IP addresses specified in the assistant generated file for the management network client access network and additional networks should be registered in Domain Name System DNS prior to initial configuration In addition all public addresses single client access name SCAN addresses and...

Page 63: ...formation when completing the Oracle Exadata Database Machine Deployment Assistant Configure the new IP addresses in your existing networks only after you have run Oracle Exadata Database Machine Deployment Assistant All IP addresses in the assistant generated file must be unassigned at the time of initial configuration In addition all IP addresses must be statically assigned IP addresses not dyna...

Page 64: ...adata Storage Server 3 IP addresses for switches 2 for InfiniBand and 1 for Ethernet 2 IP addresses for monitoring electric current of the PDUs Minimum of 19 IP address 8 IP addresses for public access one per database server 8 IP addresses for Oracle RAC VIP addresses one per database server 3 IP addresses for SCAN addresses for Oracle RAC Minimum of 8 IP addresses for each additional network 8 I...

Page 65: ... Server 3 IP addresses for switches 2 for InfiniBand and 1 for Ethernet 2 IP addresses for monitoring electric current of the PDUs Minimum of 11 IP addresses 4 IP addresses for public access one per database server 4 IP addresses for Oracle RAC VIP addresses one per database server 3 IP addresses for SCAN addresses for Oracle RAC Minimum of 4 IP addresses for each additional network 4 IP addresses...

Page 66: ...sses for ILOM one per Exadata Storage Server 3 IP addresses for switches 2 for InfiniBand and 1 for Ethernet 2 IP addresses for monitoring electric current of the PDUs Minimum of 7 IP addresses 2 IP addresses for public access one per database server 2 IP addresses for Oracle RAC VIP addresses one per database server 3 IP addresses for SCAN addresses for Oracle RAC Minimum of 2 IP addresses for ea...

Page 67: ...ation one per Exadata Storage Server 2 IP addresses for ILOM one per database server 14 IP addresses for ILOM one per Exadata Storage Server 3 IP addresses for switches 2 for InfiniBand and 1 for Ethernet 2 IP addresses for monitoring electric current of the PDUs Minimum of 7 IP addresses 2 IP addresses for public access one per database server 2 IP addresses for Oracle RAC VIP addresses one per d...

Page 68: ...abase server 3 IP addresses for ILOM one per Exadata Storage Server 3 IP addresses for switches 2 for InfiniBand and 1 for Ethernet 2 IP addresses for monitoring electric current of the PDUs Minimum of 7 IP addresses 2 IP addresses for public access one per database server 2 IP addresses for Oracle RAC VIP addresses one per database server 3 IP addresses for SCAN addresses for Oracle RAC 22 IP add...

Page 69: ... Storage Server 3 IP addresses for switches 2 for InfiniBand and 1 for Ethernet 2 IP addresses for monitoring electric current of the PDUs Minimum of 19 IP address 8 IP addresses for public access one per database server 8 IP addresses for Oracle RAC VIP addresses one per database server 3 IP addresses for SCAN addresses for Oracle RAC Minimum of 8 IP addresses for each additional network 8 IP add...

Page 70: ...a Storage Server 3 IP addresses for switches 2 for InfiniBand and 1 for Ethernet 2 IP addresses for monitoring electric current of the PDUs Minimum of 11 IP addresses 4 IP addresses for public access one per database server 4 IP addresses for Oracle RAC VIP addresses one per database server 3 IP addresses for SCAN addresses for Oracle RAC Minimum of 4 IP addresses for each additional network 4 IP ...

Page 71: ...esses for ILOM one per Exadata Storage Server 3 IP addresses for switches 2 for InfiniBand and 1 for Ethernet 2 IP addresses for monitoring electric current of the PDUs Minimum of 7 IP addresses 2 IP addresses for public access one per database server 2 IP addresses for Oracle RAC VIP addresses one per database server 3 IP addresses for SCAN addresses for Oracle RAC Minimum of 2 IP addresses for e...

Page 72: ...r Ethernet 2 IP addresses for monitoring electric current of the PDUs Minimum 7 IP addresses 2 IP addresses for public access one per database server 2 IP addresses for Oracle RAC VIP addresses one per database server 3 IP addresses for SCAN addresses for Oracle RAC Minimum of 2 IP addresses for each additional network 2 IP addresses for the database servers one per database server If using a bond...

Page 73: ...M one per Exadata Storage Server 4 IP addresses for switches 3 for InfiniBand and 1 for Ethernet 2 IP addresses for monitoring electric current of the PDUs Minimum of 19 IP address 8 IP addresses for public access one per database server 8 IP addresses for Oracle RAC VIP addresses one per database server 3 IP addresses for SCAN addresses for Oracle RAC Minimum of 8 IP addresses for each additional...

Page 74: ...OM one per Exadata Storage Server 4 IP addresses for switches 3 for InfiniBand and 1 for Ethernet 2 IP addresses for monitoring electric current of the PDUs Minimum of 11 IP addresses 4 IP addresses for public access one per database server 4 IP addresses for Oracle RAC VIP addresses one per database server 3 IP addresses for SCAN addresses for Oracle RAC Minimum of 4 IP addresses for each additio...

Page 75: ...ILOM one per Exadata Storage Server 3 IP addresses for switches 2 for InfiniBand and 1 for Ethernet 2 IP addresses for monitoring electric current of the PDUs Minimum of 7 IP addresses 2 IP addresses for public access one per database server 2 IP addresses for Oracle RAC VIP addresses one per database server 3 IP addresses for SCAN addresses for Oracle RAC Minimum of 2 IP addresses for each additi...

Page 76: ... 14 IP addresses for ILOM one per Exadata Storage Server 4 IP addresses for switches 3 for InfiniBand and 1 for Ethernet 2 IP addresses for monitoring electric current of the PDUs Minimum of 7 IP address 2 IP addresses for public access one per database server 2 IP addresses for Oracle RAC VIP addresses one per database server 3 IP addresses for SCAN addresses for Oracle RAC Minimum of 2 IP addres...

Page 77: ...rage Server 4 IP addresses for switches 3 for InfiniBand and 1 for Ethernet 2 IP addresses for monitoring electric current of the PDUs Minimum of 7 IP address 2 IP addresses for public access one per database server 2 IP addresses for Oracle RAC VIP addresses one per database server 3 IP addresses for SCAN addresses for Oracle RAC Minimum of 2 IP addresses for each additional network 2 IP addresse...

Page 78: ... per Exadata Storage Server 5 IP addresses for switches 3 for InfiniBand 1 for Ethernet and 1 for KVM 2 IP addresses for monitoring electric current of the PDUs Minimum of 19 IP address 8 IP addresses for public access one per database server 8 IP addresses for Oracle RAC VIP addresses one per database server 3 IP addresses for SCAN addresses for Oracle RAC Minimum of 8 IP addresses for each addit...

Page 79: ...erver 5 IP addresses for switches 3 for InfiniBand 1 for Ethernet and 1 for KVM 4 IP addresses are needed for Oracle Exadata Database Machine X2 2 with X4170 and X4275 servers 2 for InfiniBand 1 for Ethernet and 1 for KVM 2 IP addresses for monitoring electric current of the PDUs Minimum of 11 IP addresses 4 IP addresses for public access one per database server 4 IP addresses for Oracle RAC VIP a...

Page 80: ...one per Exadata Storage Server 4 IP addresses for switches 2 for InfiniBand 1 for Ethernet and 1 for KVM 2 IP addresses for monitoring electric current of the PDUs Minimum of 7 IP addresses 2 IP addresses for public access one per database server 2 IP addresses for Oracle RAC VIP addresses one per database server 3 IP addresses for SCAN addresses for Oracle RAC Minimum of 2 IP addresses for each a...

Page 81: ...dresses for SCAN addresses for Oracle RAC Minimum of 2 IP addresses for each additional network 2 IP addresses for the database servers one per database server If using a bonded network configuration for the client access network then NET2 cannot be used as an additional network 22 IP addresses 8 IP addresses one per database server 14 IP addresses one per Exadata Storage Server Related Topics Cal...

Page 82: ...s number of storage servers 2 number of PDUs number of IB switches number of Ethernet switches Number of client access network IP addresses number of Oracle VM user domains 2 number of Oracle RAC VM clusters 3 Number of InfiniBand network IP addresses number of Oracle VM user domains 2 number of storage servers 2 Number of additional network IP addresses number of database servers number of Oracle...

Page 83: ...ent 1 IP address for each additional configured network Oracle VM deployment 1 IP address for each user domain for each additional configured network Physical deployment 2 IP address es when using active active bonding or 1 IP address when not using active active bonding Oracle VM deployment 2 IP addresses for each user domain when using active active bonding or 1 IP address for each user domain w...

Page 84: ... Configuration and Oracle Exadata Database Machine X5 2 Elastic Configuration with the following configuration 3 database servers 9 Exadata Storage Servers and 2 InfiniBand switches Oracle VM deployment with two 3 node Oracle RAC VM clusters 2 clusters and 6 user domains total Dedicated backup network Active active bonding on the InfiniBand network 37 IP addresses for the management network 18 IP ...

Page 85: ... rack to the existing management network 1 Ethernet connection for each of the two PDUs Network connectivity to the PDUs is only required if the electric current is monitored remotely Management network connection requirements for Oracle Exadata Storage Expansion Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers 1 Ethernet connection from the ILOM to each Exadata Storage Server For O...

Page 86: ...network and up to 18 for the private InfiniBand network 9 IP addresses for administration one per Exadata Storage Server 9 IP addresses for ILOM one per Exadata Storage Server 4 IP addresses for switches 3 for InfiniBand and 1 for Ethernet 2 IP addresses for monitoring electric current of the PDUs Up to 18 IP addresses for the private InfiniBand network Oracle Exadata Storage Expansion X4 2 Quarte...

Page 87: ...iBand network 9 IP addresses for administration one per Exadata Storage Server 9 IP addresses for ILOM one per Exadata Storage Server 4 IP addresses for switches 3 for InfiniBand and 1 for Ethernet 2 IP addresses for monitoring electric current of the PDUs 9 IP addresses for the private InfiniBand network Oracle Exadata Storage Expansion X3 2 Quarter Rack Total of 17 IP addresses 13 for the manage...

Page 88: ... has a strength rating to withstand the combined weight of Oracle Exadata Rack and any other installed equipment 4 Install network cables for Oracle Exadata Rack 5 Install all necessary electrical equipment and ensure that sufficient power is provided for Oracle Exadata Rack 6 Ensure that the installation site provides adequate air conditioning 7 Operate the air conditioning system for 48 hours to...

Page 89: ...adata Database Machine Note The name used for the InfiniBand interface changed from BONDIB0 to IB0 and IB1 on Oracle Exadata Database Machine X4 2 systems using release 11 2 3 3 0 and later As of release 11 2 2 1 0 the names used for bonding changed The names are BONDIB0 for the InfiniBand bonding and BONDETH0 for Ethernet bonding In earlier releases the names were BOND0 and BOND1 respectively To ...

Page 90: ...traffic Cabling or configuration changes to these interfaces on Exadata Storage Servers is not permitted Client access network This required network connects the database servers to your existing client network and is used for client access to the database servers Applications access the database through this network using Single Client Access Name SCAN and Oracle RAC Virtual IP VIP addresses Data...

Page 91: ...be isolated from all other networks Oracle Exadata Database Machine database server networking requirements are identical with the following exceptions Oracle Exadata Database Machine X7 2 embedded ports are 1 10 25 GbE Oracle Exadata Database Machine X6 2 Oracle Exadata Database Machine X5 2 Oracle Exadata Database Machine X4 2 and Oracle Exadata Database Machine X3 2 embedded ports are 1 GbE 10 ...

Page 92: ...IB1 IB1 IB0 BONDETH0 NET0 NET3 NET4 NET1 NET2 ILOM Ethernet Switch PDU A PDU B InfiniBand Switch InfiniBand Switch Exadata Database Server Exadata Storage Server The following image shows the default network diagram for Oracle Exadata Database Machine X4 2 and later models Use the files from Oracle Exadata Database Machine Deployment Assistant to verify the cable connections when cabling Oracle Ex...

Page 93: ...torage Servers InfiniBand Switch InfiniBand Switch Ethernet Switch BONDETH0 PDU A PDU B PCI1 PORTB The following image shows the default network diagram for Oracle Exadata Database Machine X3 2 and Oracle Exadata Database Machine X2 2 Use the files from Oracle Exadata Database Machine Deployment Assistant to verify the cable connections when cabling Oracle Exadata Database Machine to the existing ...

Page 94: ...se Machine X2 8 Full Rack have BONDIB0 BONDIB1 and so on for the InfiniBand private network The KVM switch is only available in Oracle Exadata Database Machine X2 2 racks Additional configuration such as defining multiple virtual local area networks VLANs or enabling routing may be required for the switch to operate properly in your environment and is not included in the installation service If ad...

Page 95: ...Server page 2 9 2 2 1 Oracle Exadata Database Machine X7 2 Database Server Each Oracle Exadata Database Machine X7 2 database server consists of the following network components and interfaces 1 embedded 1 GbE 10 GbE port and 2 embedded 10 GbE 25GbE ports 1 dual port 4X QDR 40 Gb s InfiniBand Host Channel Adapter HCA 1 embedded Ethernet port for Sun Integrated Lights Out Manager ILOM remote manage...

Page 96: ... network card and 2 embedded ports based on the Intel I350 1GbE Controller technology 8 x 10 GbE Ethernet SFP Ports 4 Dual port 10GbE PCIe 2 0 network card based on the Intel 82599 10GbE Controller technology Note The Small Form Factor Pluggable SFP modules for the 10 GbE PCIe 2 0 network cards are purchased separately 2 2 4 Oracle Exadata Database Machine X4 2 Database Server Each Oracle Exadata ...

Page 97: ... consists of the following network components and interfaces 4 embedded 1 GbE ports 1 dual port 4X QDR 40 Gb s InfiniBand Host Channel Adapter HCA 1 embedded Ethernet port for Sun Integrated Lights Out Manager ILOM remote management 1 dual port 10 GbE PCIe 2 0 network card with Intel 82599 10 GbE controller Note The Small Form Factor Pluggable SFP modules for the 10 GbE PCIe 2 0 network cards are ...

Page 98: ... Machine Maintenance Guide Network VLAN tagging is supported for Oracle Real Application Clusters on the public network If the backup network is on a tagged VLAN network the client network must also be on a separate tagged VLAN network The backup and client networks can share the same network cables Oracle Exadata Deployment Assistant OEDA supports VLAN tagging for both physical and virtual deploy...

Page 99: ...ess network can be bonded with another network on the database server to provide higher bandwidth or availability for client connections to the database In a bonded network configuration Oracle RAC SCAN and VIP addresses are defined on the BONDETH0 interface on database servers 2 4 1 Bonded Network Configurations A bonded network configuration is used when there is a need to aggregate multiple net...

Page 100: ...efer to the Linux Ethernet Bonding Driver HOWTO in the usr share doc kernel doc 2 6 39 Documentation networking bonding txt directory on any Oracle Exadata Database Machine database server The following table shows the port connections for Oracle Exadata Database Machine Two Socket Systems database servers when using channel bonding The client access network and the backup network must use differe...

Page 101: ...upporting this bonding mode Requirements for specific bonding policies are documented in the Linux Ethernet Bonding Driver HOWTO in the usr share doc kernel doc 2 6 39 Documentation networking bonding txt directory on any Oracle Exadata Database Machine database server 2 4 1 2 Bonded Network Configuration for Oracle Exadata Database Machine X7 8 When using a bonded network configuration for databa...

Page 102: ...e management network through the ETH0 interface P0 at 3 PCIe3 Provides access to the database using the client access network and is bonded with port P0 at 13 PCIe3 to create the BONDETH0 interface P0 at 13 PCIe3 Provides access to the database using the client access network and is bonded with port P0 at 3 PCIe3 to create the BONDETH1 interface Port NET MGT Provides access to ILOM using the manag...

Page 103: ...T MGT Provides access to ILOM using the management network Table 2 5 page 2 15 shows the port connections for Oracle Exadata Database Machine X3 8 Full Rack and Oracle Exadata Database Machine X2 8 Full Rack database servers when using channel bonding The NEM0 ports are on the left and the NEM1 ports are on the right Table 2 5 Channel Bonding Connections for Oracle Exadata Database Machine X2 8 an...

Page 104: ...The following sections describe the non bonded network configuration for Oracle Exadata Database Machine 2 4 2 1 Non bonded Network Configuration for Oracle Exadata Database Machine Two Socket Systems When using a non bonded network configuration for Oracle Exadata Database Machine Two Socket Systems the database servers are configured as follows Port NET0 Provides access to the operating system u...

Page 105: ...nfiguration for Oracle Exadata Database Machine X5 8 X6 8 and X7 8 When using a non bonded network configuration for Oracle Exadata Database Machine X5 8 X6 8 and X7 8 the database servers are configured as follows Port NET0 Provides access to the operating system using the management network through the ETH0 interface Port NET1 Provides access to the database using the client access network throu...

Page 106: ...ine X4 8 Full Rack has BONDIB0 BONDIB1 and so on for the InfiniBand private network 2 4 2 4 Non bonded Network Configuration for Oracle Exadata Database Machine X3 8 Full Rack and Oracle Exadata Database Machine X2 8 Full Rack When using a non bonded network configuration for Oracle Exadata Database Machine X4 8 Full Rack Oracle Exadata Database Machine X3 8 Full Rack and Oracle Exadata Database M...

Page 107: ...are 13 open ports 5 1 10 GbE ports and 8 open 10 25 GbE PCI ports on each database server On Oracle Exadata Database Machine X5 8 and X6 8 Non bonded network configuration There are 18 open ports 10 1GbE ports and 8 10GbE ports on each database server Bonded network configuration There are 15 open ports 7 1 GbE ports and 8 open 10 GbE ports on each database server On Oracle Exadata Database Machin...

Page 108: ...chine is configured or connected to the network Oracle recommends running the script to avoid configuration delays even if a check was performed as part of planning process before the machine was delivered If you ran OEDA on a Windows system then the generated script is checkip bat The following table lists the default IP addresses for Oracle Exadata Database Machine X5 2 X6 2 and X7 2 The subnet ...

Page 109: ...cable Oracle Database server 1 Assigned during first start of the system 192 168 1 108 Not applicable Exadata Storage Server 7 Assigned during first start of the system 192 168 1 107 Not applicable Exadata Storage Server 6 Assigned during first start of the system 192 168 1 106 Not applicable Exadata Storage Server 5 Assigned during first start of the system 192 168 1 105 Not applicable Exadata St...

Page 110: ...rage Server 8 192 168 1 16 192 168 1 116 192 168 10 32 192 168 10 31 Oracle Database server 8 192 168 1 15 192 168 1 115 192 168 10 30 192 168 10 29 Oracle Database server 7 192 168 1 14 192 168 1 114 192 168 10 28 192 168 10 27 Oracle Database server 6 192 168 1 13 192 168 1 113 192 168 10 26 192 168 10 25 Oracle Database server 5 192 168 1 12 192 168 1 112 192 168 10 24 192 168 10 23 Oracle Data...

Page 111: ...Sun Datacenter InfiniBand Switch 36 switch 1 192 168 1 201 Not applicable Not applicable Ethernet switch 192 168 1 200 Not applicable Not applicable The following table lists the default IP addresses for Oracle Exadata Database Machine X3 2 and Oracle Exadata Database Machine X2 2 Table 2 8 Default IP Addresses for Oracle Exadata Database Machine X3 2 and Oracle Exadata Database Machine X2 2 Compo...

Page 112: ...0 17 Exadata Storage Server 8 Oracle Exadata Database Machine Full Rack only 192 168 1 16 192 168 1 116 192 168 10 16 Oracle Database server 8 Oracle Exadata Database Machine Full Rack only 192 168 1 15 192 168 1 115 192 168 10 15 Oracle Database server 7 Oracle Exadata Database Machine Full Rack only 192 168 1 14 192 168 1 114 192 168 10 14 Oracle Database server 6 Oracle Exadata Database Machine...

Page 113: ...ack only 192 168 1 6 192 168 1 106 192 168 10 6 Exadata Storage Server 5 Oracle Exadata Database Machine Full Rack and Half Rack only 192 168 1 5 192 168 1 105 192 168 10 5 Exadata Storage Server 4 Oracle Exadata Database Machine Full Rack and Half Rack only 192 168 1 4 192 168 1 104 192 168 10 4 Exadata Storage Server 3 192 168 1 3 192 168 1 103 192 168 10 3 Exadata Storage Server 2 192 168 1 2 1...

Page 114: ...168 10 44 Exadata Storage Server 13 192 168 1 21 192 168 1 121 192 168 10 41 192 168 10 42 Exadata Storage Server 12 192 168 1 20 192 168 1 120 192 168 10 39 192 168 10 40 Exadata Storage Server 11 192 168 1 19 192 168 1 119 192 168 10 37 192 168 10 38 Exadata Storage Server 10 192 168 1 18 192 168 1 118 192 168 10 35 192 168 10 36 Exadata Storage Server 9 192 168 1 17 192 168 1 117 192 168 10 33 ...

Page 115: ... 192 168 1 2 192 168 1 102 192 168 10 3 192 168 10 4 Exadata Storage Server 1 192 168 1 1 192 168 1 101 192 168 10 1 192 168 10 2 Sun Datacenter InfiniBand Switch 36 switch 3 192 168 1 203 Not applicable Not applicable Sun Datacenter InfiniBand Switch 36 switch 2 192 168 1 202 Not applicable Not applicable Sun Datacenter InfiniBand Switch 36 switch 1 192 168 1 201 Not applicable Not applicable Eth...

Page 116: ...1 17 192 168 1 117 192 168 10 33 192 168 10 34 Exadata Storage Server 8 192 168 1 16 192 168 1 116 192 168 10 31 192 168 10 32 Oracle Database server 2 192 168 1 9 192 168 1 109 192 168 10 29 192 168 10 30 192 168 10 27 192 168 10 28 192 168 10 25 192 168 10 26 192 168 10 23 192 168 10 24 Oracle Database server 1 192 168 1 8 192 168 1 108 192 168 10 21 192 168 10 22 192 168 10 19 192 168 10 20 192...

Page 117: ...t applicable The following table lists the default IP addresses for Oracle Exadata Database Machine X3 8 Full Rack and Oracle Exadata Database Machine X2 8 Full Rack The subnet mask is 255 255 252 0 Table 2 11 Default IP Addresses for Oracle Exadata Database Machine X3 8 Full Rack and Oracle Exadata Database Machine X2 8 Full Rack Component NET0 IP Addresses ILOM IP Addresses InfiniBand Bonded IP ...

Page 118: ...rage Server 5 192 168 1 5 192 168 1 105 192 168 10 5 Exadata Storage Server 4 192 168 1 4 192 168 1 104 192 168 10 4 Exadata Storage Server 3 192 168 1 3 192 168 1 103 192 168 10 3 Exadata Storage Server 2 192 168 1 2 192 168 1 102 192 168 10 2 Exadata Storage Server 1 192 168 1 1 192 168 1 101 192 168 10 1 Sun Datacenter InfiniBand Switch 36 switch 3 192 168 1 203 Not applicable Not applicable Su...

Page 119: ... 10 73 Exadata Storage Server 11 192 168 1 61 192 168 1 161 192 168 10 72 192 168 10 71 Exadata Storage Server 10 192 168 1 60 192 168 1 160 192 168 10 70 192 168 10 69 Exadata Storage Server 9 192 168 1 59 192 168 1 159 192 168 10 68 192 168 10 67 Exadata Storage Server 8 192 168 1 58 192 168 1 158 192 168 10 66 192 168 10 65 Exadata Storage Server 7 192 168 1 57 192 168 1 157 192 168 10 64 192 1...

Page 120: ...on Rack X3 2 and Oracle Exadata Storage Expansion Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers Table 2 13 Default IP Addresses for Oracle Exadata Storage Expansion Rack X3 2 and Oracle Exadata Storage Expansion Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers Component NET0 IP Addresses ILOM IP Addresses InfiniBand Bonded IP Addresses Exadata Storage Server 18 192...

Page 121: ... 168 1 153 192 168 10 53 Exadata Storage Server 2 192 168 1 52 192 168 1 152 192 168 10 52 Exadata Storage Server 1 192 168 1 51 192 168 1 151 192 168 10 51 Sun Datacenter InfiniBand Switch 36 switch 3 192 168 1 223 Not applicable Not applicable Sun Datacenter InfiniBand Switch 36 switch 2 192 168 1 222 Not applicable Not applicable Sun Datacenter InfiniBand Switch 36 switch 1 192 168 1 221 Not ap...

Page 122: ... Mail Transfer Protocol Any ILOMs for database servers Exadata Storage Servers and InfiniBand switches HTTP 80 Management Web user configurable Any PDU HTTP 80 Management Browser interface Any KVM HTTP 80 Management Avocent video viewer download for Java applet Any rpcbind TCP 111 Management rpcbind Database management NTP servers NTP over UDP 123 Client Outgoing Network Time Protocol NTP Database...

Page 123: ...NMP manager SNMP 162 Management SNMP version 1 SNMPv1 outgoing traps user configurable Database servers Exadata Storage Servers and ILOMs for database servers Exadata Storage Servers and InfiniBand switches ASR Manager SNMP 162 Management Telemetry messages sent to ASR Manager ILOMs for database servers Exadata Storage Servers and InfiniBand switches Any IPMI over UDP 162 Management Outgoing IPMI ...

Page 124: ...essions Exadata Storage Servers SMTPS client SMTPS 465 Management Simple Mail Transfer Protocol Secure if configured Database servers Exadata Storage Servers and ILOMs for database servers Exadata Storage Servers and InfiniBand switches Syslog server Syslog over UDP 514 Management Outgoing Syslog PDU Syslog server Syslog over UDP 514 Management Outgoing Syslog KVM Syslog server Syslog over UDP 514...

Page 125: ...nagement Cisco Smart Install Any ILOMs for database servers and Exadata Storage Servers TCP 5120 Management ILOM remote console CD Any ILOMs for database servers and Exadata Storage Servers TCP 5121 Management ILOM remote console keyboard and mouse Any ILOMs for database servers and Exadata Storage Servers TCP 5123 Management ILOM remote console diskette Any ILOMs for database servers and Exadata ...

Page 126: ...8 Management ILOM remote console video Any ILOMs for database servers and Exadata Storage Servers TCP 7579 Management ILOM remote console serial Any Database servers and Exadata Storage Servers TCP 7777 Both Oracle Enterprise Manager Grid Control HTTP console port Any Database servers and Exadata Storage Servers TCP 7799 Both Oracle Enterprise Manager Grid Control HTTPS console port Any Oracle Web...

Page 127: ...Java agent sveerana TCP 42034 IPv6 Management Java agent sveerana Any Java EM Agent TCP 47632 Management See Also Appendix E Managing Oracle Database Port Numbers in the Oracle Real Application Clusters Installation Guide for Linux and UNIX Chapter 2 Port Assignments When Using a Firewall 2 39 ...

Page 128: ...Versions My Oracle Support Doc ID 888828 1 3 1 Overview of Oracle Exadata Deployment Assistant Use the deployment assistant to create the configuration file for Oracle Exadata Rack The deployment assistant is used for Oracle Exadata Database Machine Zero Data Loss Recovery Appliance and Oracle SuperCluster Before Oracle Exadata Rack arrives 1 Work with your network and database administrators to e...

Page 129: ... and so on Up to eighteen Oracle Exadata Racks can be cabled together without additional Sun Datacenter InfiniBand Switch 36 switches The backup method information is used to size the Oracle Automatic Storage Management Oracle ASM disk groups created during installation The amount of usable disk space varies depending on the backup method The backup methods are as follows Backups internal to Oracl...

Page 130: ...mal Redundancy Data files Temporary files Online redo logs Control file Online redo logs Archive logs Flashback log files Normal Normal A valid time zone name is required for Oracle Exadata Database Machine installation Time zone data provided with Oracle Exadata Database Machine and Oracle Linux comes from the zoneinfo database A valid time zone name is suitable as a value for the TZ environment ...

Page 131: ...he rack Note that this option assumes that the storage servers are not locked down 3 2 OEDA Graphical User Interface When you run the config sh program it starts the OEDA graphical user interface The OEDA GUI walks you through several configuration details screens where you provide information about how your Exadata system should be configured 3 2 1 Using Oracle Exadata Deployment Assistant Use th...

Page 132: ...wing directories are available linux x64 macos x64 solaris sparcv9 solaris x64 windows i586 Note The deployment assistant is available in the directory of the latest Bundle Patch The operating system specific directory should match the operating system of the machine that will run the deployment assistant 3 Start the deployment assistant using one of the following commands On Linux Apple or UNIX c...

Page 133: ...k Modify After changing the fields click Save to save the changes 12 Enter the operating system information on the Identify Compute Node Base OS configuration page and click Next 13 Review and edit the information for the management and private networks and click Next 14 Define the clusters on the Define Clusters page for each cluster and click Next 15 Review and edit the cluster information for e...

Page 134: ...a Deployment Assistant on Windows in Oracle Exadata System Software User s Guide 3 2 2 Customer Details Configuration Page Define the customer information on this page Table 3 2 page 3 7 lists the customer details fields Note The domain specified on this page is used as the domain for all networks If different domains are used for the client and backup networks then specify the administration netw...

Page 135: ...ion 3 2 3 Hardware Selection Configuration Page Select your hardware from the list on the left The list on the right contains the hardware for your environment 3 2 4 Rack Details Configuration Page Click the check box if you want to include a spine switch as part of the rack configuration Do this for each rack that will have a spine switch 3 2 5 Customer Network Configuration Page Table 3 3 page 3...

Page 136: ...ackup networks RJ45 SFP28 Combined on Motherboard RJ45 10 GBit SFP28 10 GBit SFP28 25GBit SFP28 PCI Dual Port Card SFP28 10 GBit SFP28 25GBit RJ45 PCI Quad Port Card extra cost option Options for X7 8 Systems On X7 8 systems there are 2 available formats for client and backup networks RJ45 on Motherboard SFP28 PCI Dual Port Cards SFP28 10 GBit SFP28 25GBit If you select one of the SFP28 network ty...

Page 137: ...t network ensure that the Share Client Network ports box is selected and the Network Format is the same type for both client and backup networks Note that for all networks the customer is responsible for configuring VLAN on the switch Note Each IP address pool should consist of consecutive IP addresses If consecutive IP addresses are not available then modify the IP addresses at the end of the Ora...

Page 138: ...he default gateway for the database servers Note This option is not usually selected for the database servers Defines the Hostname for the Compute Nodes Select this option if the adapter name defines the host names for the database servers Note This option is usually selected for the database servers Related Topics Overview of Network Requirements page 2 1 3 2 6 1 Modifying the Default Administrat...

Page 139: ...lphanumeric characters Cell Node Starting ID Defines the starting numeric ID for the first Exadata Storage Server in this rack Note Cell Node ILOM Sets the administration name for the first Exadata Storage Server ILOM in this rack Note The name contains alphanumeric characters Cell ILOM Starting ID Defines the starting numeric ID for the first Exadata Storage Server ILOM in this rack Note Cisco Sw...

Page 140: ...Oracle Support notes for details The following table lists the client network fields Sample database client name formats are based on the prefix entered on the Customer Details page To modify the name formats click Modify Table 3 6 Client Ethernet Page Client Ethernet Field Description Starting IP Address for Pool Assigns the starting IP address for the client network port of the servers and switc...

Page 141: ...orate naming standards or compatibility with existing systems The following table lists the client network format mask fields Note All fields must be filled in The percent signs in the names are replaced by the numbers entered into the Starting ID fields Table 3 7 Client Network Format Masks Page Client Network Format Masks Field Description Client Access Name Assigns the client access name for th...

Page 142: ...able then specific IP addresses can be modified during the configuration process Pool Size Defined by the hardware selection Ending IP Address for Pool Defined by the starting IP address and the pool size Related Topics Overview of Network Requirements page 2 1 3 2 8 1 Modifying the Default InfiniBand Network Names The following table lists the InfiniBand network format mask fields Note The percen...

Page 143: ...table lists the backup network fields Note Sample name formats are based on the prefix entered on the Customer Details page To modify the name formats click Modify Table 3 10 Backup Data Guard Ethernet Network Page Backup Data Guard Ethernet Network Field Description Starting IP Address for Pool Assigns starting IP address for the backup network Note The pool should consist of consecutive IP addre...

Page 144: ... the Management ILOM and private networks for the compute nodes storage cells and the switches used in the rack To check the validity of the network configuration data click the Lookup IP button OEDA will highlight fields in red if The IP address or host name could not be resolved through DNS lookup The user input differs from what is the DNS and the fields were edited to match the DNS If you go b...

Page 145: ... Cluster name Assigns the cluster name Note The name can contain alphanumeric characters periods and hyphens The name must start with an alphanumeric character This field cannot be empty Prefix Assigns the prefix for the cluster DNS Sets the DNS IP Address Note At least one IP address must be entered NTP Sets the NTP IP Address Note At least one IP address must be entered Domain Name Sets the clus...

Page 146: ...ult value is grid This is the user that owns the Oracle Grid Infrastructure installation This option is available when using role separated authentication Grid ASM Home OS User ID Assigns Oracle ASM owner ID The default value is 1000 This option is available when using role separated authentication Grid ASM Home base Sets the Oracle grid infrastructure directory The default value is u01 app grid T...

Page 147: ...ess privileges on an Oracle Database instance This option is available when using role separated authentication ASM Home Admin Group ID Assigns the Oracle ASM administration group ID The default value is 1006 This option is available when using role separated authentication RDBMS Home OS User Sets the Oracle Database installation owner name The default value is oracle This option is available when...

Page 148: ...ectory path The default value is u01 app release_number grid Database Home Location Sets the Oracle Database release and the directory path The default value is u01 app oracle product release_number dbhome_1 Software Languages Defines the languages installed for the database The default value is English en Diskgroup Layout Sets the disk group layout The options are 80 20 for DATA and RECO when usi...

Page 149: ...Sets the sparse disk group name redundancy and size The redundancy options are NORMAL and HIGH Click the Advanced Options button and then select Enable Sparse Disk Group Note To create a sparse disk group the version of Grid Infrastructure needs to be 12 1 0 2 BP5 or later Database name Sets the database name Block size Sets the database block size The default value is 8192 To use a different bloc...

Page 150: ...are in the Oracle Exadata System Software User s Guide for additional information about Oracle ASM and database scoped security Setting up Oracle Exadata Storage Snapshots chapter in the Oracle Exadata System Software User s Guide for information about sparse disk groups 3 2 13 1 Configuring Automatic Cluster File System ACFS Note Automatic Cluster File System ACFS requires Grid Infrastructure 12 ...

Page 151: ... 15 Cell Alerting Configuration Page Cell alert delivery may be configured during or after installation Cell alerts can be delivered using Simple Mail Transfer Protocol SMTP Simple Network Management Protocol SNMP or both The following table lists the cell alert configuration options Table 3 13 Cell Alerting Configuration Page Cell Alerting Field Description Enable Email Alerting Enables cell aler...

Page 152: ...inum Service provides enhanced support at no additional cost for qualified engineered systems This is a connected service and requires Oracle Advanced Support Gateway OASG to be provisioned within the environment The configuration for OASG is defined with the user information that is used by the Platinum Service monitoring agent The following table lists the Oracle Platinum Service configuration o...

Page 153: ...ing Modify Defines the remote network for the router Network format is CIDR format such as 192 0 2 1 255 Static Routes Gateway IP This field is available after clicking Modify Defines the remote network gateway IP address The address must be in the OASG primary IP subnet Gateway machine has an ILOM Specifies that OASG is an Oracle system with an ILOM service processor ILOM IP Address Sets the ILOM...

Page 154: ...s information Oracle Advanced Support Gateway Hardware Minimum Requirements Oracle Advanced Support Gateway Documentation Library 3 2 17 Auto Service Request Configuration Page Auto Service Request ASR is designed to automatically open service requests when specific Oracle Exadata Rack hardware faults occur The following table lists the ASR configuration options Table 3 15 Auto Service Request Con...

Page 155: ...nables Oracle Configuration Manager to collect configuration information Receive updates via MOS Enables My Oracle Support updates to be received automatically MOS Email Address Sets the My Oracle Support address to receive My Oracle Support updates Access Oracle Configuration Manager via Support Hub Enables Support Hub to access Oracle Configuration Manager Oracle Support Hub allows Oracle Config...

Page 156: ...ed Topics Oracle Technical Support Policies Oracle Configuration Manager Companion Distribution Guide 3 2 19 Grid Control Agent Configuration Page Oracle Enterprise Manager Grid Control is used to monitor Oracle Exadata Rack Oracle Enterprise Manager Grid Control installs agents on the database servers and points the agents to an existing Oracle Enterprise Manager Grid Control environment or insta...

Page 157: ...terface that allows you to update an existing es xml file These updates are called Actions An Action is a single atomic task You can use the command line interface to perform any of the following tasks Add node to or remove node from a Virtual Cluster on Exadata Add database home to or remove database home from physical cluster Add or remove Storage cell Resize Oracle ASM disk groups Add or remove...

Page 158: ...st08client01vm02 vip ip 10 128 196 71 3 After you have provided all the commands for an action save the action to a list of actions to be processed within the command line interface At this point the data in the es xml file is not yet updated SAVE ACTION 4 Merge the actions into the main body of the in memory copy of the es xml using the FORCE keyword MERGE ACTIONS FORCE 5 Save the memory copy of ...

Page 159: ...EDA is only supported on Oracle Linux Have the original OEDA configuration XML file used for deployment Use the default password on the nodes in the cluster for the root oracle and grid users Note If your environment does not use the default passwords for the specified users then refer to My Oracle Support Doc ID 2163751 1 File Path The directory that contains the unzipped files from the OEDA down...

Page 160: ...TWORK LIST NETWORKS SCAN LIST SCANS SWITCH LIST SWITCHES VIP LIST VIPS CLI COMMANDS LOAD FILE SAVE FILE SAVE FILES LIST XMLACTIONS SAVE ACTION MERGE ACTIONS DEPLOY ACTIONS 3 3 2 2 Displaying Help Output for an OEDACLI Command This example shows the help output listing the OEDACLI ALTER DATABASE command Example 3 2 Help Output for the OEDACLI ALTER DATABASE command This example shows how to display...

Page 161: ...red for PDB dbtype Default normal DB otherwise CDB or PDB hostnames Default list of nodes from db home recodg The RECO diskgroup not required for PDB Where databaseid The es xml id of the database clusternumber The cluster number in the es xml starting at 1 clustername The name of the cluster clusterid The es xml id of the cluster databasename The name of the database in the cluster 3 3 3 OEDACLI ...

Page 162: ...ax LOAD FILE NAME filename Arguments NAME Specifies the name of an existing engineered system XML file Example 3 3 Loading a File into OEDACLI for Editing oedacli LOAD FILE NAME Oracle test12 xml SUCCESS file loaded OK Customer testadm01 Oracle 3 3 3 1 2 SAVE ACTION Use this command to save the current action to engineered system XML memory copy Syntax SAVE ACTION FORCE Arguments Specify FORCE if ...

Page 163: ... Deploying Action ID 4 add database dbname testdb DATADG DATAC1 RECODG RECOC1 where DBHOMEID c0_databaseHome Deploying ADD DATABASE Running datapatch on database testdb Done Done 3 3 3 1 5 SAVE FILE Use this command to save a current set of actions to a new engineered system XML file Syntax SAVE FILE NAME filename Arguments The optional argument NAME is used to specify the name of a new engineered...

Page 164: ...ame VOLUMESIZE volume_size MOUNTPATH mountpath WHERE DISKGROUPID diskgroup_id CLUSTERNUMBER cluster_number DISKGROUPNAME diskgroup_name CLUSTERNAME cluster_name DISKGROUPNAME diskgroup_name CLUSTERID cluster_id DISKGROUPNAME diskgroup_name Arguments You can specify the following attributes for the new Oracle ACFS volume VOLUMENAME Specifies a unique name for the new volume VOLUMESIZE A number that...

Page 165: ...UMESIZE A number that specifies the new size of the volume in GB MOUNTPATH Specifies the new file system mount path for the volume The following arguments are available in the WHERE clause ID Specifies the es xml ID for an existing Oracle ACFS volume DISKGROUPID Specifies the es xml ID for the container disk group CLUSTERNUMBER Specifies the cluster number in the es xml starting at 1 CLUSTERNAME S...

Page 166: ...ACFSVOLUMES WHERE ID id DISKGROUPID diskgroup_id CLUSTERNUMBER cluster_number DISKGROUPNAME diskgroup_name CLUSTERNAME cluster_name DISKGROUPNAME diskgroup_name CLUSTERID cluster_id DISKGROUPNAME diskgroup_name Arguments The following arguments are available in the WHERE clause ID Specifies the es xml ID for the Oracle ACFS volume DISKGROUPID Specifies the es xml ID for the container disk group CL...

Page 167: ...ed The following arguments are available in the SET clauses ADMINNET Specifies the DNS name admin_name with an optional domain name and the IP address to be used for the admin network PRIVNET Specifies the name with an optional domain name and the IP address to be used for the first and second private networks ILOMNET Specifies the DNS name with an optional domain name and the IP address to be use...

Page 168: ...cle RAC Cluster CLUSTERNAME Specifies a new unique name for the cluster GIVERSION Specifies the clusterware version including the bundle patch for example 12 1 0 2 170418 GIHOMELOC Specifies a new path for the Grid home INVLOC Specifies a new path for the inventory BASEDIR Specifies a new path for the Oracle base directory PATCHLIST Specifies a full list of patches separated by commas and enclosed...

Page 169: ...e 3 42 ALTER DISKGROUP page 3 43 ALTER DISKGROUPS page 3 46 DELETE DISKGROUP page 3 47 LIST DISKGROUPS page 3 47 3 3 3 5 1 ADD DISKGROUP This command adds an Oracle ASM disk group Syntax ADD DISKGROUP ACFSNAME acfs_name ACFSPATH acfs_path ACFSSIZE acfs_size CELLLIST cell_list DISKGROUPNAME diskgroup_name DISKGROUPSIZE diskgroup_size OCRVOTE ocr_voting_disks_included QUORUMDISK quorum_disks_include...

Page 170: ... for each grid disk for this disk group SPARSE A boolean variable where TRUE indicates this should be sparse disk group SPARSEVIRTUALSIZE Specifies the sparse virtual size TYPE Specifies the diskgroup type which can be DATA RECO DBFS or OTHER The default value is OTHER If you want the database to use this disk group then the type must be set to DATA or RECO DATABASENAME Specifies the name of the t...

Page 171: ... QUORUMDISK A boolean variable where TRUE indicates the disk group requires a quorum REDUNDANCY Specifies the redundancy level for the disk group The accepted values are NORMAL or HIGH SLICESIZE Specifies the slice size on disk for each grid disk for this disk group SPARSE A boolean variable where TRUE indicates this should be sparse disk group SPARSEVIRTUALSIZE Specifies the sparse virtual size T...

Page 172: ...GroupSize 53154G ocrVote false quorumDisk false id c0_datadg version PhysicalLayoutLegacy diskGroupName RECOC1 redundancy NORMAL sliceSize ALL machines cellDisks ALL diskGroupSize 13284G ocrVote false quorumDisk false id c0_recodg 3 Create an action for resizing the disk group oedacli ALTER DISKGROUP DISKGROUPSIZE 2500G WHERE CLUSTERNUMBER 1 DISKGROUPN AME DATAC1 4 Save the action oedacli SAVE ACT...

Page 173: ...or existing Oracle ASM disk groups Syntax ALTER DISKGROUPS DATASPLIT data_split_percent RECOSPLIT reco_split_percent DATAREDUNDANCY data_redundancy_level RECOREDUNDANCY reco_redundancy_level SPLITDISK percent_of_cell_disk WHERE DATADG data_diskgroup RECODG reco_diskgroup CLUSTERNAME cluster_name CLUSTERNUMBER cluster_number CLUSTERID cluster_id Arguments You can modify the following sizing attribu...

Page 174: ...E clause ID Specifies the es xml ID for the disk group CLUSTERNUMBER Specifies the cluster number in the es xml starting at 1 CLUSTERNAME Specifies the name of the cluster CLUSTERID Specifies the es xml ID of the cluster DISKGROUPNAME Specifies the name of the disk group 3 3 3 5 5 LIST DISKGROUPS This command lists the existing Oracle ASM disk groups Syntax LIST DISKGROUPS WHERE ID diskgroup_id CL...

Page 175: ...container_database_name Arguments You can specify the following attributes for the new Oracle database BLOCKSIZE Specifies the block size for the new database The default value is 8192 This argument is not required for pluggable databases CHARSET Specifies the character set to use for the new database The default value is AL32UTF8 This argument is not required for pluggable databases DATADG Mandat...

Page 176: ...ML configuration file oedacli LOAD FILE NAME Oracle test xml SUCCESS file loaded OK Customer ora07adm01 Oracle 2 Use the command LIST DATABASEHOMES to identify the databasehome_id associated with the target database home This database home will be used to create the new database oedacli LIST DATABASEHOMES version CloneInstall cluster id c0_clusterHome databaseHomeName c0_DbHome_0 databaseSwOwner c...

Page 177: ... BLOCKSIZE blocksize CHARSET database_character_set DATADG data_diskgroup DBLANG database_language DBNAME database_name DBTEMPLATE database_template DBTYPE database_type HOSTNAMES host_names RECODG reco_diskgroup WHERE ID database_id CLUSTERNUMBER cluster_number DATABASENAME database_name CLUSTERNAME cluster_name DATABASENAME database_name CLUSTERID cluster_id DATABASENAME database_name Arguments ...

Page 178: ...ster number in the es xml starting at 1 CLUSTERNAME Specifies the name of the cluster CLUSTERID Specifies the es xml ID of the cluster DATABASENAME Specifies the name of the database in the cluster 3 3 3 6 3 DELETE DATABASE This command deletes an existing Oracle database Syntax DELETE DATABASE WHERE ID database_id CLUSTERNUMBER cluster_number DATABASENAME database_name CLUSTERNAME cluster_name DA...

Page 179: ...ge all_langs diskGroups diskGroup id c0_datadg id c0_recodg id c0_testdb01 3 Create an action to delete the target database Use the database id identified in the previous step oedacli delete database where id c0_testdb01 4 Save the action oedacli SAVE ACTION 5 Merge all actions oedacli MERGE ACTIONS processMerge processMergeActions Merging Action delete database where id c0_testdb01 Merging DELETE...

Page 180: ...s ADD DATABASEHOME page 3 53 ALTER DATABASEHOME page 3 55 DELETE DATABASEHOME page 3 56 LIST DATABASEHOMES page 3 57 3 3 3 7 1 ADD DATABASEHOME This command adds an Oracle database home to an existing cluster Syntax ADD DATABASEHOME OWNER owner DBVERSION version DBHOMELOC database_home_path DBHOMENAME database_home_name INVLOC inventory_location DBLANG database_language MACHINELIST machine_list PA...

Page 181: ...le VM clusters The following arguments are available in the WHERE clause CLUSTERNUMBER Specifies the cluster number in the es xml starting at 1 CLUSTERNAME Specifies the name of the cluster CLUSTERID Specifies the es xml ID of the cluster Example 3 10 Adding a Database Home to a Deployment using OEDACLI This example shows how to add a new Oracle home dbversion should specify both the base version ...

Page 182: ... p26022196_121020_Linux x86 64 zip to node node1adm01 us oracle com Copying file p26027162_121020_Linux x86 64 zip to node node1adm01 us oracle com Copying file p26022196_121020_Linux x86 64 zip to node node1adm02 us oracle com Copying file p26027162_121020_Linux x86 64 zip to node node1adm02 us oracle com Completed copying files Extracting files Completed extracting files Validating nodes for dat...

Page 183: ...or the database home CLUSTERNUMBER Specifies the cluster number in the es xml starting at 1 CLUSTERNAME Specifies the name of the cluster CLUSTERID Specifies the es xml ID of the cluster DBHOMELOC Specifies the path for the database home directory 3 3 3 7 3 DELETE DATABASEHOME This command removes an existing Oracle database home Syntax DELETE DATABASEHOME WHERE ID database_home_id CLUSTERNUMBER c...

Page 184: ...me c0_DbHome_1 Unmounting file system Updating etc fstab entries Done Done 3 3 3 7 4 LIST DATABASEHOMES This command lists the existing Oracle database homes Syntax LIST DATABASEHOMES WHERE ID database_home_id CLUSTERNUMBER cluster_number NAME database_home_name CLUSTERNAME cluster_name NAME database_home_name CLUSTERID cluster_id NAME database_home_name Arguments The following arguments are avail...

Page 185: ...t SET PARENT NAME parent_name SET ADMINNET NAME admin_name IP IP_admin SET PRIVNET NAME1 priv_name_1 IP1 priv_ip1 NAME2 priv_name_2 IP2 priv_ip2 SET INTERCONNECT NAME1 priv_name_1 IP1 priv_ip1 NAME2 priv_name_2 IP2 priv_ip2 SET CLIENTNET NAME client_name IP client_ip SET VIPNET NAME vip_name IP vip_ip Arguments SRCNAME is used to specify the name of an existing DomU from which the new DomU is deri...

Page 186: ... GUEST WHERE SRCNAME node_name Arguments SRCNAME is used to specify the host name of an existing DomU that you want to delete 3 3 3 10 ILOM You can alter or list the ILOMS in the loaded es xml file ALTER ILOM page 3 59 LIST ILOMS page 3 60 3 3 3 10 1 ALTER ILOM This command alters attributes of an ILOM Syntax ALTER ILOM DNSSERVERS dns_servers NTPSERVERS ntp_servers TIMEZONE timezone WHERE ID ilom_...

Page 187: ...l the ILOMs in the es xml file 3 3 3 11 MACHINE You can alter or list the machines in the es xml file ALTER MACHINE page 3 60 LIST MACHINES page 3 61 3 3 3 11 1 ALTER MACHINE This command alters attributes of a compute node or storage cell in an engineered system Syntax ALTER MACHINE DNSSERVERS dns_servers GATEWAYADAPTER gateway_adapter HOSTNAMEADAPTER hostname_adapter NTPSERVERS ntp_servers TIMEZ...

Page 188: ...g at 1 CLUSTERNAME Specifies the name of the cluster CLUSTERID Specifies the es xml ID of the cluster COMPUTENUMBER Specifies the compute node number in the cluster starting at 1 STORAGENUMBER Specifies the storage cell number in the cluster starting at 1 3 3 3 11 2 LIST MACHINES This command lists the machine available in the es xml file for an engineered system Syntax LIST MACHINES WHERE TYPE ty...

Page 189: ...E hostname CLUSTERNAME cluster_name COMPUTENUMBER compute_number CLUSTERNAME cluster_name STORAGENUMBER storage_number CLUSTERNUMBER cluster_number COMPUTENUMBER compute_number CLUSTERNUMBER cluster_number STORAGENUMBER storage_number Arguments You can specify the following attributes when adding a network NETWORKTYPE Mandatory Specifies the type of network which can be ADMIN CLIENT BACKUP PRIVATE...

Page 190: ... starting at 1 STORAGENUMBER Specifies the umber of an existing storage cell in the cluster starting at 1 3 3 3 12 2 ALTER NETWORK This command modifies a network record for a machine in the existing configuration Syntax ALTER NETWORK HOSTNAME hostname IP ip_addr NETMASK netmask DOMAINNAME domain_name MASTER master GATEWAY gateway SSHENABLED ssh_enabled MAC mac_addr NICSPEED nic_speed SLAVE slave ...

Page 191: ... not private NATHOSTNAME Specifies the NAT host name NATIP Specifies the NAT IP address NATDOMAINNAME Specifies the NAT domain name NATNETMASK Specifies the NAT netmask The following arguments are available in the WHERE clause ID Specifies the ID for the target network in the XML configuration file NETWORKHOSTNAME Specifies the host name for an network object not the machine host name NATHOSTNAME ...

Page 192: ...PLICATIONVIP or ILOM CLUSTERNAME Specifies the name of an existing cluster CLUSTERNUMBER Specifies the cluster number in the XML configuration file starting at 1 CLUSTERID Specifies the cluster ID in the XML configuration file COMPUTENUMBER Specifies the number of an existing compute node in the cluster starting at 1 STORAGENUMBER Specifies the number of an existing storage cell in the cluster sta...

Page 193: ...r ADD SCAN page 3 66 ALTER SCAN page 3 67 DELETE SCAN page 3 67 LIST SCANS page 3 67 3 3 3 13 1 ADD SCAN This command adds a SCAN to the an individual cluster Syntax ADD SCAN SCANNAME scan_name SCANPORT scan_port SCANIPS scan_ip_addrs WHERE CLUSTERNAME cluster_name CLUSTERNUMBER cluster_number CLUSTERID cluster_id Arguments You can specify the following attributes for the new SCAN SCANNAME Specifi...

Page 194: ...name of the cluster CLUSTERNUMBER Specifies the cluster number in the XML configuration file starting at 1 CLUSTERID Specifies the ID of the cluster in the XML configuration file 3 3 3 13 3 DELETE SCAN This command removes a SCAN for an individual cluster Syntax DELETE SCAN WHERE CLUSTERNAME cluster_name CLUSTERNUMBER cluster_number CLUSTERID cluster_id Arguments The following arguments are availa...

Page 195: ...the XML configuration file 3 3 3 14 SWITCH You can alter or list the switches ALTER SWITCH page 3 68 LIST SWITCHES page 3 69 3 3 3 14 1 ALTER SWITCH This command alters attributes of an individual switch Syntax ALTER SWITCH DNSSERVERS dns_servers NTPSERVERS ntp_servers TIMEZONE timezone WHERE ID switch_id HOSTNAME switch_name Arguments You can modify the following attributes for a switch DNSSERVER...

Page 196: ...or list the VIPs for the clusters ADD VIP page 3 69 ALTER VIP page 3 70 DELETE VIP page 3 70 LIST VIPS page 3 71 3 3 3 15 1 ADD VIP This command adds a VIP for an individual node in a cluster Purpose This command does not add additional VIPs You should only use this command after previously issuing a DELETE VIP command Syntax ADD VIP NAME vip_name DOMAINNAME domain_name IP vip_ip_addr WHERE HOSTNA...

Page 197: ...addr WHERE HOSTNAME hostname CLUSTERNAME cluster_name COMPUTENUMBER compute_number CLUSTERNUMBER cluster_number COMPUTENUMBER compute_number CLUSTERID cluster_id COMPUTENUMBER compute_number Arguments You can modify the following attributes for the VIP NAME Specifies the short DNS name for the VIP DOMAINNAME Specifies the domain name for the VIP IP Specifies the IP address for the VIP The followin...

Page 198: ...lists the VIPs for all clusters or for an individual node in a cluster Syntax LIST VIPS WHERE HOSTNAME hostname CLUSTERNAME cluster_name COMPUTENUMBER compute_number CLUSTERNUMBER cluster_number COMPUTENUMBER compute_number CLUSTERID cluster_id COMPUTENUMBER compute_number Arguments The following arguments are available in the WHERE clause ID Specifies the ID for the VIP in the XML configuration f...

Page 199: ... air with high salt concentrations Do not install Oracle Exadata Rack in a location that is exposed to frequent vibrations Install Oracle Exadata Rack on a flat level surface Use a power outlet that uses proper grounding When using shared grounding the grounding resistance must not be greater than 10 ohms Ensure that your facility administrator or a qualified electrical engineer verifies the groun...

Page 200: ...racle Exadata Rack contains high voltage parts If a metal object or other electrically conductive object enters an opening in Oracle Exadata Rack then it could cause a short circuit This could result in personal injury fire electric shock and equipment damage When using single phase power distribution units PDUs note the following PDU A input 0 and PDU B input 2 must be on the same phase PDU A inp...

Page 201: ...w T30 Torx cranked wrench key T25 Torx cranked wrench key 6 mm hexagon Allen wrench key SW 12 mm single headed wrench 2 square jumper brackets with 4 M5 Torx screws 2 cable management hooks with 4 spring nuts Side panel removal tool Keys to the front door rear door and side panel locks 32 M6 cage nuts 32 M6 screws Cage nut mounting tool Chapter 4 Unpacking Oracle Exadata Rack 4 3 ...

Page 202: ...the labels on the carton and to the instructions that they provide a Remove the shipping carton bands b Remove the yellow fasteners and carton top c Remove the carton sides and inner top WARNING Rocking or tilting the rack can cause the rack to fall over and cause serious injury or death 2 Remove the shipping kit 3 Attach the ramps to the shipping pallet as follows a Remove the ramps from the pall...

Page 203: ...com cd E19657 01 html E29153 index html Oracle Rack Cabinet 1242 User s Guide at http docs oracle com cd E85660_01 html E87280 index html for X7 systems 4 3 Placing Oracle Exadata Rack in Its Allocated Space This section describes how to position stabilize and ground Oracle Exadata Rack 4 3 1 Moving Oracle Exadata Rack The following procedure describes how to move Oracle Exadata Rack 1 Ensure the ...

Page 204: ... smooth transport WARNING Never attempt to move Oracle Exadata Rack by pushing on the side panels Pushing on the side panels can tip the rack over This can cause serious personal injury or death as well as damage to the equipment Never tip or rock Oracle Exadata Rack because the rack can fall over 4 3 2 Stabilizing Oracle Exadata Rack After moving Oracle Exadata Rack to the installation site stabi...

Page 205: ...e Exadata Rack Figure 4 3 Location of Leveling Feet on Oracle Exadata Rack 1 Distance from the edge of the mounting feet to the side of the rack is 33 75 mm 1 33 inches 2 Width from the outside edges of the leveling feet is 532 5 mm 20 96 inches 3 Width from the inside edges of the leveling feet is 429 mm 16 89 inches 4 Distance from the edge of the feet to the front rack surface is 73 75 m 2 90 i...

Page 206: ...acle Exadata Rack Using the Leveling Feet 4 3 2 2 Stabilize Oracle Exadata Rack X7 with Leveling Feet The rack contains four leveling feet that can be lowered to stabilize the rack The leveling feet can be used even when the rack is permanently secured to the floor The four leveling feet share the load with the casters This increases the footprint of the rack which improves stability and helps pre...

Page 207: ...epth between the front and rear casters is 889 mm 35 0 inches 8 Distance between the center of the front casters and the Front door surface is 166 mm 6 5 inches 9 Width from the outside edges of the leveling feet is 583 mm 23 0 inches 10 Width from the inside edges of the leveling feet is 513 mm 20 2 inches 11 Distance from the edge of the mounting feet to the side of the rack is 8 5 mm 0 3 inches...

Page 208: ...nd the ground cable must reference a common earth ground If they do not then a difference in ground potential can be introduced If you are unsure of your facility s PDU receptacle grounding then do not install a ground cable until you confirm that there is a proper PDU receptacle grounding If a difference in ground potential is apparent then you must take corrective action Note A grounding cable i...

Page 209: ...Oracle Exadata Rack will be connected to another Oracle Exadata Rack 4 4 Acclimating Oracle Exadata Database Machine Oracle recommends an acclimation period of 24 hours for Oracle Exadata Database Machine This applies to all hardware including racks and cables Acclimation to the surrounding environment prevents damage as a result of condensation 4 5 Powering on the System the First Time Before pow...

Page 210: ...pics Ventilation and Cooling Requirements page 1 45 Always provide adequate space in front and behind the rack to allow for proper ventilation 4 5 2 Connecting Power Cords The following procedure describes how to connect power cords to Oracle Exadata Rack 1 Open the rear cabinet door 2 Ensure that the correct power connectors have been supplied 3 Unfasten the power cord cable ties The ties are for...

Page 211: ...o start through the normal BIOS POST tests 1 Switch on the PDU B circuit breakers one at a time PDU B is on the right side of the rack when viewed from the rear The circuit breakers are on the rear of the Oracle Exadata Rack cabinet as shown in the following figure Press the ON side of the toggle switch When the breaker is in the ON position the breakers are flush with the side of the PDU Chapter ...

Page 212: ...DU B 3 Connect power to PDU A Ensure the breaker switches are in the OFF position before connecting the power cables 4 Switch on the PDU A circuit breakers one at a time 5 Verify the expected LEDs are on 6 Perform a visual check of all cable connections in the rack Do not press every connector to verify connection 7 Verify the OK LED is blinking standby for all systems The OK LED blinks on for 0 1...

Page 213: ...tabase Machine Setup Configuration Best Practices My Oracle Support Doc ID 1274318 1 5 1 Configuring Sun Datacenter InfiniBand Switch 36 Switch The following procedure describes how to configure the Sun Datacenter InfiniBand Switch 36 switches 1 Log in to the first database server as the root user The first database server is the lowest database server in the rack which is rack position U16 Note I...

Page 214: ...ualified and non fully qualified names 7 Use the ILOM interface to configure the IP address host name NTP servers and DNS servers 8 Restart the switch 9 Examine the firmware version using the following command version Refer to My Oracle Support Note 888828 1 for the current firmware version 10 Check the health of the switch using the following command showunhealthy OK No unhealthy sensors 11 Run t...

Page 215: ...A 07 2B inet addr 172 16 10 32 Bcast 172 16 10 255 Mask 255 255 255 0 inet6 addr fe80 2e0 3a00 fe2a 61e 64 Scope Link UP BROADCAST RUNNING MULTICAST MTU 1500 Metric 1 RX packets 11927 errors 0 dropped 0 overruns 0 frame 0 TX packets 89 errors 0 dropped 0 overruns 0 carrier 0 collisions 0 txqueuelen 1000 RX bytes 720262 703 3 KiB TX bytes 11402 11 1 KiB 14 Verify the host name is correct using the ...

Page 216: ...xadata Database Machine Two Socket Systems X3 2 and later rack unit 20 U20 and rack unit 22 U22 Oracle Exadata Database Machine X2 2 racks rack unit 20 U20 and rack unit 24 U24 Oracle Exadata Database Machine Eight Socket Systems X2 8 and later Full Racks Rack unit 21 U21 and rack unit 23 U23 The spine switch is the Subnet Manager Master for the InfiniBand subnet The Subnet Manager Master has prio...

Page 217: ...rrent location of the Subnet Manager Master 2 Log in as the root user on the leaf switch that is the Subnet Manager Master 3 Disable Subnet Manager on the switch The Subnet Manager Master relocates to another switch 4 Use the getmaster command to identify the current location of the Subnet Manager Master If the spine switch is not Subnet Manager Master then repeat steps 2 page 5 5 and 3 page 5 5 u...

Page 218: ...isco Catalyst 4948 Ethernet switch supplied with Oracle Exadata Rack is minimally configured during installation The minimal configuration disables IP routing and sets the following Host name IP address setup Subnet mask Default gateway Domain name Name server NTP server Time Time zone Before configuring the switch note the following The Cisco Ethernet switch should not be connected until the runn...

Page 219: ... parity 1 stop bit and no handshake Switch con0 is now available Press RETURN to get started 3 Change to the enable mode Switch enable Password Switch Note If you do not have the password then contact Oracle Support Services 4 Check the current version on the swtich Switch show version Cisco IOS Software Catalyst 4500 L3 Switch Software cat4500e IPBASEK9 M Version 15 2 3 E2 RELEASE SOFTWARE fc1 Te...

Page 220: ...ault and configure the default gateway Switch configure terminal Enter configuration commands one per line End with CNTL Z Switch config ip route 0 0 0 0 0 0 0 0 10 7 7 1 Switch config end Sep 15 14 13 26 013 SYS 5 CONFIG_I Configured from console by console Switch write memory Building configuration Compressed configuration from 2502 bytes to 1085 bytes OK 7 Set the host name of the switch Switch...

Page 221: ...e 16 until password is set exa1sw ip config end If the login command returns output as shown above then telnet access has been disabled If instead you get a prompt then disable telnet access exa1sw ip config line no password exa1sw ip config line end exa1sw ip write memory Building configuration Compressed configuration from 3786 bytes to 1468 bytes OK 11 Optional Configure SSH access on the Cisco...

Page 222: ...mmer time is disabled by default To set summer time hours use the following command clock summer time zone recurring week day monthhh mm week day month hh mm offset In the preceding command zone is the time zone to be displayed when summer time is in effect EDT for example week is the week of the month 1 to 5 or last day is the day of the week Sunday Monday month is the month January February hh m...

Page 223: ...017 The preceding should show the NTP server synchronized to local time if the Cisco switch is connected to the network that has access to the NTP server 14 Verify the configuration using the following command exa1sw ip show running config Building configuration Current configuration 3923 bytes Last configuration change at 02 40 49 GMT Wed Nov 12 2014 version 15 2 no service pad service timestamps...

Page 224: ... 1 spanning tree portfast interface GigabitEthernet1 2 spanning tree portfast interface GigabitEthernet1 48 media type rj45 interface Vlan1 ip address 10 7 7 34 255 255 255 0 interface Vlan48 no ip address shutdown ip default gateway 10 7 7 1 ip http server control plane line con 0 stopbits 1 line vty 0 4 password welcome1 transport input ssh line vty 5 15 password welcome1 transport input ssh ntp...

Page 225: ...onnected to the management network at this stage The switch will be connected later after Oracle has configured the systems with the necessary IP addresses and you have worked with the field service engineer to make any additional changes necessary for connecting to the network 18 To check the Cisco swtich attach a laptop computer to port 48 and ping the IP address of the Exadata internal manageme...

Page 226: ...e network administrator 1 Connect from the Cisco switch serial console to a laptop or similar device using the available RJ45 cable 2 Ensure the terminal session is recorded on the laptop by logging the output The output can be used as a reference that the switch has been configured correctly The default serial port speed is 9600 baud 8 bits no parity 1 stop bit and no handshake 3 Power on the swi...

Page 227: ... devices promptly with your supplier Failure to register may affect response times for initial service calls Nexus9000 devices must be registered to receive entitled support services Press Enter at anytime to skip a dialog Use ctrl c at anytime to skip the remaining dialogs Would you like to enter the basic configuration dialog yes no yes 9 In the basic configuration you can use the default inputs...

Page 228: ...face layer L3 L2 L2 Configure default switchport interface state shut noshut noshut Configure CoPP system profile strict moderate lenient dense strict lenient 18 After reviewing the configuration save the configuration The following configuration will be applied no password strength check switchname test123sw adm0 Would you like to edit the configuration yes no n Use this configuration and save it...

Page 229: ...by the switch 1 Login in as the admin user 2 View the current time test123sw adm0 config show clock 20 44 52 986 UTC Thu Aug 31 2017 Time source is NTP 3 Set the timezone appropriately test123sw adm0 config clock timezone PST 8 0 4 View the modified time test123sw adm0 config show clock 12 46 22 692 PST Thu Aug 31 2017 Time source is NTP 5 Save the configuration test123sw adm0 copy running config ...

Page 230: ...and interface is the network interface determined in step 3 c page 5 18 e Using the following command to assign an IPv4 address and netmask to the interface ifconfig interface IPv4_address netmask netmask broadcast broadcast up In the preceding command interface is the network interface IPv4_address is the IP address netmask is the netmask address and broadcast is the broadcast address Note The ne...

Page 231: ...g the network 9 Confirm the DHCP Enable check box is not selected 10 Enter the following network settings for the PDU metering unit IP address Subnet mask address Default gateway 11 Click Submit to set the network settings and reset the PDU metering unit 12 Disconnect the PDU and laptop from the Cisco switch 13 Reconnect the two cables that were originally connected to the Cisco switch 14 Connect ...

Page 232: ... with Oracle Exadata Database Machine X5 2 Oracle Exadata Configuration Assistant OECA is the only source for PDU thresholds OECA is available on Oracle Technology Network at http www oracle com technetwork database exadata oeca download 2817713 html If for some reason you are unable to utilize OECA contact Oracle Support 5 3 1 2 PDU Thresholds for Oracle Exadata Database Machine X4 2 This section...

Page 233: ...2 Full Rack with Single phase Low voltage PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A Module 1 phase 1 0 20 24 A Module 1 phase 2 0 17 22 A Module 1 phase 3 0 19 24 B Module 1 phase 1 0 19 24 B Module 1 phase 2 0 17 22 B Module 1 phase 3 0 20 24 Table 5 2 page 5 21 lists the threshold values for Oracle Exadata Database Machine X4 2 Full Rack using a three phase ...

Page 234: ... Module 1 phase 2 0 18 21 A and B Module 1 phase 3 0 16 21 5 3 1 2 2 PDU Thresholds for Oracle Exadata Database Machine X4 2 Half Rack The following tables list the threshold values for Oracle Exadata Database Machine X4 2 Half Rack Table 5 5 page 5 23 Threshold Values for Oracle Exadata Database Machine X4 2 Half Rack with Single phase Low voltage PDU Table 5 6 page 5 23 Threshold Values for Orac...

Page 235: ...or Oracle Exadata Database Machine X4 2 Half Rack with Three phase Low voltage PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A and B Module 1 phase 1 0 17 22 A and B Module 1 phase 2 0 19 24 A and B Module 1 phase 3 0 15 20 Table 5 7 page 5 23 lists the threshold values for Oracle Exadata Database Machine X4 2 Half Rack using a single phase high voltage PDU Table 5 ...

Page 236: ...3 0 7 10 5 3 1 2 3 PDU Thresholds for Oracle Exadata Database Machine X4 2 Quarter Rack The following tables list the threshold values for Oracle Exadata Database Machine X4 2 Quarter Rack Table 5 9 page 5 25 Threshold Values for Oracle Exadata Database Machine X4 2 Quarter Rack with Single phase Low voltage PDU Table 5 10 page 5 25 Threshold Values for Oracle Exadata Database Machine X4 2 Quarter...

Page 237: ... Oracle Exadata Database Machine X4 2 Quarter Rack with Three phase Low voltage PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A and B Module 1 phase 1 0 11 14 A and B Module 1 phase 2 0 10 13 A and B Module 1 phase 3 0 5 7 Table 5 11 page 5 25 lists the threshold values for Oracle Exadata Database Machine X4 2 Quarter Rack using a single phase high voltage PDU Table...

Page 238: ... Exadata Database Machine X3 2 This section contains the PDU thresholds for Oracle Exadata Database Machine X3 2 Note The values listed here are reliable for use on systems in the configuration received upon deployment and delivery from the Oracle Factory Any changes to this configuration should be modeled in Oracle Exadata Configuration Assistant OECA and the PDU thresholds listed in OECA should ...

Page 239: ... Module 1 phase 1 0 20 24 A Module 1 phase 2 0 14 18 A Module 1 phase 3 0 19 24 B Module 1 phase 1 0 19 24 B Module 1 phase 2 0 14 18 B Module 1 phase 3 0 20 24 Table 5 14 page 5 27 lists the threshold values for Oracle Exadata Database Machine X3 2 Full Rack using a three phase low voltage PDU Table 5 14 Threshold Values for Oracle Exadata Database Machine X3 2 Full Rack with Three phase Low volt...

Page 240: ...Module 1 phase 2 0 17 21 A and B Module 1 phase 3 0 15 19 5 3 1 3 2 PDU Thresholds for Oracle Exadata Database Machine X3 2 Half Rack The following tables list the threshold values for Oracle Exadata Database Machine X3 2 Half Rack Table 5 17 page 5 29 Threshold Values for Oracle Exadata Database Machine X3 2 Half Rack with Single phase Low voltage PDU Table 5 18 page 5 29 Threshold Values for Ora...

Page 241: ...Oracle Exadata Database Machine X3 2 Half Rack with Three phase Low voltage PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A and B Module 1 phase 1 0 16 21 A and B Module 1 phase 2 0 19 24 A and B Module 1 phase 3 0 14 18 Table 5 19 page 5 29 lists the threshold values for Oracle Exadata Database Machine X3 2 Half Rack using a single phase high voltage PDU Table 5 19...

Page 242: ... 0 6 8 5 3 1 3 3 PDU Thresholds for Oracle Exadata Database Machine X3 2 Quarter Rack The following tables list the threshold values for Oracle Exadata Database Machine X3 2 Quarter Rack Table 5 21 page 5 31 Threshold Values for Oracle Exadata Database Machine X3 2 Quarter Rack with Single phase Low voltage PDU Table 5 22 page 5 31 Threshold Values for Oracle Exadata Database Machine X3 2 Quarter ...

Page 243: ...Oracle Exadata Database Machine X3 2 Quarter Rack with Three phase Low voltage PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A and B Module 1 phase 1 0 11 14 A and B Module 1 phase 2 0 10 13 A and B Module 1 phase 3 0 4 6 Table 5 23 page 5 31 lists the threshold values for Oracle Exadata Database Machine X3 2 Quarter Rack using a single phase high voltage PDU Table ...

Page 244: ...ule 1 phase 3 0 3 4 5 3 1 4 PDU Thresholds for Oracle Exadata Database Machine X2 2 with X4170 M2 and X4270 M2 servers This section contains the PDU thresholds for Oracle Exadata Database Machine X2 2 with X4170 M2 and X4270 M2 servers Note The values listed here are reliable for use on systems in the configuration received upon deployment and delivery from the Oracle Factory Any changes to this c...

Page 245: ... using a single phase low voltage PDU Table 5 25 Threshold Values for Oracle Exadata Database Machine X2 2 with X4170 M2 and X4270 M2 servers Full Rack with Single phase Low voltage PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A Module 1 phase 1 0 18 23 A Module 1 phase 2 0 22 24 A Module 1 phase 3 0 18 23 B Module 1 phase 1 0 18 23 B Module 1 phase 2 0 22 24 B Mod...

Page 246: ...lues for Oracle Exadata Database Machine X2 2 with X4170 M2 and X4270 M2 servers Full Rack with Three phase High voltage PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A and B Module 1 phase 1 0 18 21 A and B Module 1 phase 2 0 18 21 A and B Module 1 phase 3 0 17 21 5 3 1 4 2 PDU Thresholds for Oracle Exadata Database Machine X2 2 with X4170 M2 and X4270 M2 servers H...

Page 247: ... Pre Warning Threshold Alarm Threshold A Module 1 phase 1 0 18 23 A Module 1 phase 2 0 13 17 A Module 1 phase 3 0 0 0 B Module 1 phase 1 0 0 0 B Module 1 phase 2 0 13 17 B Module 1 phase 3 0 18 23 Table 5 30 page 5 35 lists the threshold values for Oracle Exadata Database Machine Half Rack using a three phase low voltage PDU Table 5 30 Threshold Values for Oracle Exadata Database Machine X2 2 with...

Page 248: ...eshold Pre Warning Threshold Alarm Threshold A and B Module 1 phase 1 0 9 12 A and B Module 1 phase 2 0 9 12 A and B Module 1 phase 3 0 10 13 5 3 1 4 3 PDU Thresholds for Oracle Exadata Database Machine X2 2 with X4170 M2 and X4270 M2 servers Quarter Rack The following tables list the threshold values for Oracle Exadata Database Machine Quarter Rack Table 5 33 page 5 37 Threshold Values for Oracle...

Page 249: ...phase 2 0 6 8 A Module 1 phase 3 0 0 0 B Module 1 phase 1 0 0 0 B Module 1 phase 2 0 6 8 B Module 1 phase 3 0 10 13 Table 5 34 page 5 37 lists the threshold values for Oracle Exadata Database Machine Quarter Rack using a three phase low voltage PDU Table 5 34 Threshold Values for Oracle Exadata Database Machine X2 2 with X4170 M2 and X4270 M2 servers Quarter Rack with Three phase Low voltage PDU P...

Page 250: ... Database Machine Quarter Rack using a three phase high voltage PDU Table 5 36 Threshold Values for Oracle Exadata Database Machine X2 2 with X4170 M2 and X4270 M2 servers Quarter Rack with Three phase High voltage PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A and B Module 1 phase 1 0 9 12 A and B Module 1 phase 2 0 3 4 A and B Module 1 phase 3 0 4 5 5 3 1 5 PDU T...

Page 251: ...r Oracle Exadata Database Machine X2 2 with X4170 and X4275 servers Full Rack with Three phase Low voltage PDU Table 5 39 page 5 40 Threshold Values for Oracle Exadata Database Machine X2 2 with X4170 and X4275 servers Full Rack with Single phase High voltage PDU Table 5 40 page 5 40 Threshold Values for Oracle Exadata Database Machine X2 2 with X4170 and X4275 servers Full Rack with Three phase H...

Page 252: ...base Machine X2 2 with X4170 and X4275 servers Full Rack with Single phase High voltage PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A Module 1 phase 1 0 20 21 A Module 1 phase 2 0 20 21 A Module 1 phase 3 0 19 21 B Module 1 phase 1 0 19 21 B Module 1 phase 2 0 20 21 B Module 1 phase 3 0 20 21 Table 5 40 page 5 40 lists the threshold values for Oracle Exadata Datab...

Page 253: ... with Three phase High voltage PDU Table 5 41 page 5 41 lists the threshold values for Oracle Exadata Database Machine Half Rack using a single phase low voltage PDU Table 5 41 Threshold Values for Oracle Exadata Database Machine X2 2 with X4170 and X4275 servers Half Rack with Single phase Low voltage PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A Module 1 phase 1...

Page 254: ...gh voltage PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A Module 1 phase 1 0 19 21 A Module 1 phase 2 0 12 15 A Module 1 phase 3 0 0 0 B Module 1 phase 1 0 0 0 B Module 1 phase 2 0 12 15 B Module 1 phase 3 0 19 21 Table 5 44 page 5 42 lists the threshold values for Oracle Exadata Database Machine Half Rack using a three phase high voltage PDU Table 5 44 Threshold V...

Page 255: ...ltage PDU Table 5 48 page 5 44 Threshold Values for Oracle Exadata Database Machine X2 2 with X4170 and X4275 servers Quarter Rack with Three phase High voltage PDU Table 5 45 page 5 43 lists the threshold values for Oracle Exadata Database Machine Quarter Rack using a single phase low voltage PDU Table 5 45 Threshold Values for Oracle Exadata Database Machine X2 2 with X4170 and X4275 servers Qua...

Page 256: ...th Single phase High voltage PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A Module 1 phase 1 0 11 14 A Module 1 phase 2 0 5 7 A Module 1 phase 3 0 0 0 B Module 1 phase 1 0 0 0 B Module 1 phase 2 0 5 7 B Module 1 phase 3 0 11 14 Table 5 48 page 5 44 lists the threshold values for Oracle Exadata Database Machine Quarter Rack using a three phase high voltage PDU Table...

Page 257: ...d Values for Oracle Exadata Database Machine X3 8 Full Rack with Three phase Low voltage 24 kVA PDU Table 5 51 page 5 46 Threshold Values for Oracle Exadata Database Machine X3 8 Full Rack with Single phase High voltage 22 kVA PDU Table 5 52 page 5 47 Threshold Values for Oracle Exadata Database Machine X3 8 Full Rack with Three phase High voltage 24 kVA PDU Table 5 49 page 5 45 lists the threshol...

Page 258: ...ase 2 0 23 30 B Module 2 phase 3 0 22 28 Table 5 51 page 5 46 lists the threshold values for Oracle Exadata Database Machine X3 8 Full Rack using a single phase high voltage 22 kVA PDU Table 5 51 Threshold Values for Oracle Exadata Database Machine X3 8 Full Rack with Single phase High voltage 22 kVA PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A and B Module 1 pha...

Page 259: ...tion contains the PDU thresholds for Oracle Exadata Database Machine X2 8 Full Rack Table 5 53 page 5 48 Threshold Values for Oracle Exadata Database Machine X2 8 Full Rack with Single phase Low voltage 22 kVA PDU Table 5 54 page 5 48 Threshold Values for Oracle Exadata Database Machine X2 8 Full Rack with Three phase Low voltage 24 kVA PDU Table 5 55 page 5 48 Threshold Values for Oracle Exadata ...

Page 260: ...ata Database Machine X2 8 Full Rack with Three phase Low voltage 24 kVA PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A and B Module 1 phase 1 0 32 40 A and B Module 1 phase 2 0 34 43 A and B Module 1 phase 3 0 33 42 Table 5 55 page 5 48 lists the threshold values for Oracle Exadata Database Machine X2 8 Full Rack using a single phase high voltage 22 kVA PDU Table 5...

Page 261: ...ues for Oracle Exadata Storage Expansion Full Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers Full Rack Table 5 57 page 5 50 Threshold Values for Oracle Exadata Storage Expansion Full Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers with Single phase Low voltage PDU Table 5 58 page 5 50 Threshold Values for Oracle Exadata Storage Expansion Full Rack with Exadata Stor...

Page 262: ... Oracle Exadata Storage Expansion Full Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three phase Low voltage PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A and B Module 1 phase 1 0 32 40 A and B Module 1 phase 2 0 34 43 A and B Module 1 phase 3 0 33 42 Table 5 59 page 5 50 lists the threshold values for Oracle Exadata Storage Expansion Full R...

Page 263: ...eshold Alarm Threshold A and B Module 1 phase 1 0 18 21 A and B Module 1 phase 2 0 18 21 A and B Module 1 phase 3 0 17 21 5 3 1 9 2 PDU Thresholds for Oracle Exadata Storage Expansion Half Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers The following tables list the threshold values for Oracle Exadata Storage Expansion Half Rack with Exadata Storage Server with Sun Fire X4270 M2 Se...

Page 264: ...e 1 phase 3 0 0 0 B Module 1 phase 1 0 0 0 B Module 1 phase 2 0 13 17 B Module 1 phase 3 0 18 23 Table 5 62 page 5 52 lists the threshold values for Oracle Exadata Storage Expansion Half Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers using a three phase low voltage PDU Table 5 62 Threshold Values for Oracle Exadata Storage Expansion Half Rack with Exadata Storage Server with Sun F...

Page 265: ...Servers with Three phase High voltage PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A and B Module 1 phase 1 0 9 12 A and B Module 1 phase 2 0 9 12 A and B Module 1 phase 3 0 10 13 5 3 1 9 3 PDU Thresholds for Oracle Exadata Storage Expansion Quarter Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers The following tables list the threshold values for Or...

Page 266: ...arning Threshold Alarm Threshold A Module 1 phase 1 0 10 13 A Module 1 phase 2 0 6 8 A Module 1 phase 3 0 0 0 B Module 1 phase 1 0 0 0 B Module 1 phase 2 0 6 8 B Module 1 phase 3 0 10 13 Table 5 66 page 5 54 lists the threshold values for Oracle Exadata Storage Expansion Quarter Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers using a three phase low voltage PDU Table 5 66 Threshold...

Page 267: ...ues for Oracle Exadata Storage Expansion Quarter Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers using a three phase high voltage PDU Table 5 68 Threshold Values for Oracle Exadata Storage Expansion Quarter Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three phase High voltage PDU PDU Module Phase Info Low Threshold Pre Warning Threshold Alarm Threshold A and...

Page 268: ...S Properties product_serial_number 0937XFG03B Session closed Disconnected 3 Check the hardware and firmware using the following command opt oracle SupportTools CheckHWnFWProfile If output does not show success then examine the output for mismatched hardware or firmware and take steps to correct those as explained in next steps in this section 4 Verify the disks on the server are visible and online...

Page 269: ...rd with the on site spare 6 Check the rear of the rack to ensure the flash card LEDs are green all the way across These LEDs are FMOD 0 1 2 3 and SuperCAP If any LED is amber then check again after the next step If the LED is still amber after restart then reseat the card and ESM or FMOD If the problem continues then replace the card with the on site spare Note This step can be done when all syste...

Page 270: ...is correct using the following command The command checks CPU type and count component firmware and so on dcli l root g group_file opt oracle SupportTools CheckHWnFWProfile c strict tmp checkhwfw out more tmp checkhwfw out The following is an example of a check that failed 172 108 1 6 WARNING The hardware and firmware are not supported See details below DiskControllerPCIeSlotWidth Requires x8 Foun...

Page 271: ...nd must be entered as a single line 9 Log out of the system using the following command logout 10 Return to the User Interface on the KVM switch by pressing the Ctrl key on the left to return to the KVM switch and select Disconnect Session if using the KVM switch to access the server 11 Select Target Devices from Unit View and proceed to the next database server if using the KVM switch to access t...

Page 272: ...m01cel02 Disk Cache Policy Disabled If any server shows different output then identify the LUN and use the following command to reset the policy to Disabled MegaCli64 LDSetProp DisDskCache LUNn a0 In the preceding command LUNn is the LUN number such as L2 5 7 Verifying the InfiniBand Network The following procedure describes how to verify the InfiniBand network 1 Visually check all the InfiniBand ...

Page 273: ... external switches connected to each other SUCCESS Are any hosts connected to spine switch SUCCESS Check if all hosts have 2 CAs to different switches ERROR Node db01 has 1 endpoints Should be 2 Port 2 of this node is not connected to any switch fattree End Point Cabling verification failed Leaf switch check cardinality and even distribution ERROR Internal QDR Switch 0x21283a87b8a0a0 has fewer tha...

Page 274: ...12 1 2 2 0 release and patch 20131726 My Oracle Support Doc ID 2038073 1 5 8 1 Using ISO Images to Image a New System In versions prior to 12 1 2 2 0 ISO images are available as patches that you can download for bare metal imaging an Exadata system This is now the default method in 12 1 2 2 0 and above You are no longer required to build the ISO files using imagemaker Patches are available for bot...

Page 275: ...ically You will be prompted to enter IP addresses You can use a preconf csv by following the steps in Using ISO to Image a New System page 5 68 to mount the image on an NFS repository You need to place the preconf csv file in the same NFS directory 5 If you are using Oracle VM run switch_to_ovm sh on each database server The database servers will reboot For example opt oracle SupportTools switch_t...

Page 276: ...nd sector of the last partition after removing of dev sda4 partition INFO End sector of the last partition on the system device dev sda 3300035608 INFO Check for existing first boot system image EXAVMIMAGES System first boot 12 1 2 1 0 141205 2 img INFO Saving EXAVMIMAGES System first boot 12 1 2 1 0 141205 2 img in var log exadatatmp INFO First boot system image saved in var log exadatatmp System...

Page 277: ...te Databases 15 Apply Security Fixes 16 Install Exachk 17 Setup ASR Alerting 18 Create Installation Summary 19 Resecure Machine Related Topics Exadata 12 1 2 1 1 release and patch 20240049 My Oracle Support Doc ID 1959143 1 5 8 2 Using Elastic Configuration to Image a New System Elastic configuration is now the standard methodology for all new deployments and applies to Oracle Exadata X5 X5 2L and...

Page 278: ... 12 07 11 58 36 0800 INFO Set active systen device to dev VGExaDb LVDbSys3 in boot I_am_hd_boot 2014 12 07 11 58 36 0800 INFO Reboot has been initiated to switch to the DOM0 system partition 5 Run reclaimdisks sh on each database server The opt oracle SupportTools reclaimdisks sh free reclaim command reclaims disk space reserved for the deployment type not selected The command takes less than 5 mi...

Page 279: ...using 240132160 3509758999 INFO Create ocfs2 partition on dev sda3 INFO Mount ocfs2 partition on dev sda3 to EXAVMIMAGES INFO Restoring var log exadatatmp System first boot 12 1 2 1 0 141205 2 img into EXAVMIMAGES INFO Logical volume LVDbSys2 exists in volume group VGExaDb INFO Grub version in boot grub grub stage version 0 97 81 0 1 el6 INFO Grub rpm version 0 97 13 10 0 1 el5 INFO Copying usr sh...

Page 280: ...My Oracle Support Doc ID 1953915 1 5 8 3 Using ISO to Image a New System To prepare a new Exadata system for deployment using ISO perform the following steps 1 Obtain the latest Oracle Exadata Deployment Assistant OEDA 2 Run the OEDA configuration tool to generate the configuration files 3 Power on all the servers a Database nodes and cells will automatically assign to themselves unused IP address...

Page 281: ...onger necessary to use imagemaker to create the image files The relevant PXE ISO and USB image files have already been created in the patches themselves Simply download the patch containing the prebuilt image file from Oracle Software Delivery Cloud and place the downloaded ISO iso image file in the appropriate location For 12 1 2 2 0 the patch numbers can be obtained from My Oracle Support note 2...

Page 282: ...load the imagemaker kit to prepare and create the files for the USB drive This kit is available publicly on the Oracle Software Delivery Cloud edelivery oracle com site under Oracle Database Products Linux x86 64 There are separate ImageMaker files for database nodes and cells 12 After download unzip the first file called something similar to V75080 01 zip and then unzip the subsequent file as wel...

Page 283: ...29 10 47 27 2016 0 60 done estimate finish Wed Nov 29 10 47 27 2016 0 90 done estimate finish Wed Nov 29 10 47 27 2016 1 21 done estimate finish Wed Nov 29 10 47 27 2016 1 51 done estimate finish Wed Nov 29 10 47 27 2016 1 81 done estimate finish Wed Nov 29 10 47 27 2016 2 11 done estimate finish Wed Nov 29 10 47 27 2016 2 41 done estimate finish Wed Nov 29 10 47 27 2016 2 71 done estimate finish ...

Page 284: ... 5 minutes approximately Systems are imaged with disks configured with RAID5 a RAID rebuild is no longer part of the reclaimdisks sh process Do not skip this step Skipping this step results in unused space that can no longer be reclaimed by reclaimdisks sh For example opt oracle SupportTools reclaimdisks sh free reclaim Model is ORACLE SERVER X5 2 Number of LSI controllers 1 Physical disks found 4...

Page 285: ...97 81 0 1 el6 INFO Grub rpm version 0 97 13 10 0 1 el5 INFO Copying usr share grub x86_64 redhat to boot grub INFO Create filesystem on device dev sda1 INFO Tune filesystem on device dev sda1 GNU GRUB version 0 97 640K lower 3072K upper memory Minimal BASH like line editing is supported For the first word TAB lists possible command completions Anywhere else TAB lists the possible completions of a ...

Page 286: ... nodeN where N is a number 4 Run OEDA to generate the preconf csv file that you will use to image the system 5 Connect to the first database node You can do this by connecting a laptop to the ILOM serial management port 9600 8 N 1 and then connecting to the console and log in to the database node 6 Obtain the eth0 MAC address for each database node This is the fru_macaddress field from SYS MB NET0...

Page 287: ...For 12 2 1 1 0 and above kernel vmlinux version ImageName cell compute initrd initrd version ImageName cell compute img image nfsimg version ImageName cell compute tar image nfsimg version ImageName cell compute tar md5 If you are imaging version 12 1 2 2 0 and later proceed to step 13 page 5 76 For versions earlier than 12 1 2 2 0 go to step 10 page 5 75 to create the image files using ImageMaker...

Page 288: ...nos tbz Calculating md5 checksum for debugos tbz Calculating md5 checksum for dbrpms tbz Calculating md5 checksum for exaosovs tbz Calculating md5 checksum for dbovsboot tbz Calculating md5 checksum for kernelovs tbz Calculating md5 checksum for ofedovs tbz Calculating md5 checksum for commonovsos tbz Calculating md5 checksum for debugosovs tbz Calculating md5 checksum for dbovsrpms tbz Calculatin...

Page 289: ...mdisks sh For example opt oracle SupportTools reclaimdisks sh free reclaim Model is ORACLE SERVER X5 2 Number of LSI controllers 1 Physical disks found 4 252 0 252 1 252 2 252 3 Logical drives found 1 Linux logical drive 0 RAID Level for the Linux logical drive 5 Physical disks in the Linux logical drive 4 252 0 252 1 252 2 252 3 Dedicated Hot Spares for the Linux logical drive 0 Global Hot Spares...

Page 290: ...stem on device dev sda1 GNU GRUB version 0 97 640K lower 3072K upper memory Minimal BASH like line editing is supported For the first word TAB lists possible command completions Anywhere else TAB lists the possible completions of a device filename grub root hd0 0 Filesystem type is ext2fs partition type 0x83 grub setup hd0 Checking if boot grub stage1 exists no Checking if grub stage1 exists yes C...

Page 291: ...nodeN where N is a number 4 Connect to the first database node You can do this by connecting a laptop to the ILOM serial management port 9600 8 N 1 and then connecting to the console and logging in to the database node 5 Obtain the eth0 MAC address for each database node This is the fru_macaddress field from SYS MB NET0 in the ILOM or use the command ip addr if logged into the console a Connect to...

Page 292: ...E txt file to copy the file and optional preconf csv file onto the USB drive a Place the computeImageMaker_12 1 2 2 0_LINUX X64_150917 x86_64 img file in a directory on a Linux server b Verify that the md5sums match f3daae6a9757d4feb4a0f4262e610945 computeImageMaker_12 1 2 2 0_LINUX X64_150917 x86_64 img c Prepare the USB drive using a command similar to the following where dev sdd is the name of ...

Page 293: ...Media sh will prompt to confirm creation of the image on the USB device For building 12 1 2 1 0 and above images the recommended makeImageMedia sh options for building USB bootable media are a For 12 1 2 1 0 up to 12 2 1 1 0 Change directory to the dl180 or dl360 directory b For 12 2 1 1 0 and above Change directory to the cell or compute directory c Make files for the USB makeImageMedia sh factor...

Page 294: ...gical drive 4 252 0 252 1 252 2 252 3 Dedicated Hot Spares for the Linux logical drive 0 Global Hot Spares 0 INFO Check for DOM0 system disk INFO Check for DOM0 with inactive Linux system disk INFO Valid DOM0 with inactive Linux system disk is detected INFO Number of partitions on the system device dev sda 4 INFO Higher partition number on the system device dev sda 4 INFO Last sector on the system...

Page 295: ...83 grub setup hd0 Checking if boot grub stage1 exists no Checking if grub stage1 exists yes Checking if grub stage2 exists yes Checking if grub e2fs_stage1_5 exists yes Running embed grub e2fs_stage1_5 hd0 failed this is not fatal Running embed grub e2fs_stage1_5 hd0 0 failed this is not fatal Running install grub stage1 hd0 grub stage2 p grub grub conf succeeded Done grub quit 18 Run ibhosts and ...

Page 296: ...ions such as ovs yes This should be used for all imaging regardless of the ultimate system configuration Oracle VM Physical etc OVS yes no This option defaults to no However it is not recommended to use this at all because it may change in the future In its place use the factory option which will override some default options There are some additional command line options which may be useful To cr...

Page 297: ... and also from a cell in cases where expansion involves adding only cell nodes Every Exadata system has a pre defined method for the cabling of nodes to the InfiniBand switch ports Therefore there is a fixed mapping from each node s location in the rack to the ports of the InfiniBand switches Assuming the rack is always populated following this map a node s rack unit location can be identified by ...

Page 298: ...o the Oracle VM when using virtualization on the rack using the following command Note that database servers will reboot during this step Note It is not possible or supported to switch between physical and Oracle VM configuration opt oracle SupportTools switch_to_ovm sh On database servers run reclaimdisks sh This is necessary in all deployment scenarios opt oracle SupportTools reclaimdisks sh fre...

Page 299: ... also return the two internal USB drives usually dev sda1 and dev sdb1 The newly inserted USB drive will be the additional device usually dev sdc1 The expected output is similar to dev sda1 dev sdb1 dev sdc1 The internal USBs can be identified by viewing mdstat grep md4 proc mdstat awk print 5 6 d Create a directory on the database server or cell using the following command mkdir mnt usb e Create ...

Page 300: ...command real_ip is the IP address to assign to the database server and real_netmask is the subnet mask to assign to the database server c Add the default route as follows route add net 0 0 0 0 netmask 0 0 0 0 gw real_gateway In the preceding command real_gateway is the default gateway to use for the database server d Copy the configuration files to the opt oracle SupportTools onecommand directory ...

Page 301: ...p sh script can be run on a server outside of Oracle Exadata Database Machine to verify network connectivity to Oracle Exadata Database Machine Copy the checkip sh file to the external system and run the command as shown in this step If the command is run from a Microsoft Windows machine then the command is checkip cmd Download the version of Oracle Exadata Deployment Assistant for the relevant pl...

Page 302: ...sticConfig sh script that runs as part of step 8 page 5 88 determines which nodes are new and assigns IP addresses accordingly When adding only storage cells you can run the applyElasticConfig sh script from a cell server rather than a database server 5 11 Loading the Configuration Information and Installing the Software Oracle Exadata Deployment Assistant loads the network settings creates the us...

Page 303: ... Server Software and Oracle Database patches See My Oracle Support note 888828 1 for details 4 Log in as the root user on the first database server Note If you do not have the password for the root user then contact Oracle Support Services 5 Copy the configuration file from the machine that was used to run Oracle Exadata Deployment Assistant to the opt oracle SupportTools onecommand directory on t...

Page 304: ...ns chosen For example the Update Nodes for Eighth Rack step is performed only if you are doing an eighth rack deployment 1 Validate Configuration File 2 Update Nodes for Eighth Rack 3 Create Virtual Machine 4 Create Users 5 Setup Cell Connectivity 6 Create Cell Disks 7 Create Grid Disks 8 Configure Alerting 9 Install Cluster Software 10 Initialize Cluster Software 11 Install Database Software 12 R...

Page 305: ...lled on the database server Follow the instructions for installing Oracle Database and Oracle ASM provided in the Oracle Database Installation Guide for your platform Note During Oracle Database installation Database Configuration Assistant DBCA release 11 2 0 1 0 does not set the COMPATIBLE parameter equal to 11 2 0 2 You must set the value on the Initialization Parameters page To fully utilize t...

Page 306: ...ion Clusters Installation Guide for Linux and UNIX 3 Apply the latest patches for Oracle Database and Oracle Exadata Storage Server Software After the cells are configured as described in Oracle Exadata System Software User s Guide and the database and Oracle ASM instances are installed the instances must be configured to use the cells as part of an Oracle ASM disk group The required configuration...

Page 307: ...le from the operating system or use the SQL Plus administration command SHOW PARAMETER if the database is running For example SQL SHOW PARAMETER SQL SHOW PARAMETER compatible If necessary set the COMPATIBLE initialization parameter in the initialization parameter file to 11 2 0 2 or later For example COMPATIBLE 11 2 0 2 The COMPATIBLE parameter cannot be changed dynamically If you change the value...

Page 308: ...g up and connecting to an Oracle ASM instance Oracle Database Reference for additional information about the ASM_DISKSTRING initialization parameter Oracle Database SQL Language Reference for additional information about the ALTER SYSTEM command 5 12 Installing Oracle Enterprise Manager Cloud Control Oracle Exadata Database Machine should be monitored using Oracle Enterprise Manager Cloud Control ...

Page 309: ... to Configure Oracle Configuration Manager for Oracle Exadata Database Machine My Oracle Support Doc ID 1319476 1 MAA Best Practices website Chapter 5 Installing Oracle Enterprise Manager Cloud Control 5 97 ...

Page 310: ...acle Exadata Storage Expansion Rack A 1 System Components Checklist Use this checklist to ensure that the system component considerations have been addressed System Components Checklist Items Yes No N A Comment Is it an Oracle Exadata Database Machine Oracle Exadata Cloud Machine or Oracle Exadata Storage Expansion Rack How many racks will be installed Is the system going to be connected to other ...

Page 311: ...witch and cables been ordered Is the rack installation an addition to an existing system If yes refer to the Oracle Exadata Database Machine Extending and Multi Rack Cabling Guide for cabling information Has the multi rack cabling service been purchased and the correct networking components been ordered Are all Oracle Exadata Database Machine racks adjacent to each other Appendix A System Componen...

Page 312: ...cle Support Services to provide and schedule the custom multi rack cabling service with the installation Will the Ethernet switch be replaced If yes has the customer arranged for the replacement switch installation Will additional equipment be attached to or installed in the rack If so ensure that the additional equipment falls within Oracle guidelines and sufficient power and cooling exist for it...

Page 313: ...he rack location been allocated and is vacant Does the floor layout meet the equipment maintenance access requirements Will the rack be positioned so that the exhaust air of one rack does not enter the air inlet of another rack Have cabinet stabilization measures been considered If the data center has a raised floor Does the raised floor satisfy the weight requirements for the new hardware Is perm...

Page 314: ... 1 28 Flooring Requirements page 1 34 Stabilize Oracle Exadata Rack with Leveling Feet page 4 7 A 3 Data Center Environment Checklist Use this checklist to ensure that the data center environment requirements have been addressed Data Center Environment Considerations Yes No N A Comment Does the computer room air conditioning meet temperature and humidity requirements Does the installation floor la...

Page 315: ...t to back airflow Is airflow adequate to prevent hot spots Can the data center continuously satisfy the environmental requirements Related Topics Temperature and Humidity Requirements page 1 44 Ventilation and Cooling Requirements page 1 45 Always provide adequate space in front and behind the rack to allow for proper ventilation General Environmental Requirements page 1 1 A 4 Access Route Checkli...

Page 316: ...1219 mm 48 inches Depth 1575 mm 62 inches Dimensions of the unpackaged rack Height 1998 mm 78 66 inches Width 600 mm with side panels 23 62 inches Depth 1200 mm 47 24 inches Are there any stairs ramps or thresholds that are of concern If yes then provide details Are all access route incline angles within the permitted range 6 degrees Is the access route free of any obstacles that would expose the ...

Page 317: ...k tines compatible with the shipping pallet If there are stairs is a loading elevator available for the equipment If an elevator is to be used Is the elevator car wide enough for the device to be carried into it Is the elevator car high enough for the device to be carried into it Does the elevator door meet the height requirement Can the elevator car handle the weight of a fully loaded rack Append...

Page 318: ...rage Expansion Rack page 1 31 Flooring Requirements page 1 34 A 5 Facility Power Checklist Use this checklist to ensure that the facility power requirements have been addressed Facility Power Considerations Yes No N A Comment Have the operating voltage and electric current requirements listed in Electrical Power Requirements page 1 34 been reviewed Will single phase low voltage or high voltage or ...

Page 319: ...uipment suitable in terms of voltage and current carrying capacities Does the power frequency meet the equipment specifications Are power outlets available for the new equipment at the designated location Will system power be delivered from two separate grids Is there a UPS to power the equipment Are the minimum required power sources available to support the power load for the new hardware Use ki...

Page 320: ...static flooring installed Is the area below the raised floor free of obstacles and blockages Related Topics Temperature and Humidity Requirements page 1 44 See Also Powering On and Off Oracle Exadata Rack in the Oracle Exadata Database Machine Maintenance Guide A 7 Logistics Checklist Use this checklist to ensure that the logistics requirements have been addressed Logistics Checklist Consideration...

Page 321: ...vide the process for Oracle to follow How many days in advance must background checks be completed Are there any additional security access issues Is computer room access available for installation personnel Are laptops allowed in the data center Are cell phones allowed in the data center Are cameras allowed in the data center Does the building have a delivery dock Is there a delivery unpacking st...

Page 322: ...ements Does the building have adequate receiving space Is the unpacking area air conditioned to avoid thermal shock for various hardware components Will sufficient moving personnel be available to transport the rack If applicable to your country Is union labor required for any part of the delivery or installation Is the site prepared for uncrating and packaging removal Package removal should take ...

Page 323: ... cardboard boxes and other packing material in the computer room since the spares are packed in cardboard boxes Is there a time constraint on dock access If yes please provide time constraints Is a tail or side lift required on the delivery carrier to unload the equipment at the delivery dock Will any special equipment be required to place the rack in the data center room Examples Stair walkers Li...

Page 324: ...configuration requirements have been addressed Network Configuration Considerations Yes No N A Comment Were any conflicts found while running the checkip sh script before connecting the network See Default IP Addresses page 2 20 for information on the script Will the required network cables be laid from the network equipment to the location where the Oracle Exadata Rack will be installed Will the ...

Page 325: ...lated Topics Understanding the Network Requirements for Oracle Exadata Database Machine page 2 1 A 9 Auto Service Request Checklist Use this checklist if you are planning to use Auto Service Request with the Oracle Exadata Database Machine Auto Service Request Considerations Yes No N A Comment Does the customer have a My Oracle Support account to register Auto Service Request Is the Oracle Support...

Page 326: ...clude the first name last name and e mail address of the contact See Also Understanding Auto Service Request in the Oracle Exadata Database Machine Maintenance Guide A 10 Reracking Checklists Reracking of Oracle Exadata Database Machine Half Rack or Oracle Exadata Database Machine Quarter Rack is allowed when the customer site requires a specialized infrastructure Use these checklists prior to rer...

Page 327: ...nsiderations Yes No N A Comment Has the customer purchased the Oracle Reracking Service Is there a cart capable of carrying the weight of the servers to move the components and associated cabling from the supplied rack to the customer supplied rack Is the target rack empty Please attach pictures of the target rack inside and outside Appendix A Reracking Checklists A 18 ...

Page 328: ...than 42 RU then the rack must be at least 30 RU tall and the customer must provide compatible PDUs to install in the target rack Is the distance between the front and rear mounting planes between the minimum of 610 mm and the maximum 915 mm 24 inches to 36 inches Is the clearance depth in the front of the front mounting plane distance to the front cabinet door at least 25 4 mm 1 inch Appendix A Re...

Page 329: ... opening and unit vertical pitch conform to ANSI EIA 310 D 1992 or IEC 60297 standards Does the target rack have RETMA rail support Note Oracle Exadata Rack requires 19 inches 483 mm for RETMA rail spacing width The minimum rack width of 600 mm 23 63 inches is recommended to accommodate the PDU and cable harnesses on the side If the rack is less than 600 mm wide then it must have additional depth ...

Page 330: ...he InfiniBand cables The side is left rear side when viewed from the front of the rack Can the target rack provide tie downs for the Ethernet wiring harness Is there sufficient space for the cable harnesses and the PDUs in the target rack Can a label with the Oracle Exadata Rack serial number be printed and attached to the target rack The following checklist is specific to the power distribution u...

Page 331: ...er PDU Can the customer provide at least 17 x 10A C13 plugs per PDU Can the customer provide a single PDU and its circuits to support the Oracle Exadata Rack power requirements in case one PDU fails Can the customer ensure power loads are evenly distributed across all circuits of a single PDU Can the customer provide appropriate power drops for the PDUs A 10 1 Recycling the Racks Use this checklis...

Page 332: ...ck If yes then the Oracle service engineer can pack the empty rack for recycling If Oracle is recycling the rack then has the customer completed the appropriate application at the Oracle Hardware Take Back Program website Related Topics Product Take Back and Recycling website Appendix A Reracking Checklists A 23 ...

Page 333: ...tection against different storage failures and corruptions Do you have a bonded network for client access Will the pre optimized and configured database be used after deployment Have you reviewed the Oracle Exadata Storage Server Software patching overview and patch testing guidelines in My Oracle Support note 1262380 1 Have you reviewed the Oracle Exadata Storage Server Software Maximum Availabil...

Page 334: ...viewed Oracle Exadata Database Machine best practices in My Oracle Support note 757552 1 Related Topics Oracle Database High Availability Overview Exadata Patching Overview and Patch Testing Guidelines My Oracle Support Doc ID 1262380 1 Oracle Maximum Availability Architecture website Oracle Exadata Database Machine exachk or HealthCheck My Oracle Support Doc ID 1070954 1 Exadata Health and Resour...

Page 335: ...co switch continued configuring default gateway 5 6 5 14 configuring host name 5 6 5 14 default port speed 5 6 setting password 5 6 5 14 client access network 2 1 CLONE CELL 3 40 CLONE GUEST 3 58 configuration files etc hosts 5 1 configuring cell alerts 3 24 database 5 93 InfiniBand interface 5 1 initialization parameter files 5 93 instances 5 93 Oracle Automatic Storage Management 5 93 PDUs 5 18 ...

Page 336: ...le Exadata Storage Expansion HC Rack 1 72 Oracle Exadata Storage Expansion Rack 1 21 1 23 1 25 1 26 L leaf switches 5 4 leveling feet 4 7 4 8 LIST ACFSVOLUME 3 39 LIST CELLS 3 41 LIST CLUSTERS 3 41 LIST DATABASEHOMES 3 57 LIST DATABASES 3 53 LIST DISKGROUPS 3 47 LIST ILOMS 3 60 LIST MACHINES 3 61 LIST NETWORKS 3 65 LIST SCANS 3 67 LIST SWITCHES 3 69 LIST VIPS 3 71 LIST XMLACTIONS 3 37 LOAD FILE 3 ...

Page 337: ... numbers 5 60 setting Cisco switch time zone 5 6 Subnet Manager Master 5 4 shipping kit 4 2 shipping weights Oracle Exadata Database Machine 1 29 Oracle Exadata Storage Expansion Rack 1 29 Small Form Factor Pluggable SFP modules 2 1 2 7 spine switches rack location 5 4 stabilizing Oracle Exadata Database Machine 4 7 stabilizing Oracle Exadata Rack 4 8 Subnet Manager Master 5 4 Support Hub 3 28 sup...