Note:
Oracle Exadata Database Machine Half Rack with Sun Fire X4170 Oracle
Database Servers include two Sun Datacenter InfiniBand Switch 36 switches,
which are set to priority 5.
To determine the Subnet Manager Master, log in as the
root
user on any InfiniBand
switch, and run the
getmaster
command. The location of the Subnet Manager Master is
displayed. The following is an example of the output from the
getmaster
command:
# getmaster
20100701 11:46:38 OpenSM Master on Switch : 0x0021283a8516a0a0 ports 36 Sun DCS 36
QDR switch dm01sw-ib1.example.com enhanced port 0 lid 1 lmc 0
The preceding output shows the proper configuration. The Subnet Master Manager is
running on spine switch
dm01sw-ib1.example.com
.
If the spine switch is not the Subnet Manager Master, then do the following procedure
to set the Subnet Manager Master:
1.
Use the
getmaster
command to identify the current location of the Subnet Manager
Master.
2.
Log in as the
root
user on the leaf switch that is the Subnet Manager Master.
3.
Disable Subnet Manager on the switch. The Subnet Manager Master relocates to
another switch.
4.
Use the
getmaster
command to identify the current location of the Subnet Manager
Master. If the spine switch is not Subnet Manager Master, then repeat steps
(page 5-5) and
(page 5-5) until the spine switch is the Subnet Manager Master.
5.
Enable Subnet Manager on the leaf switches that were disabled during this
procedure.
Note:
•
If the InfiniBand network consists of four or more racks cabled together,
then only the spine switches should run Subnet Manager. The leaf
switches should have Subnet Manager disabled on them.
•
Oracle Exadata Database Machine Half Racks with Sun Fire X4170
Oracle Database Servers, and Oracle Exadata Database Machine Quarter
Racks have two Sun Datacenter InfiniBand Switch 36 switches, and both
are set to priority 5. The master is the one with the lowest GUID.
Chapter 5
Configuring Sun Datacenter InfiniBand Switch 36 Switch
5-5