D – Multi-Subnet Fabrics
Primarily Independent Subnets
D-2
D000006-000 Rev A
Q
typically with different IP subnets. Consult the
QuickSilver Fabric Access Software
Users Guide
for more information on configuring IPoIB.
NOTE:
When managing a cluster where compute nodes are not running the
QuickSilver host stack or where the IPoIB settings on the compute nodes
are incompatible with the IB Management node (e.g., when a 4K MTU is
used on the compute nodes), it is recommended not to run IPoIB on the
IB management node(s).
“Installing and Verifying Firmware on the SilverStorm IB Chassis” on page 3-6 can
be performed as per the instructions. When creating the chassis file, list all
SilverStorm 9000 series internally-managed IB switches in all subnets. If desired,
additional files may also be created per subnet that list only the SilverStorm chassis
in each subnet.
“Installing and Configuring the Subnet Manager” on page 3-9 can be performed as
per the instructions. At least one subnet manager is required per IB subnet. Consult
the
QuickSilver Fabric Manager and Fabric Viewer Users Guide
for more information
on how to configure a host SM node to manage more than one IB subnet.
“Installing and Verifying Firmware on the IB Switches” on page 3-10. At this time
this operation is not supported for IB management nodes connected to more than
one IB subnet.
“Installing InfiniBand on the Remaining Servers” on page 3-12 can be performed
as per the instructions. When creating the
hosts
file, list all of the hosts in all
subnets except the IB management node where Fast Fabric is being run. If desired,
additional files may also be created per subnet that list the hosts in each subnet
(except the IB management node).
“Verifying InfiniBand on the Remaining Servers” on page 3-16 has the following
adjustments from the instructons.
❥
(All)
: Create the
allhosts
file per the instructions. Next, create additional files
per subnet that list all the hosts in each subnet including the IB management
node.
❥
(All)
: “Verify Hosts via Ethernet ping” on page 4-4 can be performed per the
instructions.
❥
(All)
: “Summary of Fabric Components” on page 4-9 is not presently supported
for IB management nodes connected to multiple fabrics. Instead manually run:
iba_report -d 0 -h x -p y
where
x
and
y
specify the applicable HCA and port to select the desired subnet.
Repeat for each subnet.
❥
(Host)
: “Show Status of Host IB Ports” on page 4-9 may be run per the
instructions.
Summary of Contents for Fast Fabric
Page 1: ...D000006 000 Rev A Page i Q S i m p l i f y Fast Fabric Users Guide...
Page 2: ...Fast Fabric Users Guide Q Page ii D000006 000 Rev A...
Page 38: ...3 Getting Started Upgrading IB software 3 24 D000006 000 Rev A Q...
Page 148: ...6 MPI Sample Applications Pallas 6 6 D000006 000 Rev A Q...
Page 166: ...B Fast Fabric Configuration Files Port List Files B 14 D000006 000 Rev A Q...
Page 168: ...C Configuration of IPoIB Name Mapping C 2 D000006 000 Rev A Q...
