6–RoCE Configuration
Configuring RoCE on the Adapter for Linux
68
AH0054602-00 A
3.
Verify that the RoCE devices were detected by examining the dmesg logs.
#
dmesg|grep qedr
[87910.988411] qedr: discovered and registered 2 RoCE funcs
4.
Verify that all of the modules have been loaded. For example:
#
lsmod|grep qedr
qedr 89871 0
qede 96670 1 qedr
qed 2075255 2 qede,qedr
ib_core 88311 16 qedr, rdma_cm, ib_cm,
ib_sa,iw_cm,xprtrdma,ib_mad,ib_srp,
ib_ucm,ib_iser,ib_srpt,ib_umad,
ib_uverbs,rdma_ucm,ib_ipoib,ib_isert
5.
Configure the IP address and enable the port using a configuration method
such as ifconfig:
#
ifconfig ethX 192.168.10.10/24 up
6.
Issue the
ibv_devinfo
command. For each PCI function, you should see
a separate
hca_id
, as shown in the following example:
root@captain:~#
ibv_devinfo
hca_id: qedr0
transport: InfiniBand (0)
fw_ver: 8.3.9.0
node_guid: 020e:1eff:fe50:c7c0
sys_image_guid: 020e:1eff:fe50:c7c0
vendor_id: 0x1077
vendor_part_id: 5684
hw_ver: 0x0
phys_port_cnt: 1
port: 1
state: PORT_ACTIVE (1)
max_mtu: 4096 (5)
active_mtu: 1024 (3)
sm_lid: 0
port_lid: 0
port_lmc: 0x00
link_layer: Ethernet
7.
Verify the L2 and RoCE connectivity between all servers: one server acts as
a server, another acts as a client.
Verify the L2 connection using a simple
ping
command.
