background image

Task

Document Title

Description

Installing hardware

Intel

®

 Omni-Path Fabric Switches

Hardware Installation Guide

Describes the hardware installation and initial configuration

tasks for the Intel

®

 Omni-Path Switches 100 Series. This

includes: Intel

®

 Omni-Path Edge Switches 100 Series, 24 and

48-port configurable Edge switches, and Intel

®

 Omni-Path

Director Class Switches 100 Series.

Intel

®

 Omni-Path Host Fabric Interface

Installation Guide

Contains instructions for installing the HFI in an Intel

®

 OPA

cluster.

Installing host

software
Installing HFI

firmware
Installing switch

firmware (externally-

managed switches)

Intel

®

 Omni-Path Fabric Software

Installation Guide

Describes using a Text-based User Interface (TUI) to guide

you through the installation process. You have the option of

using command line interface (CLI) commands to perform the

installation or install using the Linux* distribution software.

Managing a switch

using Chassis Viewer

GUI
Installing switch

firmware (managed

switches)

Intel

®

 Omni-Path Fabric Switches GUI

User Guide

Describes the graphical user interface (GUI) of the Intel

®

Omni-Path Fabric Chassis Viewer GUI. This document

provides task-oriented procedures for configuring and

managing the Intel

®

 Omni-Path Switch family.

Help: GUI embedded help files

Managing a switch

using the CLI
Installing switch

firmware (managed

switches)

Intel

®

 Omni-Path Fabric Switches

Command Line Interface Reference

Guide

Describes the command line interface (CLI) task information

for the Intel

®

 Omni-Path Switch family.

Help: -help for each CLI

Managing a fabric

using FastFabric

Intel

®

 Omni-Path Fabric Suite

FastFabric User Guide

Provides instructions for using the set of fabric management

tools designed to simplify and optimize common fabric

management tasks. The management tools consist of Text-

based User Interface (TUI) menus and command line

interface (CLI) commands.
Help: -help and man pages for each CLI. Also, all host CLI

commands can be accessed as console help in the Fabric

Manager GUI.

Managing a fabric

using Fabric Manager

Intel

®

 Omni-Path Fabric Suite Fabric

Manager User Guide

The Fabric Manager uses a well defined management protocol

to communicate with management agents in every Intel

®

Omni-Path Host Fabric Interface (HFI) and switch. Through

these interfaces the Fabric Manager is able to discover,

configure, and monitor the fabric.

Intel

®

 Omni-Path Fabric Suite Fabric

Manager GUI User Guide

Provides an intuitive, scalable dashboard and set of analysis

tools for graphically monitoring fabric status and

configuration. This document is a user-friendly alternative to

traditional command-line tools for day-to-day monitoring of

fabric health.
Help: Fabric Manager GUI embedded help files

Configuring and

administering Intel

®

HFI and IPoIB driver
Running MPI

applications on

Intel

®

 OPA

Intel

®

 Omni-Path Fabric Host Software

User Guide

Describes how to set up and administer the Host Fabric

Interface (HFI) after the software has been installed. The

audience for this document includes cluster administrators

and Message-Passing Interface (MPI) application

programmers.

Writing and running

middleware that

uses Intel

®

 OPA

Intel

®

 Performance Scaled Messaging

2 (PSM2) Programmer's Guide

Provides a reference for programmers working with the Intel

®

PSM2 Application Programming Interface (API). The

Performance Scaled Messaging 2 API (PSM2 API) is a low-

level user-level communications interface.

continued...   

Intel

®

 Omni-Path Fabric—Preface

Intel

®

 Omni-Path Host Fabric Interface

Installation Guide

April 2020

8

Doc. No.: H76466, Rev.: 8.0

Summary of Contents for Omni-Path

Page 1: ...Intel Omni Path Host Fabric Interface Installation Guide Rev 8 0 April 2020 Doc No H76466 Rev 8 0...

Page 2: ...out notice The products described may contain design defects or errors known as errata which may cause the product to deviate from published specifications Current characterized errata are available o...

Page 3: ...to Hardware Installation for HFI Without a PCI Express Riser Added a Note with a pointer to upgrading HFI firmware to Hardware Installation Checklist December 2016 4 0 Added the section Cluster Config...

Page 4: ...llation Checklist 15 3 0 Hardware Installation 16 3 1 Hardware Installation Requirements 16 3 1 1 Hardware 16 3 1 2 Cabling and Switches 16 3 2 Safety with Electricity 17 3 3 Unpacking Information 17...

Page 5: ...tel Omni Path Host Fabric Interface x16 18 3 PCIe Slot in a Typical Motherboard 20 4 Assembled PCIe Host Fabric Interface with Riser 20 Figures Intel Omni Path Fabric Intel Omni Path Host Fabric Inter...

Page 6: ...Tables 1 HFI Model and Related Platforms 16 Intel Omni Path Fabric Tables Intel Omni Path Host Fabric Interface Installation Guide April 2020 6 Doc No H76466 Rev 8 0...

Page 7: ...Path publications are available at the following URL under Latest Release Library https www intel com content www us en design products and solutions networking and io fabric products omni path downlo...

Page 8: ...set of fabric management tools designed to simplify and optimize common fabric management tasks The management tools consist of Text based User Interface TUI menus and command line interface CLI comm...

Page 9: ...Performance Administrator Using NVMe over Fabrics on Intel OPA Configuring Non Volatile Memory Express NVMe over Fabrics on Intel Omni Path Architecture Application Note Describes how to implement a s...

Page 10: ...el com Text in bold font indicates user interface elements such as menu items buttons check boxes key names key strokes or column headings For example Click the Start button point to Programs point to...

Page 11: ...use of 48 bit CRC when the peak bandwidth is not critical in the fabric Due to the improved detection of failing cables provided by 10 8 2 0 firmware it is possible that failing cables that were not p...

Page 12: ...e software until you have carefully read and agree to the terms and conditions of the license agreement s By loading or using the software you agree to the terms of the license agreement s If you do n...

Page 13: ...arget operating systems This document does not contain all the information you need to use basic Linux commands or to perform all system administration tasks For this information see the software docu...

Page 14: ...e or more managed Intel Omni Path switches Use a host based subnet manager such as the Intel Omni Path Fabric Suite Fabric Manager as a part of the Intel Omni Path Fabric Suite download Intel Omni Pat...

Page 15: ...tricity on page 17 Unpack the HFI Unpacking Information on page 17 and verify the package contents 4 Install the HFI by following the instructions in Hardware Installation on page 19 5 Cable the HFI t...

Page 16: ...s Intel Model Number Platform Plugs Into Intel Omni Path Host Fabric Interface PCI Express systems x8 PCI Express slot x16 PCI Express slot If the installation of the HFI requires the use of a riser c...

Page 17: ...imes Inserting or removing components while standby is active can damage them Use normal precautions to prevent electrostatic discharge which can damage integrated circuits Unpacking Information This...

Page 18: ...n unpacking the HFI 1 When unpacking ground yourself before removing the Intel OP HFI from the anti static bag 2 Grasping the Intel OP HFI by its face plate pull the HFI out of the anti static bag 3 3...

Page 19: ...rds Installation Steps NOTE Change the server BIOS PCIe setting to AUTO The Intel OP HFI card will train itself to PCIe GEN 3 For details on changing server BIOS refer your server vendor documentation...

Page 20: ...into your motherboard First visually line up the HFI slot connector edge with the edge connector of the PCIe riser card see the figure below Figure 4 Assembled PCIe Host Fabric Interface with Riser 9...

Page 21: ...Installation on page 22 Hardware Installation for HFI Without a PCI Express Riser NOTE If you intend to use the NVIDIA GPUDirect RDMA Linux kernel feature provided within the Intel Omni Path Fabric S...

Page 22: ...the Switch Follow the recommendations of your cable vendor for cable management and proper bend radius To install the cable s 1 Check that you have removed the protector plugs if any from the cable c...

Page 23: ...LED functions are as follows Link Down Off Link Up Initialized On solid green Link Up Active No Traffic On solid green Link Up Active Slow Packet rate 10K S BLINK 384ms On 384ms Off Link Up Active Fas...

Reviews: