scst

Differences between revisions 7 and 8
Revision 7 as of 2010-04-30 11:48:53
Size: 1776
Editor: gate1
Comment:
Revision 8 as of 2010-05-09 13:44:22
Size: 1573
Editor: brmn-4db70f7e
Comment:
Deletions are marked like this. Additions are marked like this.
Line 13: Line 13:
Ubuntu already has the most needed packages from OFED 1.4.2 ([[http://openfabrics.org|openfabrics.org]]) but sadly lacks some management and diagnostic utilities needed for an Infiniband setup.

You may try installing Debian packages which are also based on OFED 1.4.2: [[http://pkg-ofed.alioth.debian.org/apt/ofed-1.4.2/|http://pkg-ofed.alioth.debian.org/apt/ofed-1.4.2/]]
Line 19: Line 15:
The kernel module for your Infiniband adapter will already be loaded (mine was ib_mtcha). Now you need to install the corresponding Infiniband-libs: The kernel module for your Infiniband adapter will already be loaded (mine was ib_mtcha). Now you need to install/load the corresponding Infiniband-libs and modules:
Line 21: Line 17:
""apt-get install libibcm1 libibcommon1 libibmad1 libibumad1 libibverbs1 librdmacm1 rdmacm-utils ibverbs-utils"" "" apt-get install libibcm1 libibcommon1 libibmad1 libibumad1 libibverbs1 librdmacm1 rdmacm-utils ibverbs-utils ""
Line 23: Line 19:
""lsmod |grep ib_"" will show you the avalaible Infiniband kernel modules. Load any modules you need with ""modprobe ib_<name>"" "" lsmod |grep ib_"" will show you the avalaible Infiniband kernel modules. Load any modules you need with ""modprobe ib_<name> ""
Line 28: Line 24:
You can find patched Kernels and SCST-Admin in this PPA: Initiator: You can find srptools and opensm in this PPA:

[[https://launchpad.net/~ast/+archive/srp|https://launchpad.net/~ast/+archive/srp]]

Target: You can find patched Kernels and SCST-Admin in this PPA:

SCST - Infiniband, SRP Target and Ubuntu Lucid

This Wiki will describe how to setup an Infiniband based SRP target on Ubuntu Lucid (10.04).

A Word of Warning

Configuring, designing and implementing an Infiniband based setup is not for the faint-hearted. It will take days or even weeks to understand its quirks, bottlenecks, complexities and you'll even end up doubting yourself why you had chosen Infiniband over 10GB ethernet.

Before we jump ahead

First of all: Check your BIOS settings! You may end up with really bad PCIe performance if not configured properly. Especially server boards tend to be configured very conservatively. "Optimized Defaults" may be your friend but your mileage may vary.

Where do I start?

The kernel module for your Infiniband adapter will already be loaded (mine was ib_mtcha). Now you need to install/load the corresponding Infiniband-libs and modules:

"" apt-get install libibcm1 libibcommon1 libibmad1 libibumad1 libibverbs1 librdmacm1 rdmacm-utils ibverbs-utils ""

"" lsmod |grep ib_"" will show you the avalaible Infiniband kernel modules. Load any modules you need with ""modprobe ib_<name> ""

Where do I get the appropriate Ubuntu packages?

Initiator: You can find srptools and opensm in this PPA:

https://launchpad.net/~ast/+archive/srp

Target: You can find patched Kernels and SCST-Admin in this PPA:

https://launchpad.net/~ast/+archive/scst


CategoryDocumentation

scst (last edited 2010-10-08 00:34:46 by eth2083)