scst
|
Size: 1310
Comment:
|
Size: 1573
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| =Infiniband, SRP Target and Ubuntu Lucid= | = SCST - Infiniband, SRP Target and Ubuntu Lucid = |
| Line 5: | Line 5: |
| ==A Word of Warning== | == A Word of Warning == |
| Line 7: | Line 7: |
| Configuring, designing and implementing an Infiniband based setup is not for the faint-hearted. It will take days or even weeks to understand its quirks, bottlenecks, complexities and you'll even end up doubting yourself why you had chosen Infiniband instead of 10GB ethernet. | Configuring, designing and implementing an Infiniband based setup is not for the faint-hearted. It will take days or even weeks to understand its quirks, bottlenecks, complexities and you'll even end up doubting yourself why you had chosen Infiniband over 10GB ethernet. |
| Line 9: | Line 9: |
| ==Before we jump ahead== | == Before we jump ahead == |
| Line 13: | Line 13: |
| Ubuntu already has the most needed packages from OFED 1.4.2 ([[http://openfabrics.org|openfabrics.org]]) but sadly lacks some management and diagnostic utilities needed for an Infiniband setup. | == Where do I start? == |
| Line 15: | Line 15: |
| You may try installing Debian packages which were also built on OFED 1.4.2: [[http://pkg-ofed.alioth.debian.org/apt/ofed-1.4.2/|http://pkg-ofed.alioth.debian.org/apt/ofed-1.4.2/]] | The kernel module for your Infiniband adapter will already be loaded (mine was ib_mtcha). Now you need to install/load the corresponding Infiniband-libs and modules: |
| Line 17: | Line 17: |
| ==Where do I get the appropriate Ubuntu packages?== | "" apt-get install libibcm1 libibcommon1 libibmad1 libibumad1 libibverbs1 librdmacm1 rdmacm-utils ibverbs-utils "" |
| Line 19: | Line 19: |
| You can find patched Kernels and SCST-Admin in this PPA: | "" lsmod |grep ib_"" will show you the avalaible Infiniband kernel modules. Load any modules you need with ""modprobe ib_<name> "" == Where do I get the appropriate Ubuntu packages? == Initiator: You can find srptools and opensm in this PPA: [[https://launchpad.net/~ast/+archive/srp|https://launchpad.net/~ast/+archive/srp]] Target: You can find patched Kernels and SCST-Admin in this PPA: |
| Line 22: | Line 31: |
| ---- CategoryDocumentation |
SCST - Infiniband, SRP Target and Ubuntu Lucid
This Wiki will describe how to setup an Infiniband based SRP target on Ubuntu Lucid (10.04).
A Word of Warning
Configuring, designing and implementing an Infiniband based setup is not for the faint-hearted. It will take days or even weeks to understand its quirks, bottlenecks, complexities and you'll even end up doubting yourself why you had chosen Infiniband over 10GB ethernet.
Before we jump ahead
First of all: Check your BIOS settings! You may end up with really bad PCIe performance if not configured properly. Especially server boards tend to be configured very conservatively. "Optimized Defaults" may be your friend but your mileage may vary.
Where do I start?
The kernel module for your Infiniband adapter will already be loaded (mine was ib_mtcha). Now you need to install/load the corresponding Infiniband-libs and modules:
"" apt-get install libibcm1 libibcommon1 libibmad1 libibumad1 libibverbs1 librdmacm1 rdmacm-utils ibverbs-utils ""
"" lsmod |grep ib_"" will show you the avalaible Infiniband kernel modules. Load any modules you need with ""modprobe ib_<name> ""
Where do I get the appropriate Ubuntu packages?
Initiator: You can find srptools and opensm in this PPA:
https://launchpad.net/~ast/+archive/srp
Target: You can find patched Kernels and SCST-Admin in this PPA:
https://launchpad.net/~ast/+archive/scst
scst (last edited 2010-10-08 00:34:46 by eth2083)