Skip to content
RDMA core userspace libraries and daemons
C Roff Python C++ CMake Perl Other
Branch: master
Clone or download
Latest commit 4159490 Oct 2, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
Documentation kernel-boot: Separate PCI fill function Jul 28, 2019
buildlib cbuild: Run gpg with a home directy in the tmpdir Sep 24, 2019
ccan Add align and roundup_pow_of_two helpers May 27, 2019
debian libibumad: Support arbitrary number of IB devices Sep 10, 2019
ibacm ibacm: only open InfiniBand port Jun 19, 2019
infiniband-diags ibdiags: Support arbitrary number of IB devices in ibstat Sep 10, 2019
iwpmd treewide: Don't cast malloc() output Mar 3, 2019
kernel-boot kernel-boot: Set default prefix for RDMA devices with unknown protocol Jul 28, 2019
kernel-headers Update kernel headers Aug 29, 2019
libibmad libibmad: Flatten libibmad into one directory May 29, 2019
libibnetdisc libibnetdiscover: Flatten libibnetdiscover into one directory May 29, 2019
libibumad libibumad: Redesign resolve_ca_name to support arbitrary number of IB… Sep 10, 2019
libibverbs verbs: Fix UD pingpong default message size to match default MTU Sep 26, 2019
librdmacm rdmacm: Fix missing libraries on centos6 build Jul 22, 2019
providers mlx4: Update errno where necessary Sep 26, 2019
pyverbs pyverbs: Fix PD assignment in QPInitAttrEx Sep 26, 2019
rdma-ndd rdma-ndd: Don't emit warnings for missing device folder May 28, 2019
redhat redhat: BuildRequires python3 Sep 24, 2019
srp_daemon srp_daemon: fix a double free segment fault for ibsrpdm Sep 24, 2019
suse suse: provide libibmad-devel Sep 17, 2019
util util: Enable uninitialized_var on powerpc Jul 22, 2019
.clang-format Copy .clang-format from the kernel Sep 20, 2018
.gitignore Consolidate the .gitignore files Sep 21, 2016
.mailmap .mailmap: add Steve Wise aliases Mar 26, 2019
.travis.yml build/azp: Have Azure Pipelines create releases when tags are made Jul 23, 2019
CMakeLists.txt Merge pull request #552 from jgunthorpe/azp_update Jul 29, 2019
COPYING.BSD_FB Document copyright situation and select default license Sep 29, 2016
COPYING.BSD_MIT Document copyright situation and select default license Sep 29, 2016
COPYING.GPL2 Unified CMake build system Sep 21, 2016
COPYING.md rdma-core: Spell "daemon" correctly May 11, 2017
MAINTAINERS Adding Soft-iWarp user library Jun 20, 2019
README.md Document how to setup rxe/siw. Aug 23, 2019
build.sh build: Pass extra cmake flags Feb 4, 2018

README.md

Build Status

RDMA Core Userspace Libraries and Daemons

This is the userspace components for the Linux Kernel's drivers/infiniband subsystem. Specifically this contains the userspace libraries for the following device nodes:

  • /dev/infiniband/uverbsX (libibverbs)
  • /dev/infiniband/rdma_cm (librdmacm)
  • /dev/infiniband/umadX (libibumad)

The userspace component of the libibverbs RDMA kernel drivers are included under the providers/ directory. Support for the following Kernel RDMA drivers is included:

  • efa.ko
  • iw_cxgb3.ko
  • iw_cxgb4.ko
  • hfi1.ko
  • hns-roce.ko
  • i40iw.ko
  • ib_qib.ko
  • mlx4_ib.ko
  • mlx5_ib.ko
  • ib_mthca.ko
  • iw_nes.ko
  • ocrdma.ko
  • qedr.ko
  • rdma_rxe.ko
  • siw.ko
  • vmw_pvrdma.ko

Additional service daemons are provided for:

  • srp_daemon (ib_srp.ko)
  • iwpmd (for iwarp kernel providers)
  • ibacm (for InfiniBand communication management assistant)

Building

This project uses a cmake based build system. Quick start:

$ bash build.sh

build/bin will contain the sample programs and build/lib will contain the shared libraries. The build is configured to run all the programs 'in-place' and cannot be installed.

NOTE: It is not currently easy to run from the build directory, the plugins only load from the system path.

Debian Derived

$ apt-get install build-essential cmake gcc libudev-dev libnl-3-dev libnl-route-3-dev ninja-build pkg-config valgrind python3-dev cython3

Fedora

$ dnf install cmake gcc libnl3-devel libudev-devel pkgconfig valgrind-devel ninja-build python3-devel python3-Cython

NOTE: Fedora Core uses the name 'ninja-build' for the 'ninja' command.

openSUSE

$ zypper install cmake gcc libnl3-devel libudev-devel ninja pkg-config valgrind-devel python3-devel python3-Cython

Building on CentOS 6/7

Install required packages:

$ yum install cmake gcc libnl3-devel libudev-devel make pkgconfig valgrind-devel

Developers on CentOS 7 are suggested to install more modern tooling for the best experience.

$ yum install epel-release
$ yum install cmake3 ninja-build pandoc

NOTE: EPEL uses the name 'ninja-build' for the 'ninja' command, and 'cmake3' for the 'cmake' command.

Usage

To set up software RDMA on an existing interface with either of the available driver, use the following commands, substituting <DRIVER> with the name of the driver of your choice (rxe or siw)

# modprobe <DRIVER>
# rdma link add <NAME> type <DRIVER> netdev <DEVICE>

Please note that you need version of iproute2 recent enough is required for the command above to work.

You can use either ibv_devices or rdma link to verify that the device was successfully added.

Use of rxe_cfg is deprecated, please use the rdma command instead.

Reporting bugs

Bugs should be reported to the linux-rdma@vger.kernel.org mailing list In your bug report, please include:

  • Information about your system:

    • Linux distribution and version
    • Linux kernel and version
    • InfiniBand hardware and firmware version
    • ... any other relevant information
  • How to reproduce the bug.

  • If the bug is a crash, the exact output printed out when the crash occurred, including any kernel messages produced.

Submitting patches

Patches should also be submitted to the linux-rdma@vger.kernel.org mailing list. Please use unified diff form (the -u option to GNU diff), and include a good description of what your patch does and why it should be applied. If your patch fixes a bug, please make sure to describe the bug and how your fix works.

Make sure that your contribution can be licensed under the same license as the original code you are patching, and that you have all necessary permissions to release your work.

TravisCI

Submitted patches must pass the TravisCI automatic builds without warnings. A build similar to TravisCI can be run locally using docker and the 'buildlib/cbuild' script.

$ buildlib/cbuild build-images travis
$ buildlib/cbuild pkg travis
You can’t perform that action at this time.