Skip to content

Using RDMA in Deployments

This chapter mainly introduces how to configure and use RDMA resources in deployments. DCE 5.0 provides three methods for RDMA passthrough. See RDMA Usage Comparison for details.

Note

This chapter is based on the example of using RoCE NICs with SR-IOV. To facilitate RDMA testing, the configured image should be docker.io/mellanox/rping-test, and the sh command should be run to prevent the pod from exiting abnormally during the operation. Please refer to the following content for details.

Prerequisites

UI Operations

  1. Log in to the platform UI, click Container Management -> Clusters in the left navigation bar, find the proper cluster. Then, select Deployments in the left navigation bar and click Create By Image .

    Create By Image

  2. On the Create Deployments page, use the image docker.io/mellanox/rping-test. Set Replica to 2 to deploy a group of cross-node Pods.

  3. Fill in the Basic Information and enter the following information in the Container Settings .

    rdma_sriov

    • Network Resource Parameters:

      The spidernet.io/mellnoxrdma in the example is an example of using RoCE NICs based on SR-IOV . The request and limit values are currently consistent, and the input value should not exceed the maximum available value.

    • Run Command: To prevent the pod from starting and exiting abnormally, add the following run command:

      - sh
      - -c
      - |
        ls -l /dev/infiniband /sys/class/net
        sleep 1000000
      
  4. After completing the information input on the Container Settings -> Service Settings pages, proceed to Advanced Settings and click to configure the Container NICs .

    Container NICs

  5. Select the created Multus CR, turn off the fixed IPPool creation function, select the created IPPool, and click OK to complete the creation.

    rdma_usage01

Comments