Skip to main content

Cabling disk shelves with IOM12 modules for a hot-add

You cable the SAS connections, shelf-to-shelf and controller-to-stack, as applicable for hot-added disk shelves so they have connectivity to the system.

Before you begin

You must have met the requirements in the Requirements for a hot-adding disk shelves with IOM12 modules section and installed, powered on, and set shelf IDs for each disk shelf as instructed in the Installing disk shelves with IOM12 modules for a hot-add section.

About this task

  • For an explanation and examples of shelf-to-shelf standard cabling and shelf-to-shelf double-wide cabling, see the Shelf-to-shelf SAS connection rules section.
  • Instructions about how to read a worksheet to cable controller-to-stack connections can be found towards the back of this guide.
  • After you have cabled the hot-added disk shelves, ONTAP recognizes them: disk ownership is assigned if disk ownership automatic assignment is enabled; disk shelf (IOM) firmware and disk drive firmware should automatically update if needed; and if in-band ACP is enabled on your configuration, it is automatically enabled on the hot-added disk shelves.
    Note
    Firmware updates can take up to 30 minutes.
  1. If you want to manually assign disk ownership for the disk shelves you are hot-adding, you need to disable disk ownership automatic assignment if it is enabled; otherwise, go to the next step.
    You need to manually assign disk ownership if disks in the stack are owned by both controllers in an HA pair.

    You disable disk ownership automatic assignment before cabling the hot-added disk shelves and then later, in step 7, you reenable it after cabling the hot-added disk shelves.

    1. Verify if disk ownership automatic assignment is enabled: storage disk option show

      If you have an HA pair, you can enter the command at the console of either controller.

      If disk ownership automatic assignment is enabled, the output shows on (for each controller) in the Auto Assign column.
    2. If disk ownership automatic assignment is enabled, you need to disable it: storage disk option modify -node node_name -autoassign off
      You need to disable disk ownership automatic assignment on both controllers in an HA pair.
  2. If you are hot-adding a stack of disk shelves directly to a controller, complete the following substeps; otherwise, go to step 3.
    1. If the stack you are hot-adding has more than one disk shelf, cable the shelf-to-shelf connections; otherwise, go to substep b.
      If...Then...
      You are cabling a stack with multipath HA, multipath, single-path HA, or single-path connectivity to the controllers

      Cable the shelf-to-shelf connections as standard connectivity (using IOM ports 3 and 1):

      i. Beginning with the logical first shelf in the stack, connect IOM A port 3 to the next shelf's IOM A port 1 until each IOM A in the stack is connected.

      ii. Repeat substep i for IOM B.

      You are cabling a stack with quad-path HA or quad-path connectivity to the controllers

      Cable the shelf-to-shelf connections as double-wide connectivity:

      You cable the standard connectivity using IOM ports 3 and 1 and then the double-wide connectivity using IOM ports 4 and 2.

      i. Beginning with the logical first shelf in the stack, connect IOM A port 3 to the next shelf's IOM A port 1 until each IOM A in the stack is connected.

      ii. Beginning with the logical first shelf in the stack, connect IOM A port 4 to the next shelf's IOM A port 2 until each IOM A in the stack is connected.

      iii. Repeat substeps i and ii for IOM B.

    2. Check the controller-to-stack cabling worksheets and cabling examples sections to see whether a completed worksheet exists for your configuration.
    3. If there is a completed worksheet for your configuration, cable the controller-to-stack connections using the completed worksheet; otherwise, go to the next substep.
    4. If there is no completed worksheet for your configuration, fill out a worksheet template, and then cable the controller-to-stack connections using the completed worksheet.
      Worksheet templates can be found towards the back of this guide.
    5. Verify that all cables are securely fastened.
  3. If you are hot-adding one or more disk shelves to an end—the logical first or last disk shelf—of an existing stack, complete the applicable substeps for your configuration; otherwise, go to the next step.
    If you are...Then...
    Hot-adding a disk shelf to an end of a stack that has multipath HA, multipath, quad-path HA, or quad-path connectivity to the controllers

    a. Disconnect any cables from IOM A of the disk shelf at the end of the stack that are connected to any controllers; otherwise, go to substep e. Leave the other end of these cables connected to the controllers, or replace cables with longer cables if needed.

    b. Cable the shelf-to-shelf connection(s) between IOM A of the disk shelf at the end of the stack and IOM A of the disk shelf you are hot-adding.

    c. Reconnect any cables that you removed in substep a to the same port(s) on IOM A of the disk shelf you are hot-adding; otherwise, go to the next substep.

    d. Verify that all cables are securely fastened.

    e. Repeat substeps a through d for IOM B; otherwise, go to Step 4.

    Hot-adding a disk shelf to an end of the stack in a DM3000x, DM5000x, or DM7000x single-path HA or single-path configuration

    These instructions are for hot-adding to the end of the stack that does not have controller-to-stack connections.

    a. Cable the shelf-to-shelf connection between IOM A of the disk shelf in the stack and IOM A of the disk shelf you are hot-adding.

    b. Verify that the cable is securely fastened.

    c. Repeat applicable substeps for IOM B.

  4. Verify SAS connectivity for each hot-added disk shelf: storage shelf show -shelf shelf_name -connectivity

    You must run this command for each disk shelf you hot-added.

    For example, the following output shows hot-added disk shelf 2.5 is connected to initiator ports 1a and 0d (port pair 1a/0d) on each controller (in a multipath HA configuration with one quad-port SAS HBA):

    cluster1::> storage shelf show -shelf 2.5 -connectivity 

    Shelf Name: 2.5
    Stack ID: 2
    Shelf ID: 5
    Shelf UID: 40:0a:09:70:02:2a:2b
    Serial Number: 101033373
    Module Type: IOM12
    Model: DM240S
    Shelf Vendor: Lenovo
    Disk Count: 24
    Connection Type: SAS
    Shelf State: Online
    Status: Normal

    Paths:

    Controller Initiator Initiator Side Switch Port Target Side Switch Port Target Port TPGN
    ------------ --------- ---------------------- ---------------------------- ----------- ------
    stor-8080-1 1a - - - -
    stor-8080-1 0d - - - -
    stor-8080-2 1a - - - -
    stor-8080-2 0d - - - -

    Errors:
    ------
    -

  5. If you disabled disk ownership automatic assignment in Step 1, manually assign disk ownership, and then reenable disk ownership automatic assignment if needed:
    1. Display all unowned disks: storage disk show -container-type unassigned
    2. Assign each disk: storage disk assign -disk disk_name -owner owner_name

      You can use the wildcard character to assign more than one disk at once.

    3. Reenable disk ownership automatic assignment if needed: storage disk option modify -node node_name -autoassign on

      You need to reenable disk ownership automatic assignment on both controllers in an HA pair.

  6. If your configuration is running in-band ACP, verify that in-band ACP was automatically enabled on hot-added disk shelves: storage shelf acp show
    In the output, in-band is listed as active for each node.