Skip to main content

Cabling disk shelves with IOM12 modules for a new system installation

You cable disk shelf SAS connections, shelf-to-shelf (as applicable) and controller-to-shelf, to establish storage connectivity for the system.

Before you begin

You must have met the requirements in the Requirements for installing and cabling disk shelves with IOM12 modules for a new system installation section and installed the disk shelves in the rack.

About this task

After you cable the disk shelves, you power them on, set the shelf IDs, and complete system setup and configuration.
  1. Cable the shelf to shelf connections within each stack. If the system has more than one stack, repeat this for the second stack. Otherwise, go to the next step.

    For a detailed explanation and examples of shelf-to-shelf standard cabling and shelf-to-shelf double-wide cabling, see the shelf-to-shelf connection rules section.

    If...Then...
    You are cabling a multipath HA, multipath, single-path HA, or single-path configuration

    Cable the shelf-to-shelf connections as standard connectivity (using IOM ports 3 and 1):

    a. Beginning with the logical first shelf in the stack, connect IOM A port 3 to the next shelf's IOM A port 1 until each IOM A in the stack is connected.

    b. Repeat substep a for IOM B.

    c. Repeat substeps a and b for each stack.

    You are cabling a quad-path HA or quad-path configuration

    Cable the shelf-to-shelf connections as double-wide connectivity:

    You cable the standard connectivity using IOM ports 3 and 1 and then the double-wide connectivity using IOM ports 4 and 2.

    a. Beginning with the logical first shelf in the stack, connect IOM A port 3 to the next shelf's IOM A port 1 until each IOM A in the stack is connected.

    b. Beginning with the logical first shelf in the stack, connect IOM A port 4 to the next shelf's IOM A port 2 until each IOM A in the stack is connected.

    c. Repeat substeps a and b for IOM B.

    d. Repeat substeps a through c for each stack.

  2. Identify the controller SAS port pairs that you can use to cable the controller-to-stack connections.
    1. Check the controller-to-stack cabling worksheets and cabling examples sections to see whether a completed worksheet exists for your configuration.
    2. The next step depends on whether a completed worksheet exists for your configuration:
      If...Then...
      There is a completed worksheet for your configuration

      Go to the next step.

      You use the existing completed worksheet.

      There is no completed worksheet for your configuration

      Fill out a controller-to-stack cabling worksheet template.

      Worksheet templates can be found towards the back of this guide.

  3. Cable the controller-to-stack connections using the completed worksheet.

    Instructions about how to read a worksheet to cable controller-to-stack connections can be found towards the back of this guide.

  4. Connect the power supplies for each disk shelf:
    1. Connect the power cords first to the disk shelves, securing them in place with the power cord retainer, and then connect the power cords to different power sources for resiliency.
    2. Turn on the power supplies for each disk shelf and wait for the disk drives to spin up.
  5. Set the shelf IDs and complete system setup:

    You must set shelf IDs so they are unique within the HA pair configuration, including the internal disk shelf in a DM3000x, DM5000x, or DM7000x.

    If...Then...
    You are manually setting shelf IDs

    a. Access the shelf ID button behind the left end cap.

    b. Change the shelf ID to a unique ID (00 through 99).

    c. Power-cycle the disk shelf to make the shelf ID take effect.Wait at least 10 seconds before turning the power back on to complete the power cycle. The shelf ID blinks and the operator display panel amber LED blinks until you power cycle the disk shelf.

    d. Power on the controllers and complete system setup and configuration as instructed by the Installation and Setup Instructions that came with your system.

    You are automatically assigning all shelf IDs in your HA pair configuration
    Note
    Shelf IDs are assigned in sequential order from 00-99. If you have a DM3000x, DM5000x, or DM7000x, shelf ID assignment begins with the internal disk shelf.

    a. Power on the controllers.

    b. As the controllers start booting, press Ctrl-C to abort the AUTOBOOT process when you see the message Starting AUTOBOOT press Ctrl-C to abort.
    Note
    If you miss the prompt and the controllers boot to ONTAP, halt both controllers, and then boot both controllers to the menu by entering boot_ontap menu at their LOADER prompt.

    c. Boot one controller to Maintenance mode:boot_ontap menu You only need to assign shelf IDs on one controller.

    d. From the menu, select option 5 for Maintenance mode.

    e. Automatically assign shelf IDs: sasadmin expander_set_shelf_id -a

    f. Exit Maintenance mode:halt

    g. Bring up the system by entering the following command at the LOADER prompt of both controllers: boot_ontap Shelf IDs appear in disk shelf digital display windows.
    Note
    Before you boot the system, best practice is to take this opportunity to verify cabling is correct, a root aggregate is present, and run system-level diagnostics to identify any faulty components.

    h. Complete system setup and configuration as instructed by the Installation and Setup Instructions that came with your system.

  6. If as part of system set up and configuration, you did not enable disk ownership automatic assignment, manually assign disk ownership; otherwise, go to the next step:
    1. Display all unowned disks: storage disk show -container-type unassigned
    2. Assign each disk: storage disk assign -disk disk_name -owner owner_name \

      You can use the wildcard character to assign more than one disk at once.

  7. Verify that in-band ACP was automatically enabled. storage shelf acp show
    In the output, in-band is listed as active for each node.