Maintaining JBOD Storage Arrays
This section provides cluster-specific procedures about how to maintain a JBOD storage array. See the documentation that shipped with your JBOD storage array for general maintenance procedures.
Table 2-1 Task Map: Maintaining a JBOD Storage Array
| Task | Information |
|---|---|
Add a JBOD storage array | |
Remove a JBOD storage array | |
Replace a JBOD storage array
To replace a JBOD storage array, remove the JBOD storage array. Add a new JBOD storage array to the configuration. | |
Replace a chassis | |
Add a disk drive | |
Remove a disk drive | |
Replace a disk drive | |
Replace a SCSI cable | Sun Cluster 3.x Hardware Administration Manual |
How to Add a JBOD Storage Array
Use this procedure to install a JBOD storage array in a running cluster. Perform the steps in this procedure in conjunction with the procedures in your Sun Cluster system administration documentation and your server hardware manual.
This procedure uses an updated method for setting the scsi-initiator-id. This new method must be used with the StorEdge PCI Dual Ultra3 SCSI host adapter. If you are adding this storage array to a cluster configuration that uses the previous method of setting the scsi-initiator-id, you will need to update the nvramrc script and set the scsi-initiator-id by using this procedure. The previous method relied on setting each node's scsi-initiator-id for shared storage in the nvramrc script.
Note - To determine if the cluster configuration uses the previous method of setting the scsi-initiator-id, run the following command on the two nodes that you plan to connect to this storage device.
# eeprom scsi-initiator-id |
For conceptual information on multi-initiator SCSI and device IDs, see your Sun Cluster concepts documentation.
Shut down the first node.
For the procedure on shutting down and powering off a node, see your Sun Cluster system administration documentation.
If necessary, install the host adapters in the first node.
For the procedure about how to install host adapters, see the documentation that shipped with your host adapters and nodes.
Connect the SCSI cable between the first node and the JBOD storage array.
If the JBOD storage array is in dual bus, multi-initiator mode, see Figure 2-1 for a diagram about how to cable and terminate the JBOD storage arrays.
Caution - Do not power on the JBOD storage array until the JBOD storage array
is cabled to the first node.Ensure the cable does not exceed bus length limitations. For more information on bus length limitations, see the documentation that shipped with your hardware.
For the procedure on how to cable the storage arrays, see the Sun StorEdge 3310 SCSI Array Installation, Operation, and Service Manual.
Figure 2-1 Cabling a Dual-Bus, Multi-Inititator Storage Array: Part 1
Ensure that each device in the SCSI chain has a unique SCSI address.
This procedures ensures that each device in the SCSI chain has a unique SCSI address.
If necessary, power on the storage devices.
For the procedure on powering on a storage device, see the service manual that shipped with your storage device.
If necessary, power on the first node, but do not allow it to boot. If necessary, halt the system to continue with OBP Monitor tasks.
Set the scsi-initiator-id for one node to 6.
{1} ok setenv scsi-initiator-id 6 scsi-initiator-id = 6Find the paths to the host adapters that connect to the local disk drives.
{0} ok show-disksUse this information to change the SCSI addresses in the nvramrc script. Do not include the /sd directories in the device paths.
Edit the nvramrc script to set the scsi-initiator-id for the local devices on the first node to 7.
For a full list of commands, see the OpenBoot 2.x Command Reference Manual.
Caution - Insert exactly one space after the first double quote and before scsi-initiator-id.The following screen shot is an example and might not reflect the hardware that you plan to configure. Do not input this text verbatim.
{0} ok nvedit 0: probe-all 1: cd /pci@1f,4000/scsi@2 2: 7 " scsi-initiator-id" integer-property 3: device-end 4: cd /pci@1f,4000/scsi@3 5: 7 " scsi-initiator-id" integer-property 6: device-end 7: install-console 8: banner[Control C] {0} okStore the changes.
The changes you make through the nvedit command are recorded on a temporary copy of the nvramrc script. You can continue to edit this copy without risk. After you complete your edits, save the changes. If you are not sure about the changes, discard them.
To store the changes, type:
{0} ok nvstore {1} ok
To discard the changes, type:
{0} ok nvquit {1} ok
Verify the contents of the nvramrc script that you created, as shown in the following example.
If the contents of the nvramrc script are incorrect, use the nvedit command to make corrections.
The following screen shot is an example and might not reflect the hardware that you plan to configure. Do not input this text verbatim.
{0} ok printenv nvramrc nvramrc = probe-all cd /pci@1f,4000/scsi@2 7 " scsi-initiator-id" integer-property device-end cd /pci@1f,4000/scsi@3 7 " scsi-initiator-id" integer-property device-end install-console banner {1} okInstruct the OpenBoot PROM (OBP) Monitor to use the nvramrc script, as shown in the following example.
{0} ok setenv use-nvramrc? true use-nvramrc? = true {1} ok
Perform a reconfiguration boot on the first node to create the new Solaris device files and links.
If necessary, format and label the disks.
On the first node, verify that the DIDs have been assigned to the disk drives in the JBOD storage array.
# scdidadm -l
Shut down the second node.
For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.
If necessary, install the host adapters in the second node.
For the procedure about how to install a host adapter, see the documentation that shipped with your host adapter and node.
Connect the JBOD storage array to the host adapters.
If the JBOD storage array is in dual bus, multi-initiator mode, remove the terminators and connect the JBOD storage array to the second node. See Figure 2-2 for a diagram about how the JBOD storage array will look cabled to both nodes.
For the procedure on how to cable the storage arrays, see the Sun StorEdge 3310 SCSI Array Installation, Operation, and Service Manual and the Sun StorEdge 3310 SCSI Array Release Notes.
Ensure the cable does not exceed bus length limitations. For more information on bus length limitations, see the documentation that shipped with your hardware.
Figure 2-2 Cabling a Dual-Bus, Multi-Inititator Storage Array: Part 2
Verify that the scsi-initiator-id is set correctly on the second node.
If necessary, power on the second node, but do not allow it to boot. If necessary, halt the system to continue with OBP Monitor tasks.
Verify that the scsi-initiator-id for each host adapter on the second node is set to 7
Use the show-disks command to find the paths to the host adapters that are connected to these enclosures. Select each host adapter's device tree node, and display the node's properties to confirm that the scsi-initiator-id for each host adapter is set to 7.
The following screen shot is an example and might not reflect the hardware that you plan to configure. Do not input this text verbatim.
{0} ok cd /pci@6,4000/pci@3/scsi@5 {0} ok .properties scsi-initiator-id 00000007 ...
Perform a reconfiguration boot to create the new Solaris device files and links.
On the second node, verify that the DIDs have been assigned to the disk drives in the JBOD storage array.
# scdidadm -L
Perform volume management administration to add the disk drives in the JBOD storage array to the volume management configuration.
For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.