Where to Go From Here

To create a logical volume, see How to Create a Logical Volume.

Maintaining Storage Arrays

This section contains the procedures about how to maintain a storage array. The following table lists these procedures. This section does not include a procedure about how to add a disk drive and a procedure about how to remove a disk drive. This section does not include these procedures because a storage array only operates when fully configured.

Caution! Caution - If you remove any field-replaceable unit (FRU) for an extended period of time, thermal complications might result. To prevent this complication, the storage array is designed so that an orderly shutdown occurs. This shutdown occurs when you remove a component for longer than 30 minutes. Therefore, a replacement part must be immediately available before you start an FRU replacement procedure. You must replace an FRU within 30 minutes. If you do not replace the FRU within this time, the storage array, and all attached storage array, shut down and power off.

Note - When you upgrade firmware on a storage device or on an enclosure, redefine the stripe size of a LUN, or perform other LUN operations, a device ID (DID) might change unexpectedly. When you perform a check of the DID configuration by running the scdidadm -c command, the following error message appears on your console if the DID changed unexpectedly.

 device id for nodename:/dev/rdsk/cXtYdZsN does not match physical 
device's id for ddecimalnumber, device may have been replaced.

To fix DIDs that report this error, run the scdidadm -R command for each affected device.

Table 1-2 Task Map: Maintaining a Storage Array

Task	Information
Upgrade storage array firmware.	How to Upgrade Storage Array Firmware
Replace a disk drive.	How to Replace a Disk Drive
Add a storage array.	How to Add a Storage Array
Remove a storage array.	How to Remove a Storage Array
Replace a host-to-hub/switch fiber-optic cable.	How to Replace a Host-to-Hub/Switch Component
Replace an FC host adapter GBIC or an SFP.	How to Replace a Host-to-Hub/Switch Component
Replace an FC hub/switch GBIC or an SFP that connects an FC hub/switch to a host.	How to Replace a Host-to-Hub/Switch Component
Replace a hub/switch-to-storage array fiber-optic cable.	How to Replace a Hub/Switch or Hub/Switch-to-Array Component
Replace an FC hub/switch GBIC or an SFP that connects the FC hub/switch to a storage array.	How to Replace a Hub/Switch or Hub/Switch-to-Array Component
Replace an FC hub/switch.	How to Replace a Hub/Switch or Hub/Switch-to-Array Component
Replace an FC switch. This procedure applies to SAN-configured clusters only.	How to Replace a Hub/Switch or Hub/Switch-to-Array Component
Replace an FC hub/switch power cord.	How to Replace a Hub/Switch or Hub/Switch-to-Array Component
Replace a media interface adapter (MIA) on a storage array. This procedure does not apply to storage arrays.	How to Replace a Hub/Switch or Hub/Switch-to-Array Component
Replace a storage array controller.	How to Replace a Storage Array Controller
Replace a chassis.	How to Replace a Chassis
Replace a host adapter.	How to Replace a Host Adapter
Upgrade a StorEdge T3 array controller to a StorEdge T3+ array controller.	How To Upgrade a StorEdge T3 Controller to a StorEdge T3+ Controller

The following is a list of administrative tasks that require no cluster-specific procedures. See the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual for the following procedures.

Replacing an Ethernet cable .
Replacing a power cable on the storage array.
Replacing a Power and Cooling Unit (PCU).
Replacing a unit interconnect card (UIC).
Adding a disk drive.
Removing a disk drive.

How to Upgrade Storage Array Firmware

Use this procedure to upgrade storage array firmware in a running cluster. Storage array firmware includes controller firmware, unit interconnect card (UIC) firmware, and disk drive firmware.

Caution! Caution - Perform this procedure on one storage array at a time. This procedure requires that you reset the storage arrays that you are upgrading. If you reset more than one storage array at a time, your cluster loses access to data.

Note - For all firmware installations, always read any README files that accompany the firmware patch for the latest information and special notes.

On one node that is attached to the storage array, detach the submirrors. This storage array is the storage array that you are upgrading.
For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

Apply the controller, disk drive, and UIC firmware patches.
See the Sun Cluster release notes documentation for information about accessing Sun's Info Docs on http://sunsolve.sun.com. The Info Docs list information about required patches and firmware that are available for download. For the procedure about how to apply host adapter firmware, see the firmware patch README file.

Reset the storage array, if you have not already done so.
For the procedure about how to reboot a storage array, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Reattach the submirrors to resynchronize the submirrors.
For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

How to Replace a Disk Drive

Use this procedure to replace a failed disk drive in a storage array in a running cluster.

If the failed disk drive impacted the logical volume's availability, remove the logical volume from volume management control. Otherwise, proceed to Step 2.
For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

Replace the disk drive.
For the procedure about how to replace a disk drive, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

If you removed a LUN from volume management control in Step 1, return the LUN(s) to volume management control. Otherwise, Step 2 completes this procedure.
For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

How to Add a Storage Array

Use this procedure to add a new storage array to a running cluster.

This procedure defines Node A as the node with which you begin working. Node B is the remaining node.

Set up a Reverse Address Resolution Protocol (RARP) server on the network you want the new storage arrays to reside on. Afterward, assign an IP address to the new storage arrays.
This RARP server enables you to assign an IP address to the new storage array by using the storage array's unique MAC address.

For the procedure about how to set up a RARP server, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.
Are you adding a StorEdge T3+ array?
- If yes, proceed to Step 3.
- If no, skip to Step 4.

Install the media interface adapter (MIA) in storage array that you are adding, as shown in Figure 1-2.
For the procedure about how to install a media interface adapter (MIA), see the Sun StorEdge T3 and T3+ Array Configuration Guide.

If necessary, install gigabit interface converters (GBICs) or Small Form Factor Pluggables (SFPs) in the FC hub/switch, as shown in Figure 1-2.
The GBICs or SFPs enables you to connect the FC hubs/switches to the storage array that you are adding.

For the procedure about how to install an FC hub/switch GBIC or an SFP, see the documentation that shipped with your FC hub/switch hardware.

Note - If you are using two FC switches and Sun SAN software to create a storage area network (SAN), see "SAN Solutions in a Sun Cluster Environment" in Sun Cluster 3.x Hardware Administration Manual for more information.

Install the Ethernet cable between the storage array and the Local Area Network (LAN), as shown in Figure 1-2.

Power on the storage array array.
Note - The storage array might require a few minutes to boot.

For the procedure about how to power on a storage array, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.

Aaccess the storage array that you are adding. If necessary, install the required controller firmware for the storage array.
See the Sun Cluster release notes documentation for information about accessing Sun's Info Docs on http://sunsolve.sun.com. The Info Docs list information about required patches and firmware that are available for download. For the procedure about how to apply host adapter firmware, see the firmware patch README file.

Does this new storage array have a unique target address?
- If yes, proceed to Step 9.
- If no, change the target address for this new storage array.
For the procedure about how to verify and assign a target address, see the Sun StorEdge T3 and T3+ Array Configuration Guide.

Install a fiber-optic cable between the FC hub/switch and the storage array, as shown in Figure 1-2.
For the procedure about how to install a fiber-optic cable, see the Sun StorEdge T3 and T3+ Array Configuration Guide.

Figure 1-2 Adding a Single-Controller Configuration: Part I

Note - Figure 1-2 shows how to cable two storage arrays to enable data sharing and host-based mirroring. This configuration prevents a single-point of failure.

Configure the new storage array.
For the procedure about how to create a logical volume, see the Sun StorEdge T3 and T3+ Array Administrator's Guide.

Determine the resource groups and device groups that are running on Node A and Node B.
Record this information because you use this information in Step 42 of this procedure to return resource groups and device groups to these nodes.
# scstat

Move all resource groups and device groups off Node A.
# scswitch -S -h from-node

Do you need to install a host adapter in Node A?
- If yes, proceed to Step 14.
- If no, skip to Step 21.

Is the host adapter that you are installing the first FC host adapter on Node A?

If no, skip to Step 16.
If yes, determine whether the Fibre Channel support packages are already installed on these nodes. This product requires the following packages.

# pkginfo | egrep Wlux
system	SUNWluxd		Sun Enterprise Network Array sf Device Driver
system	SUNWluxdx	Sun Enterprise Network Array sf Device Driver 
									(64-bit)
system	SUNWluxl		Sun Enterprise Network Array socal Device Driver
system	SUNWluxlx	Sun Enterprise Network Array socal Device Driver 
									(64-bit)
system	SUNWluxop	Sun Enterprise Network Array firmware and utilities

Are the Fibre Channel support packages installed?
- If yes, proceed to Step 16.
- If no, install the required support packages that are missing.
The storage array packages are located in the Product directory of the Solaris CD-ROM. Add any necessary packages.

Shut down Node A.
For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

Power off Node A.

Install the host adapter in Node A.
For the procedure about how to install a host adapter, see the documentation that shipped with your host adapter and node.

If necessary, power on and boot Node A into noncluster mode.
For the procedure about how to boot a node in noncluster mode, see your Sun Cluster system administration documentation.

If necessary, upgrade the host adapter firmware on Node A.
See the Sun Cluster release notes documentation for information about accessing Sun's Info Docs on http://sunsolve.sun.com. The Info Docs list information about required patches and firmware that are available for download. For the procedure about how to apply host adapter firmware, see the firmware patch README file.

If necessary, install a GBIC or an SFP in the FC hub/switch, as shown in Figure 1-3.
For the procedure about how to install an FC hub/switch GBIC or an SFP, see the documentation that shipped with your FC hub/switch hardware.

Note - If you are using two FC switches and Sun SAN software to create a storage area network (SAN), see "SAN Solutions in a Sun Cluster Environment" in Sun Cluster 3.x Hardware Administration Manual for more information.

If necessary, connect a fiber-optic cable between the FC hub/switch and Node A, as shown in Figure 1-3.
For the procedure about how to install an FC host adapter GBIC or an SFP, see your host adapter documentation. For the procedure about how to install a fiber-optic cable, see the Sun StorEdge T3 and T3+ Array Configuration Guide.

Figure 1-3 Adding a Single-Controller Configuration: Part II

If necessary, install the required Solaris patches for array support on Node A.
For a list of required Solaris patches for storage array support, see the Sun StorEdge T3 and T3+ Array Release Notes.

Shut down Node A.
For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

Perform a reconfiguration boot to create the new Solaris device files and links on Node A.

Label the new logical volume.
For the procedure about how to label a logical volume, see the Sun StorEdge T3 and T3+ Array Administrator's Guide.

(Optional) On Node A, verify that the device IDs (DIDs) are assigned to the new storage array.
# scdidadm -l

Do you need to install a host adapter in Node B?
- If yes, proceed to Step 29.
- If no, skip to Step 36.

Is the host adapter that you are installing the first FC host adapter on Node B?

If no, skip to Step 31.
If yes, determine whether the Fibre Channel support packages are already installed on these nodes. This product requires the following packages.

# pkginfo | egrep Wlux
system	SUNWluxd		Sun Enterprise Network Array sf Device Driver
system	SUNWluxdx	Sun Enterprise Network Array sf Device Driver 
									(64-bit)
system	SUNWluxl		Sun Enterprise Network Array socal Device Driver
system	SUNWluxlx	Sun Enterprise Network Array socal Device Driver 
									(64-bit)
system	SUNWluxop	Sun Enterprise Network Array firmware and utilities

Are the Fibre Channel support packages installed?
- If yes, proceed to Step 31.
- If no, install the required support packages that are missing.
The storage array packages are located in the Product directory of the Solaris CD-ROM. Add any necessary packages.

Shut down Node B.
For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

Power off Node B.
For more information, see your Sun Cluster system administration documentation.

Install the host adapter in Node B.
For the procedure about how to install a host adapter, see the documentation that shipped with your host adapter and node.

If necessary, power on and boot Node B into noncluster mode.
For the procedure about how to boot a node in noncluster mode, see your Sun Cluster system administration documentation.

If necessary, upgrade the host adapter firmware on Node B.
See the Sun Cluster release notes documentation for information about accessing Sun's Info Docs on http://sunsolve.sun.com. The Info Docs list information about required patches and firmware that are available for download. For the procedure about how to apply host adapter firmware, see the firmware patch README file.

If necessary, install a GBIC or an SFP, as shown in Figure 1-4.
For the procedure about how to install an FC hub/switch GBIC or an SFP, see the documentation that shipped with your FC hub/switch hardware.

Note - If you are using two FC switches and Sun SAN software to create a storage area network (SAN), see "SAN Solutions in a Sun Cluster Environment" in Sun Cluster 3.x Hardware Administration Manual for more information.

If necessary, connect a fiber-optic cable between the FC hub/switch and Node B, as shown in Figure 1-4.
For the procedure about how to install an FC host adapter GBIC or an SFP, see your host adapter documentation. For the procedure about how to install a fiber-optic cable, see the Sun StorEdge T3 and T3+ Array Configuration Guide.

Figure 1-4 Adding a Single-Controller Configuration: Part III

If necessary, install the required Solaris patches for storage array support on Node B.
For a list of required Solaris patches for storage array support, see the Sun StorEdge T3 and T3+ Array Release Notes.

Shut down Node B.
For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.

Perform a reconfiguration boot to create the new Solaris device files and links on Node B.

(Optional) On Node B, verify that the device IDs (DIDs) are assigned to the new storage array.
# scdidadm -l

Return the resource groups and device groups that you identified in Step 11 to Node A and Node B.
# scswitch -z -g resource-group -h nodename # scswitch -z -D device-group-name -h nodename
For more information, see your Sun Cluster system administration documentation.

Perform volume management administration to incorporate the new logical volumes into the cluster.
For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.


1. Installing and Maintaining a Sun StorEdge T3 or T3+ Array Single-Controller Configuration Configuring Storage Arrays How to Remove a Logical Volume