Upgrading Firmware on Storage Arrays That Do Not Support Submirrored Data
In a partner-group configuration, you can have nonmirrored data. However, you must shut down the cluster when upgrading firmware.
Caution - Perform this procedure on one storage array at a time.
This procedure requires that you reset the storage arrays that you are
upgrading. If you reset more than one storage array at a time, your cluster
loses access to data.
Shut down the entire cluster.
For the procedure about how to shut down a cluster, see your Sun Cluster system administration documentation.
Apply the controller, disk drive, and UIC firmware patches.
For the list of required storage array patches, see the Sun StorEdge T3 Disk Tray Release Notes. For the procedure about how to apply firmware patches, see the firmware patch README file. For the procedure about how to verify the firmware level, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.
Reset the storage arrays.
For the procedure about how to reset a storage array, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.
Boot all nodes back into the cluster.
For the procedure about how to boot a cluster, Sun Cluster system administration documentation
On one node that is connected to the partner group, verify that the storage array controllers are visible to the node.
# format
How to Add Partner Groups
Note - Use this procedure to add new storage array partner groups to a running cluster. To install partner groups to a new Sun Cluster that is not running, use the procedure in How to Install a Partner Group.
This procedure defines Node A as the node that you begin working with. Node B is the second node.
Set up a Reverse Address Resolution Protocol (RARP) server on the network you want the new storage arrays to reside on. Afterward, assign an IP address to the new storage arrays.
Note - Assign an IP address to the master controller unit only. The master controller unit is the storage array that has the interconnect cables attached to the to the second port of each interconnect card, as shown in Figure 2-2.
This RARP server enables you to assign an IP address to the new storage arrays. Assign an IP address by using the storage array's unique MAC address. For the procedure about how to set up a RARP server, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.
Install the Ethernet cable between the storage arrays and the local area network (LAN), as shown in Figure 2-2.
If not already installed, install interconnect cables between the two storage arrays of each partner group, as shown in Figure 2-2.
For the procedure about how to install interconnect cables, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.
Figure 2-2 Adding a Partner-Group Configuration: Part I
Power on the storage arrays.
Note - The storage arrays might require several minutes to boot.
For the procedure about how to power on storage arrays, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.
Administer the storage arrays' network addresses and settings.
Use the telnet command to access the master controller unit and administer the storage arrays.
For the procedure about how to administer the network address and the settings of a storage array, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.
Install any required storage array controller firmware upgrades.
For partner-group configurations, use the telnet command to the master controller unit. If necessary, install the required controller firmware for the storage array.
For the required revision number of the storage array controller firmware, see the Sun StorEdge T3 Disk Tray Release Notes.
Ensure that each storage array has a unique target address.
For the procedure about how to verify and assign a target address to a storage array, see the Sun StorEdge T3 and T3+ Array Configuration Guide.
Ensure that the cache and mirror settings for each storage array are set to auto.
For more information, see the Sun StorEdge T3 and T3+ Array Administrator's Guide.
Ensure that the mp_support parameter for each storage array is set to mpxio.
For more information, see the Sun StorEdge T3 and T3+ Array Administrator's Guide.
Configure the new storage arrays with the desired logical volumes.
For the procedure about how to create and initialize a logical volume, see the Sun StorEdge T3 and T3+ Array Administrator's Guide. For the procedure about how to mount a logical volume, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.
Reset the storage arrays.
For the procedure about how to reboot or reset a storage array, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.
Are you adding Sun StorEdge T3+ arrays?
If no, proceed to Step 13.
If yes, install the media interface adapter (MIA) in the Sun StorEdge T3 arrays that you are adding, as shown in Figure 2-2.
For the procedure about how to install an MIA, see the Sun StorEdge T3 and T3+ Array Configuration Guide.
If necessary, install GBICs or SFPs in the FC switches, as shown in Figure 2-2.
For the procedure about how to install a GBIC or an SFP to an FC switch, see the documentation that shipped with your FC switch hardware.
Install a fiber-optic cable between each FC switch and both new storage arrays of the partner group, as shown in Figure 2-2.
For the procedure about how to install a fiber-optic cable, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.
Note - If you are using two FC switches and Sun SAN software to create a storage area network (SAN), see SAN Considerations for more information.
Determine the resource groups and device groups that are running on all nodes.
Record this information because you use this information in Step 53 of this procedure to return resource groups and device groups to these nodes.
# scstat
Move all resource groups and device groups off Node A.
# scswitch -S -h from-node
Do you need to install host adapters in Node A?
Is the host adapter that you are installing the first host adapter on Node A?
If no, skip to Step 20.
If yes, determine whether the required support packages are already installed on this node. The following packages are required.
# pkginfo | egrep Wlux system SUNWluxd Sun Enterprise Network Array sf Device Driver system SUNWluxdx Sun Enterprise Network Array sf Device Driver (64-bit) system SUNWluxl Sun Enterprise Network Array socal Device Driver system SUNWluxlx Sun Enterprise Network Array socal Device Driver (64-bit) system SUNWluxop Sun Enterprise Network Array firmware and utilities system SUNWluxox Sun Enterprise Network Array libraries (64-bit)
Are the required support packages already installed?
If yes, proceed to Step 20.
If no, install the required support packages that are missing.
The support packages are located in the Product directory of the Solaris CD-ROM. Add any missing packages.
Shut down and power off Node A.
For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.
Install the host adapters in Node A.
For the procedure about how to install host adapters, see the documentation that shipped with your host adapters and nodes.
Power on and boot Node A into noncluster mode.
For more information about how to boot nodes, see your Sun Cluster system administration documentation.
If necessary, upgrade the host adapter firmware on Node A.
See the Sun Cluster release notes documentation for information about accessing Sun's Info Docs on http://sunsolve.sun.com. The Info Docs list information about required patches and firmware that are available for download. For the procedure about how to apply host adapter firmware, see the firmware patch README file.
If necessary, install GBICs or SFPs to the FC switches, as shown in Figure 2-3.
For the procedure about how to install a GBIC or an SFP to an FC switch, see the documentation that shipped with your FC switch hardware.
Connect fiber-optic cables between Node A and the FC switches, as shown in Figure 2-3.
For the procedure about how to install a fiber-optic cable, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.
Note - If you are using two FC switches and Sun SAN software to create a storage area network (SAN), see SAN Considerations for more information.
Figure 2-3 Adding a Partner-Group Configuration: Part II
If necessary, install the required Solaris patches for storage array support on Node A.
See the Sun Cluster release notes documentation for information about accessing Sun's Info Docs on http://sunsolve.sun.com. The Info Docs list information about required patches and firmware that are available for download. For the procedure about how to apply host adapter firmware, see the firmware patch README file.
Install any required patches or software for Sun StorEdge Traffic Manager software support on Node A.
For the procedure on how to install the Sun StorEdge Traffic Manager software, see the Sun StorEdge Traffic Manager Installation and Configuration Guide at http://www.sun.com/products-n-solutions/hardware/docs/. For a list of required patches for Sun StorEdge Traffic Manager software, see the Sun StorEdge Traffic Manager Software Release Notes on http://www.sun.com/storage/san.
Edit the /kernel/drv/scsi_vhci.conf file to activate the Sun StorEdge Traffic Manager software functionality. Set the mpxio-disable parameter to no.
mpxio-disable="no"
Shut down Node A.
For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.
Perform a reconfiguration boot on Node A to create the new Solaris device files and links.
On Node A, update the /devices and /dev entries.
# devfsadm -C
On Node A, update the paths to the DID instances.
# scdidadm -C
Label the new storage array logical volume.
For the procedure about how to label a logical volume, see the Sun StorEdge T3 and T3+ Array Administrator's Guide.
(Optional) On Node A, verify that the device IDs (DIDs) are assigned to the new storage array.
# scdidadm -l
Do you need to install host adapters in Node B?
Is the host adapter that you are installing the first host adapter on Node B?
If no, skip to Step 38.
If yes, determine whether the required support packages for host adapters are already installed on this node. The following packages are required.
# pkginfo | egrep Wlux system SUNWluxd Sun Enterprise Network Array sf Device Driver system SUNWluxdx Sun Enterprise Network Array sf Device Driver (64-bit) system SUNWluxl Sun Enterprise Network Array socal Device Driver system SUNWluxlx Sun Enterprise Network Array socal Device Driver (64-bit) system SUNWluxop Sun Enterprise Network Array firmware and utilities system SUNWluxox Sun Enterprise Network Array libraries (64-bit)
Are the required support packages already installed?
If yes, skip to Step 38.
If no, install the missing support packages.
The support packages are located in the Product directory of the Solaris CD-ROM. Add any missing packages.
Shut down and power off Node B.
For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.
Install the host adapters in Node B.
For the procedure about how to install host adapters, see the documentation that shipped with your host adapters and nodes.
Power on and boot Node B.
For more information on booting nodes, see your Sun Cluster system administration documentation.
If necessary, upgrade the host adapter firmware on Node B.
See the Sun Cluster release notes documentation for information about accessing Sun's Info Docs on http://sunsolve.sun.com. The Info Docs list information about required patches and firmware that are available for download. For the procedure about how to apply host adapter firmware, see the firmware patch README file.
If necessary, install GBICs or SFPs to the FC switches, as shown in Figure 2-4.
For the procedure about how to install GBICs or SFPs to an FC switch, see the documentation that shipped with your FC switch hardware.
Connect fiber-optic cables between the FC switches and Node B, as shown in Figure 2-4.
For the procedure about how to install fiber-optic cables, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.
Note - If you are using two FC switches and Sun SAN software to create a storage area network (SAN), see SAN Considerations for more information.
Figure 2-4 Adding a Partner-Group Configuration: Part III
If necessary, install the required Solaris patches for storage array support on Node B.
For a list of required Solaris patches for storage array support, see the Sun StorEdge T3 Disk Tray Release Notes.
If you are installing a partner-group configuration, install any required patches or software for Sun StorEdge Traffic Manager software support on Node B.
For the procedure about how to install the software, see the Sun StorEdge Traffic Manager Installation and Configuration Guide at http://www.sun.com/products-n-solutions/hardware/docs/.
Edit the /kernel/drv/scsi_vhci.conf file to activate the Sun StorEdge Traffic Manager software functionality. Set the mpxio-disable parameter to no.
mpxio-disable="no"
Shut down Node B.
For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.
Perform a reconfiguration boot to create the new Solaris device files and links on Node B.
On Node B, update the /devices and /dev entries.
# devfsadm -C
On Node B, update the paths to the DID instances.
# scdidadm -C
(Optional) On Node B, verify that the DIDs are assigned to the new storage arrays.
# scdidadm -l
On one node that is attached to the new storage arrays, reset the SCSI reservation state.
# scdidadm -R n
Where n is the DID instance of a storage array LUN that you are adding to the cluster.
Note - Repeat this command on the same node for each storage array LUN that you are adding to the cluster.
Return the resource groups and device groups that you identified in Step 15 to all nodes.
# scswitch -z -g resource-group -h nodename # scswitch -z -D device-group-name -h nodename
For more information, see your Sun Cluster system administration documentation.
Perform volume management administration to incorporate the new logical volumes into the cluster.
For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.