Troubleshooting PCI-SCI Interconnects
If you have problems with your PCI-SCI interconnect, check the following items.
Verify that the LED on the PCI-SCI transport adapter is blinking green rapidly. For detailed LED interpretations and actions, see the documentation that shipped with your host adapter.
Verify that the PCI-SCI transport adapter card's DIP switch settings are correct. For more information, see the documentation that shipped with your PCI-SCI host adapter.
Verify that the PCI-SCI cables are correctly connected. The PCI-SCI cable connects to the connector that is marked SCI In on the PCI-SCI adapter cards and, if you are using transport junctions, to the Out ports on the SCI transport junctions.
Verify that the PCI-SCI cables are correctly connected. The PCI-SCI cable connects to the connector that is marked SCI Out on the PCI-SCI adapter cards and, if you are using transport junctions, to the In ports on the SCI transport junctions.
Verify that the PCI-SCI switch Unit selectors are set to F.
Where to Go From Here
Install the Sun Cluster software. Configure the interconnect after you install all other hardware. To review the task map about how to install cluster hardware, see Table 3-1.
Installing Sun Fire Link Cluster Interconnect Hardware
Table 3-3 lists procedures about how to install Sun Fire cluster interconnect hardware. Perform the procedures in the order that the procedures are listed.
Table 3-3 Task Map: Installing Sun Fire Link Cluster Interconnect Hardware
Task | For Instructions, Go To |
|---|---|
Install the Sun Fire cluster interconnect hardware. | Sun Fire Link Interconnect Hardware Installation Guide |
Perform the Sun Fire Link software installation. | Sun Fire Link Software Installation Guide |
Create and activate the Sun Fire Link fabric. | Sun Fire Link Fabric Administrator's Guide |
Maintaining Ethernet and PCI-SCI Interconnect Hardware in a Running Cluster
The following table lists procedures about how to maintain Ethernet and PCI-SCI cluster interconnect and public network hardware.
Table 3-4 Task Map: Maintaining Cluster Interconnect Hardware
Task | For Instructions, Go To |
|---|---|
Add transport adapters. | |
Replace transport adapters. | |
Remove transport adapters. | |
Upgrade transport adapter firmware | |
Add transport cables and transport junctions. | |
Replace transport cables and transport junctions. | |
Remove transport cables and transport junctions. |
How to Add Transport Adapters
This section contains the procedure about how to add transport adapters to nodes in a running cluster. For conceptual information on transport adapters, see your Sun Cluster concepts documentation.
Shut down the node in which you are installing the transport adapter.
For the procedure about how to shut down a node, see your Sun Cluster system administration documentation.
Power off the node.
For the procedure about how to power off a node, see the documentation that shipped with your node.
Install the transport adapter.
For the procedure about how to install transport adapters and set transport adapter DIP switches, see the documentation that shipped with your host adapter and node hardware.
Perform a reconfiguration boot to create the new Solaris device files and links.
Where to Go From Here
After you add your interconnect hardware, you might want to reconfigure Sun Cluster software with the new interconnect components. If you want to reconfigure Sun Cluster software with the new interconnect components, see your Sun Cluster system administration documentation.
How to Replace Transport Adapters
This section contains the procedure about how to replace a failed transport adapter in a node in a running cluster. For conceptual information on transport adapters, see your Sun Cluster concepts documentation.
Caution - You must maintain at least one cluster interconnect between the nodes of a cluster. The cluster does not function without a working cluster interconnect. You can check the status of the interconnect with the command, scstat -W. For more details
on checking the status of the cluster interconnect, see your Sun Cluster system administration documentation.
Shut down the node with the transport adapter you want to replace.
For the procedure about how to shut down a node, see your Sun Cluster system administration documentation.
Power off the node.
For the procedure about how to power off your node, see the documentation that shipped with your node.
Disconnect the transport cable from the transport adapter and other devices.
For the procedure about how to disconnect cables from transport adapters, see the documentation that shipped with your host adapter and node.
Replace the transport adapter.
For the procedure about how to replace transport adapters, see the documentation that shipped with your host adapter and node.
Reconnect the transport cable to the new transport adapter.
For the procedure about how to connect cables to transport adapters, see the documentation that shipped with your host adapter and node.
Perform a reconfiguration boot to create the new Solaris device files and links.
Where to Go From Here
After you replace your interconnect hardware, you might want to reconfigure Sun Cluster software with the new interconnect components. If you want to reconfigure Sun Cluster software with the new interconnect components, see your Sun Cluster system administration documentation.
How to Replace a PCI-SCI Transport Adapter
This section contains the procedure about how to replace a PCI-SCI transport adapter in a running cluster.
Caution - You must maintain at least one cluster interconnect between the nodes of a cluster. The cluster does not function without a working cluster interconnect. You can check the status of the interconnect with the command. scstat --W. For more details on checking the status
of the cluster interconnect, see your Sun Cluster system administration documentation.
Identify the adapter that you want to replace.
# scstat -W
Remove the adapter and the cable from the cluster configuration.
# scsetup
See the Sun Cluster system administration documentation for the procedure on removing host adapters.
Verify that the removed adapter and cable path has been removed from the cluster configuration.
# scstat -W
Shut down the node that contains the host adapter you plan to replace.
For the full procedure on shutting down and powering off a node, see "Shutting Down and Booting a Single Cluster Node" in the Sun Cluster 3.1 System Administration Guide.
Replace the host adapter.
For the procedure on replacing the host adapter, see the documentation that shipped with your SCI-PCI host adapter.
Note - Ensure that you insert the replacement adapter into the original adapter's slot. If the new adapter is inserted into a different slot, the system will assign a new device instance number to the new adapter.
If you decide to insert the adapter into a different slot, note the adapter's new name. You will need to use the new name when you add the adapter to the configuration with scsetup.
Boot the node.
For more information on booting nodes, see the Sun Cluster system administration documentation.
For more information on booting nodes, see "Shutting Down and Booting a Single Cluster Node" in the Sun Cluster 3.1 System Administration Guide.
Verify that the cluster configuration did not change after you shut down the node.
# scstat -W
Determine the adapter's instance number.
Based on the slot number, find the adapter's name.
The following screen shot is an example and might not reflect the hardware that you plan to configure.
# prtdiag ... ========================= IO Cards ========================= Bus Max IO Port Bus Freq Bus Dev, Type ID Side Slot MHz Freq Func State Name Model ---- ---- ---- ---- ---- ---- ---- ----- -------------------------------- PCI 8 B 2 33 33 2,0 ok pci11c8,0-pci11c8,d665.11c8.0.0 PCI 8 B 3 33 33 3,0 ok pci11c8,0-pci11c8,d665.11c8.0.0 ...By using the adapter's name and slot number, find the adapter's instance number.
The following screen shot is an example and might not reflect the hardware that you plan to configure.
# prtconf ... pci, instance #0 pci11c8,0, instance #0 pci11c8,0, instance #1 ...
Add the new adapter card and cable to the configuration.
Note - It is important that you use the correct SCI adapter name when you add the new adapter through scsetup . The adapter name is a combination of the type of the adapter and the adapter's instance number, for example sci0.
# scsetup
Verify that the paths that connect to the new host adapter are online.
# scstat -W