Oracle Solaris Cluster 3.3 System Manual

Category
Software
Type
System Manual
Oracle® Solaris Cluster 3.3 With StorEdge
A1000 Array, Netra st A1000 Array, or
StorEdge A3500 System Manual
For Solaris OS (SPARC Platform Edition)
Part No: E22718
May 2011, Revision A
Copyright © 2000, 2011, Oracle and/or its aliates. All rights reserved.
License Restrictions Warranty/Consequential Damages Disclaimer
This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual
property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license,
transmit, distribute, exhibit, perform, publish or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software,
unless required by law for interoperability, is prohibited.
Warranty Disclaimer
The information contained herein is subject to change without notice and is not warranted to be error-free. If you nd any errors, please report them to us in writing.
Restricted Rights Notice
If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, the following notice is
applicable:
U.S. GOVERNMENT RIGHTS
Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers are "commercial computer software" or
"commercial technical data" pursuant to the applicable Federal Acquisition Regulation and agency-specic supplemental regulations. As such, the use, duplication,
disclosure, modication, and adaptation shall be subject to the restrictions and license terms set forth in the applicable Government contract, and, to the extent
applicable by the terms of the Government contract, the additional rights set forth in FAR 52.227-19, Commercial Computer Software License (December 2007).
Oracle America, Inc., 500 Oracle Parkway, Redwood City, CA 94065.
Hazardous Applications Notice
This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently
dangerous applications, including applications that may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall
be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its aliates disclaim any
liability for any damages caused by use of this software or hardware in dangerous applications.
Trademark Notice
Oracle and Java are registered trademarks of Oracle and/or its aliates. Other names may be trademarks of their respective owners.
Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered
trademarks of SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro
Devices. UNIX is a registered trademark of The Open Group in the United States and other countries.
Third Party Content, Products, and Services Disclaimer
This software or hardware and documentation may provide access to or information on content, products, and services from third parties. Oracle Corporation and
its aliates are not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services. Oracle Corporation
and its aliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services.
Ce logiciel et la documentation qui l’accompagne sont protégés par les lois sur la propriété intellectuelle. Ils sont concédés sous licence et soumis à des restrictions
d’utilisation et de divulgation. Sauf disposition de votre contrat de licence ou de la loi, vous ne pouvez pas copier, reproduire, traduire, diuser, modier, breveter,
transmettre, distribuer, exposer, exécuter, publier ou acher le logiciel, même partiellement, sous quelque forme et par quelque procédé que ce soit. Par ailleurs, il est
interdit de procéder à toute ingénierie inverse du logiciel, de le désassembler ou de le décompiler, excepté à des ns d’interopérabilité avec des logiciels tiers ou tel que
prescrit par la loi.
Les informations fournies dans ce document sont susceptibles de modication sans préavis. Par ailleurs, Oracle Corporation ne garantit pas qu’elles soient exemptes
d’erreurs et vous invite, le cas échéant, à lui en faire part par écrit.
Si ce logiciel, ou la documentation qui l’accompagne, est concédé sous licence au Gouvernement des Etats-Unis, ou à toute entité qui délivre la licence de ce logiciel
ou l’utilise pour le compte du Gouvernement des Etats-Unis, la notice suivante s’applique :
U.S. GOVERNMENT RIGHTS. Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers are
"commercial computer software" or "commercial technical data" pursuant to the applicable Federal Acquisition Regulation and agency-specic supplemental
regulations. As such, the use, duplication, disclosure, modication, and adaptation shall be subject to the restrictions and license terms set forth in the applicable
Government contract, and, to the extent applicable by the terms of the Government contract, the additional rights set forth in FAR 52.227-19, Commercial
Computer Software License (December 2007). Oracle America, Inc., 500 Oracle Parkway, Redwood City, CA 94065.
Ce logiciel ou matériel a été développé pour un usage général dans le cadre d’applications de gestion des informations. Ce logiciel ou matériel n’est pas conçu ni n’est
destiné à être utilisé dans des applications à risque, notamment dans des applications pouvant causer des dommages corporels. Si vous utilisez ce logiciel ou matériel
dans le cadre d’applications dangereuses, il est de votre responsabilité de prendre toutes les mesures de secours, de sauvegarde, de redondance et autres mesures
nécessaires à son utilisation dans des conditions optimales de sécurité. Oracle Corporation et ses aliés déclinent toute responsabilité quant aux dommages causés
par l’utilisation de ce logiciel ou matériel pour ce type d’applications.
Oracle et Java sont des marques déposées d’Oracle Corporation et/ou de ses aliés.Tout autre nom mentionné peut correspondre à des marques appartenant à
d’autres propriétaires qu’Oracle.
AMD, Opteron, le logo AMD et le logo AMD Opteron sont des marques ou des marques déposées d’Advanced Micro Devices. Intel et Intel Xeon sont des marques ou
des marques déposées d’Intel Corporation. Toutes les marques SPARC sont utilisées sous licence et sont des marques ou des marques déposées de SPARC
International, Inc. UNIX est une marque déposée concédé sous license par X/Open Company, Ltd.
130129@25097
Contents
Preface .....................................................................................................................................................5
1 Installing and Maintaining a SCSI RAID Storage Device ............................................................... 11
Restrictions and Requirements .......................................................................................................... 11
Installing Storage Arrays .................................................................................................................... 12
How to Install a Storage Array in a New Cluster ...................................................................... 12
How to Add a Storage Array to an Existing Cluster ................................................................. 16
Conguring Storage Arrays ............................................................................................................... 22
How to Create a LUN ................................................................................................................... 22
How to Delete a LUN ................................................................................................................... 25
How to Reset the LUN Conguration ....................................................................................... 27
How to Correct Mismatched Device ID Numbers ................................................................... 29
Maintaining Storage Arrays ............................................................................................................... 31
FRUs That Do Not Require Oracle Solaris Cluster Maintenance Procedures ...................... 32
How to Remove a Storage Array ................................................................................................ 34
How to Replace a Failed Controller or Restore an Oine Controller ................................... 37
How to Upgrade Controller Module Firmware ....................................................................... 39
How to Add a Disk Drive ............................................................................................................ 40
How to Replace a Disk Drive ...................................................................................................... 41
How to Remove a Disk Drive ...................................................................................................... 43
How to Upgrade Disk Drive Firmware ..................................................................................... 44
How to Replace a Host Adapter .................................................................................................. 44
A Cabling Diagrams ................................................................................................................................49
Sun StorEdge A1000 and Netra st A1000 Cabling Diagrams ......................................................... 49
Installing a Sun StorEdge A1000 or Netra st A1000 Storage Array ........................................ 49
Sun StorEdge A3500 Cabling Diagrams ........................................................................................... 51
3
Installing a Sun StorEdge A3500 Storage System ..................................................................... 51
Adding a Sun StorEdge A3500 Storage System ........................................................................ 51
Index ......................................................................................................................................................53
Contents
Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual
May 2011, Revision A
4
Preface
The Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge
A3500 System Manual provides procedures specic to SCSI RAID storage devices that use
Oracle's Sun StorEdge RAID Manager software in an Oracle Solaris Clusterenvironment.
Note In this document, references to Oracle Real Application Clusters also apply to Oracle
Parallel Server, unless otherwise stated.
Who Should UseThis Book
This book is for Oracle representatives who are performing the initial installation of an Oracle
Solaris Cluster conguration and for system administrators who are responsible for
maintaining the system.
This document is intended for experienced system administrators with extensive knowledge of
Oracle software and hardware. Do not use this document as a planning or a pre-sales guide. You
should have already determined your system requirements and purchased the appropriate
equipment and software before reading this document.
HowThis Book Is Organized
This book contains the following:
Chapter 1, “Installing and Maintaining a SCSI RAID Storage Device, contains procedures
about installing, conguring, and maintaining SCSI RAID storage devices that use RAID
Manager software.
Appendix A, “Cabling Diagrams, contains cabling diagrams for the various storage devices.
5
Revision History
The following table lists the information that has been revised or added since the initial release
of this documentation. The table also lists the revision date for these changes.
TABLE P–1 Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge
A3500 System Manual
Revision Date New Information
January 2009 Update links in the Preface to other books and to Sun Cluster documentation.
September 2010 Update product name throughout book and remove old CLI commands for 3.3 release.
May 2011 Changed links to point to Oracle sites for 3.3 5/11 release.
Related Documentation
The following books provide conceptual information or procedures to administer hardware
and applications. If you plan to use this documentation in a hardcopy format, ensure that you
have these books available for your reference.
The following books support the Oracle Solaris Cluster 3.3 release. You can also access the
documentation for the Sun Cluster 3.1 and 3.2 releases. All Sun Cluster and Oracle Solaris
Cluster documentation is available at
http://www.oracle.com/technetwork/indexes/
documentation/index.html
.
The related books are organized by the following products and subjects:
Storage Array and Storage System patches
Solaris I/O Multipathing and Sun StorEdge RAID Manager
Sun StorEdge A1000 and Netra st A1000 Storage Array
Sun StorEdge A3500 system
Oracle Solaris Cluster and Sun Cluster Documentation
TABLE P–2 Storage Array and Storage System Patches
Title
Sun StorEdge A1000/Sun StorEdgeA3x00/Sun StorEdge A3500FC/Sun StorEdge Software/Firmware
Conguration Matrix 1.61
Log into My Oracle Support to view this Technical Instruction.
Preface
Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual
May 2011, Revision A
6
TABLE P–3 Solaris I/O multipathing and Sun StorEdge RAID Manager
Title Part Number
Sun StorEdge RAID Manager 6.22.1 Release Notes 805-7758–14
Sun StorEdge RAID Manager 6.22 User's Guide 806-0478-10
Solaris Fibre Channel Storage Conguration and Multipathing Support Guide 819-0139
TABLE P–4 Sun StorEdge A1000 and Netra st A1000 Storage Array
Title Part Number
OpenBoot 2.x Command Reference Manual 806-2906-10
Netra st A1000/D1000 Installation and Maintenance Manual 805-7147
Sun StorEdge A1000 and D1000 Installation, Operations, and Service Manual 805-2624
Sun StorEdge D1000 Storage Guide 805-4013
TABLE P–5 Sun StorEdge A3500 Storage System
Title Part Number
OpenBoot 2.x Command Reference Manual 806-2906-10
Sun StorEdge A3500/A3500FC Hardware Conguration Guide 805-4981
TABLE P–6 Oracle Solaris Cluster and Sun Cluster Documentation
Documentation
Oracle Solaris Cluster 3.3
Sun Cluster 3.2
Sun Cluster 3.1
Using UNIX Commands
This document contains information about commands that are used to install, congure, or
upgrade an Oracle Solaris Cluster conguration. This document might not contain complete
information about basic UNIX commands and procedures such as shutting down the system,
booting the system, and conguring devices.
See one or more of the following sources for this information:
Online documentation for the Oracle Solaris Operating System (Oracle Solaris OS)
Other software documentation that you received with your system
Preface
7
Oracle Solaris Operating System man pages
Getting Help
If you have problems installing or using Oracle Solaris Cluster, contact your service provider
and provide the following information.
Your name and email address (if available)
Your company name, address, and phone number
The model number and serial number of your systems
The release number of the operating environment (for example, Oracle Solaris 10)
The release number of Oracle Solaris Cluster (for example, Oracle Solaris Cluster 3.3)
Use the following commands to gather information about your system for your service
provider.
Command Function
prtconf -v Displays the size of the system memory and reports information
about peripheral devices
psrinfo -v Displays information about processors
showrev -p Reports which patches are installed
prtdiag -v Displays system diagnostic information
/usr/cluster/bin/clnode show-rev Displays Oracle Solaris Cluster release and package version
information for each node
Also have available the contents of the /var/adm/messages le.
Documentation and Support
See the following web sites for additional resources:
Documentation (http://www.oracle.com/technetwork/indexes/documentation/
index.html)
Support (http://www.oracle.com/us/support/systems/index.html)
Preface
Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual
May 2011, Revision A
8
Oracle Software Resources
Oracle Technology Network (http://www.oracle.com/technetwork/index.html) oers a
range of resources related to Oracle software:
Discuss technical problems and solutions on the Discussion Forums
(http://forums.oracle.com)
.
Get hands-on step-by-step tutorials with Oracle By Example (http://www.oracle.com/
technetwork/tutorials/index.html)
.
Typographic Conventions
The following table describes the typographic conventions that are used in this book.
TABLE P–7 Typographic Conventions
Typeface Meaning Example
AaBbCc123 The names of commands, les, and directories,
and onscreen computer output
Edit your .login le.
Use ls -a to list all les.
machine_name% you have mail.
AaBbCc123 What you type, contrasted with onscreen
computer output
machine_name% su
Password:
aabbcc123 Placeholder: replace with a real name or value The command to remove a le is rm
lename.
AaBbCc123 Book titles, new terms, and terms to be
emphasized
Read Chapter 6 in the User's Guide.
A cache is a copy that is stored
locally.
Do not save the le.
Note: Some emphasized items
appear bold online.
Shell Prompts in Command Examples
The following table shows the default UNIX system prompt and superuser prompt for shells
that are included in the Oracle Solaris OS. Note that the default system prompt that is displayed
in command examples varies, depending on the Oracle Solaris release.
Preface
9
TABLE P–8 Shell Prompts
Shell Prompt
Bash shell, Korn shell, and Bourne shell $
Bash shell, Korn shell, and Bourne shell for superuser #
C shell machine_name%
C shell for superuser machine_name#
Preface
Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual
May 2011, Revision A
10
Installing and Maintaining a SCSI RAID Storage
Device
This chapter describes the procedures about how to install, congure, and maintain SCSI RAID
storage devices that use Sun StorEdge RAID Manager software in an Oracle Solaris Cluster
environment.
The procedures in this chapter apply to the following SCSI RAID storage devices:
Oracle's Netra st A1000 array
Oracle's Sun StorEdge A1000 array
Oracle's Sun StorEdge A3500 system
This chapter contains the following sections:
“Restrictions and Requirements” on page 11
“Installing Storage Arrays” on page 12
“Conguring Storage Arrays” on page 22
“Maintaining Storage Arrays” on page 31
Restrictions and Requirements
This section includes only restrictions and support information that have a direct impact on the
procedures in this chapter. For general support information, contact your Oracle service
provider.
RAID Manager software 6.22.1 or later version is required.
(StorEdge A3500 Only) Do not use LUNs as quorum devices.
1
CHAPTER 1
11
Installing Storage Arrays
This section contains the instructions for installing storage arrays both in new clusters and
existing clusters.
TABLE 1–1 Task Map: Installing Storage Arrays
Task Information
Install an array in a new cluster, before the OS and
Oracle Solaris Cluster software are installed.
“How to Install a Storage Array in a New Cluster” on
page 12
Add an array to an operational cluster. “How to Add a Storage Array to an Existing Cluster”
on page 16
How to Install a Storage Array in a New Cluster
This procedure assumes you are installing one or more storage arrays at initial installation of a
cluster.
This procedure uses an updated method for setting the scsi-initiator-id. The method that
was published in earlier documentation is still applicable. However, if your cluster
conguration uses a Sun StorEdge PCI Dual Ultra3 SCSI host adapter to connect to any other
shared storage, you need to update your nvramrc script and set the scsi-initiator-id by
following this procedure.
Before performing this procedure, ensure that you have met the following prerequisites. This
procedure relies on the following prerequisites and assumptions.
You have read the entire procedure.
You can access necessary patches, drivers, software packages, and hardware.
Your nodes are powered o or are at the OpenBoot PROM.
Your arrays are powered o.
Your interconnect hardware is connected to the nodes in your cluster.
No software is installed.
Install the host adapters in the nodes that connect to the storage arrays.
For the procedure about how to install host adapters, see the documentation that shipped with
your host adapters and nodes.
Cable the storage arrays.
For cabling diagrams, see
Appendix A, “Cabling Diagrams.
BeforeYou Begin
1
2
Installing Storage Arrays
Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual
May 2011, Revision A
12
Ensure that each device in the SCSI chain has a unique SCSI address.
To avoid SCSI-chain conicts, the following steps instruct you to reserve SCSI address 7 for one
host adapter in the SCSI chain and change the other host adapter's global scsi-initiator-id
to an available SCSI address. Then the steps instruct you to change the scsi-initiator-id for
local devices back to 7.
Note A slot in the storage array might not be in use. However, do not set the
scsi-initiator-id to a SCSI address for that disk slot. This precaution minimizes future
complications if you install additional disk drives.
a. If necessary, power on the storage devices.
Note If necessary, halt the nodes so that you can perform OpenBoot PROM (OBP) Monitor
tasks at the ok prompt.
For the procedure about powering on a storage device, see the service manual that shipped
with your storage device.
b. If necessary, power on a node, but do not allow it to boot. If necessary, halt the system to
continue with OBP Monitor tasks.
c. Set the scsi-initiator-id for one node to 6.
{1} ok setenv scsi-initiator-id 6
scsi-initiator-id = 6
d. Find the paths to the host adapters that connect to the local disk drives.
{0} ok show-disks
Use this information to change the SCSI addresses in the nvramrc script. Do not include the
/sd directories in the device paths.
e. Edit the nvramrc script to set the scsi-initiator-id for the local devices on the rst node
to 7.
For a full list of commands, see the
OpenBoot 2.x Command Reference Manual.
Caution Insert exactly one space after the rst double quote and before
scsi-initiator-id.
{0} ok nvedit
0: probe-all
1: cd /pci@1f,4000/scsi@2
2: 7 encode-int " scsi-initiator-id" property
3: device-end
4: cd /pci@1f,4000/scsi@3
3
Installing Storage Arrays
Chapter 1 • Installing and Maintaining a SCSI RAID Storage Device 13
5: 7 encode-int " scsi-initiator-id" property
6: device-end
7: install-console
8: banner[Control C]
{0} ok
f. Store the changes.
The changes you make through the nvedit command are recorded on a temporary copy of
the nvramrc script. You can continue to edit this copy without risk. After you complete your
edits, save the changes. If you are not sure about the changes, discard them.
To store the changes, type the following command:
{0} ok nvstore
{1} ok
To discard the changes, type the following command:
{0} ok nvquit
{1} ok
g. Verify the contents of the nvramrc script that you created, as shown in the following
example.
If the contents of the nvramrc script are incorrect, use the nvedit command to make
corrections.
{0} ok printenv nvramrc
nvramrc = probe-all
cd /pci@1f,4000/scsi@2
7 " scsi-initiator-id" integer-property
device-end
cd /pci@1f,4000/scsi@3
7 " scsi-initiator-id" integer-property
device-end
install-console
banner
{1} ok
h. Instruct the OpenBoot PROM (OBP) Monitor to use the nvramrc script, as shown in the
following example.
{0} ok setenv use-nvramrc? true
use-nvramrc? = true
{1} ok
Verify that the scsi-initiator-id is set correctly on the second node.
a. If necessary, power on the second node, but do not allow it to boot. If necessary, halt the
system to continue with OBP Monitor tasks.
4
Installing Storage Arrays
Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual
May 2011, Revision A
14
b. Verify that the scsi-initiator-id for each host adapter on the second node is set to 7.
Use the show-disks command to nd the paths to the host adapters that are connected to
these enclosures. Select each host adapter's device tree node, and display the node's
properties to conrm that the scsi-initiator-id for each host adapter is set to 7.
{0} ok cd /pci@6,4000/pci@3/scsi@5
{0} ok .properties
scsi-initiator-id 00000007
...
Install the Solaris Operating System, then apply any required Solaris patches.
For the most current list of patches, see
My Oracle Support.
Read the following two conditions carefully to determine whether you must reboot the nodes.
If you are using a version of RAID Manager later than 6.22, proceed to Step 7.
If you are using a version of the Solaris Operating System earlier than Solaris 8 Update 4,
proceed to
Step 7.
If you are using RAID Manager 6.22 and the Solaris 8 Update 4 or later operating
environment, reboot both nodes.
# reboot
Install the RAID Manager software.
For the procedure about how to install the RAID Manager software, see the Sun StorEdge RAID
Manager User’s Guide.
For the required version of the RAID Manager software that Oracle Solaris Cluster software
supports, see
“Restrictions and Requirements” on page 11.
Install patches for the controller modules and RAID Manager software.
For the most current list of patches, see
My Oracle Support.
Check the NVSRAM le revision for the storage arrays. If necessary, install the most recent
revision.
For the NVSRAM le revision number, boot level, and procedure about how to upgrade the
NVSRAM le, see the Sun StorEdge RAID Manager Release Notes.
Check the controller module rmware revision for the storage arrays. If necessary, install the
most recent revision.
For the rmware revision number and boot level, see the Sun StorEdge RAID Manager Release
Notes. For the procedure about how to upgrade the rmware, see the Sun StorEdge RAID
Manager User’s Guide.
5
6
7
8
9
10
Installing Storage Arrays
Chapter 1 • Installing and Maintaining a SCSI RAID Storage Device 15
Set the Rdac parameters in the /etc/osa/rmparams le on both nodes.
Rdac_RetryCount=1
Rdac_NoAltOffline=TRUE
Ensure that the controller module is set to active/active mode.
For more information about controller modes, see the Sun StorEdge RAID Manager Installation
and Support Guide and the Sun StorEdge RAID Manager User’s Guide.
Set up the storage arrays with logical unit numbers (LUNs) and hot spares.
For the procedure about how to set up the storage array with LUNs and hot spares, see the Sun
StorEdge RAID Manager User’s Guide.
Note Use the format command to verify Solaris logical device names.
Copy the /etc/raid/rdac_address le from the node on which you created the LUNs to the
other node. If you copy this le to the other node, you ensure consistency across both nodes.
Ensure that the new logical name for the LUN that you created in
Step 13 appears in the
/dev/rdsk directory on both nodes.
# /etc/raid/bin/hot_add
To continue with Oracle Solaris Cluster software and data services installation tasks, see your
Oracle Solaris Cluster software installation documentation and the Oracle Solaris Cluster data
services developer's documentation. For a list of Oracle Solaris Cluster documentation, see
“Related Documentation” on page 6.
How to Add a Storage Array to an Existing Cluster
Use this procedure to add a storage device to an existing cluster. If you need to install a storage
device in a new cluster, use the procedure in
“How to Install a Storage Array in a New Cluster”
on page 12
.
You might want to perform this procedure in the following scenarios.
You need to increase available storage.
You need to upgrade to a higher-quality or larger storage array.
To upgrade storage arrays, remove the old storage array and then add the new storage array.
To replace a storage array with the same type of storage array, use this procedure.
11
12
13
14
15
See Also
Installing Storage Arrays
Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual
May 2011, Revision A
16
This procedure relies on the following prerequisites and assumptions.
Your cluster is operational.
This procedure denes Node A as the node with which you begin working. Node B is the
remaining node.
This procedure uses an updated method for setting the scsi-initiator-id. For this
storage array, the method that was published in earlier documentation is still applicable.
However, if your cluster conguration uses a Sun StorEdge PCI Dual Ultra3 SCSI host
adapter to connect to any other shared storage, you need to update your nvramrc script and
set the scsi-initiator-id by using this procedure.
This procedure provides the long forms of the Oracle Solaris Cluster commands. Most
commands also have short forms. Except for the forms of the command names, the commands
are identical.
To perform this procedure, become superuser or assume a role that provides
solaris.cluster.read RBAC (role-based access control) authorization.
Install the RAID Manager software.
For the required version of the RAID Manager software that Oracle Solaris Cluster software
supports, see
“Restrictions and Requirements” on page 11.
For the procedure about how to install RAID Manager software, see the Sun StorEdge RAID
Manager Installation and Support Guide.
For the most current list of software, rmware, and patches that your storage array or
storage system requires, refer to the appropriate EarlyNotier that is outlined in
“Related
Documentation” on page 6
. This document is available online to Oracle service providers
and to customers with service contracts at
My Oracle Support.
Install the storage array or storage system patches.
For the location of patches and installation instructions, see your Oracle Solaris Cluster release
notes documentation. For a list of Oracle Solaris Cluster documentation, see
“Related
Documentation” on page 6
.
Set the Rdac parameters in the /etc/osa/rmparams le.
Rdac_RetryCount=1
Rdac_NoAltOffline=TRUE
Power on the storage array or storage system.
For the procedure about how to power on the storage array or storage system, see your storage
documentation. For a list of storage documentation, see
“Related Documentation” on page 6.
If you are not installing new host adapters in your nodes, skip to
Step 8.
BeforeYou Begin
1
2
3
4
5
Installing Storage Arrays
Chapter 1 • Installing and Maintaining a SCSI RAID Storage Device 17
If you are installing new host adapters in your nodes, shut down and power o Node A.
For the procedure about how to shut down and power o a node, see your Oracle Solaris
Cluster system administration documentation. For a list of Oracle Solaris Cluster
documentation, see
“Related Documentation” on page 6.
Install the host adapters in Node A.
For the procedure about how to install host adapters, see the documentation that shipped with
your host adapters and nodes.
Cable the storage array or storage system to Node A.
For cabling diagrams, see
Appendix A, “Cabling Diagrams.
Ensure that each device in the SCSI chain has a unique SCSI address.
To avoid SCSI-chain conicts, the following steps instruct you to reserve SCSI address 7 for one
host adapter in the SCSI chain and change the other host adapter's global scsi-initiator-id
to an available SCSI address. Then the steps instruct you to change the scsi-initiator-id for
local devices back to 7.
Note A slot in the storage array might not be in use. However, do not set the
scsi-initiator-id to a SCSI address for that disk slot. This precaution minimizes future
complications if you install additional disk drives.
a. If necessary, power on the storage devices.
Note If necessary, halt the nodes so that you can perform OpenBoot PROM (OBP) Monitor
tasks at the ok prompt.
For the procedure about powering on a storage device, see the service manual that shipped
with your storage device.
b. If necessary, power on a node, but do not allow it to boot. If necessary, halt the system to
continue with OBP Monitor tasks.
c. Set the scsi-initiator-id for one node to 6.
{1} ok setenv scsi-initiator-id 6
scsi-initiator-id = 6
d. Find the paths to the host adapters that connect to the local disk drives.
{0} ok show-disks
Use this information to change the SCSI addresses in the nvramrc script. Do not include the
/sd directories in the device paths.
6
7
8
9
Installing Storage Arrays
Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual
May 2011, Revision A
18
e. Edit the nvramrc script to set the scsi-initiator-id for the local devices on the rst node
to 7.
For a full list of commands, see the
OpenBoot 2.x Command Reference Manual.
Caution Insert exactly one space after the rst double quote and before
scsi-initiator-id.
{0} ok nvedit
0: probe-all
1: cd /pci@1f,4000/scsi@2
2: 7 encode-int " scsi-initiator-id" property
3: device-end
4: cd /pci@1f,4000/scsi@3
5: 7 encode-int " scsi-initiator-id" property
6: device-end
7: install-console
8: banner[Control C]
{0} ok
f. Store the changes.
The changes you make through the nvedit command are recorded on a temporary copy of
the nvramrc script. You can continue to edit this copy without risk. After you complete your
edits, save the changes. If you are not sure about the changes, discard them.
To store the changes, type the following command:
{0} ok nvstore
{1} ok
To discard the changes, type the following command:
{0} ok nvquit
{1} ok
g. Verify the contents of the nvramrc script that you created, as shown in the following
example.
If the contents of the nvramrc script are incorrect, use the nvedit command to make
corrections.
{0} ok printenv nvramrc
nvramrc = probe-all
cd /pci@1f,4000/scsi@2
7 " scsi-initiator-id" integer-property
device-end
cd /pci@1f,4000/scsi@3
7 " scsi-initiator-id" integer-property
device-end
install-console
banner
{1} ok
Installing Storage Arrays
Chapter 1 • Installing and Maintaining a SCSI RAID Storage Device 19
h. Instruct the OpenBoot PROM (OBP) Monitor to use the nvramrc script, as shown in the
following example.
{0} ok setenv use-nvramrc? true
use-nvramrc? = true
{1} ok
If you are not installing new host adapters in Node B,skiptoStep 13.
If you are installing new host adapters in Node B to connect Node B to the storage array or
storage system, shut down and power o the node.
For the procedure about how to shut down and power o a node, see your Oracle Solaris
Cluster system administration documentation. For a list of Oracle Solaris Cluster
documentation, see
“Related Documentation” on page 6.
Install the host adapters in Node B.
For the procedure about how to install host adapters, see the documentation that shipped with
your nodes.
Cable the storage array or storage system to Node B.
For cabling diagrams, see
“Adding a Sun StorEdge A3500 Storage System” on page 51.
If you did not power o Node B to install a host adapter, skip to
Step 17.
If you powered o Node B to install a host adapter, power on Node B and the storage array or
storage system.
Do not enable the node to boot. If necessary, halt the system to continue with OpenBoot PROM
(OBP) Monitor tasks.
Verify that Node B recognizes the new host adapters and disk drives.
If the node does not recognize the new hardware, check all hardware connections and repeat the
installation steps you performed in
Step 12.
{0} ok show-disks
...
b) /sbus@6,0/QLGC,isp@2,10000/sd...
d) /sbus@2,0/QLGC,isp@2,10000/sd...{0} ok
Verify that the scsi-initiator-id is set correctly on the second node.
a. If necessary, power on the second node, but do not allow it to boot. If necessary, halt the
system to continue with OBP Monitor tasks.
10
11
12
13
14
15
16
17
Installing Storage Arrays
Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual
May 2011, Revision A
20
  • Page 1 1
  • Page 2 2
  • Page 3 3
  • Page 4 4
  • Page 5 5
  • Page 6 6
  • Page 7 7
  • Page 8 8
  • Page 9 9
  • Page 10 10
  • Page 11 11
  • Page 12 12
  • Page 13 13
  • Page 14 14
  • Page 15 15
  • Page 16 16
  • Page 17 17
  • Page 18 18
  • Page 19 19
  • Page 20 20
  • Page 21 21
  • Page 22 22
  • Page 23 23
  • Page 24 24
  • Page 25 25
  • Page 26 26
  • Page 27 27
  • Page 28 28
  • Page 29 29
  • Page 30 30
  • Page 31 31
  • Page 32 32
  • Page 33 33
  • Page 34 34
  • Page 35 35
  • Page 36 36
  • Page 37 37
  • Page 38 38
  • Page 39 39
  • Page 40 40
  • Page 41 41
  • Page 42 42
  • Page 43 43
  • Page 44 44
  • Page 45 45
  • Page 46 46
  • Page 47 47
  • Page 48 48
  • Page 49 49
  • Page 50 50
  • Page 51 51
  • Page 52 52
  • Page 53 53
  • Page 54 54
  • Page 55 55
  • Page 56 56

Oracle Solaris Cluster 3.3 System Manual

Category
Software
Type
System Manual

Ask a question and I''ll find the answer in the document

Finding information in a document is now easier with AI