Oracle Solaris Cluster 3.3 System Manual

Brand: Oracle

Model: Solaris Cluster 3.3

Category: Software

Type: System Manual

Oracle® Solaris Cluster 3.3 With StorEdge

A1000 Array, Netra st A1000 Array, or

StorEdge A3500 System Manual

For Solaris OS (SPARC Platform Edition)

Part No: E22718

May 2011, Revision A

License Restrictions Warranty/Consequential Damages Disclaimer

This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual

property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license,

transmit, distribute, exhibit, perform, publish or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software,

unless required by law for interoperability, is prohibited.

Warranty Disclaimer

The information contained herein is subject to change without notice and is not warranted to be error-free. If you nd any errors, please report them to us in writing.

Restricted Rights Notice

If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, the following notice is

applicable:

U.S. GOVERNMENT RIGHTS

Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers are "commercial computer software" or

"commercial technical data" pursuant to the applicable Federal Acquisition Regulation and agency-specic supplemental regulations. As such, the use, duplication,

disclosure, modication, and adaptation shall be subject to the restrictions and license terms set forth in the applicable Government contract, and, to the extent

applicable by the terms of the Government contract, the additional rights set forth in FAR 52.227-19, Commercial Computer Software License (December 2007).

Oracle America, Inc., 500 Oracle Parkway, Redwood City, CA 94065.

Hazardous Applications Notice

This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently

dangerous applications, including applications that may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall

be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its aliates disclaim any

liability for any damages caused by use of this software or hardware in dangerous applications.

Trademark Notice

Oracle and Java are registered trademarks of Oracle and/or its aliates. Other names may be trademarks of their respective owners.

Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered

trademarks of SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro

Devices. UNIX is a registered trademark of The Open Group in the United States and other countries.

Third Party Content, Products, and Services Disclaimer

This software or hardware and documentation may provide access to or information on content, products, and services from third parties. Oracle Corporation and

its aliates are not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services. Oracle Corporation

and its aliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services.

Ce logiciel et la documentation qui l’accompagne sont protégés par les lois sur la propriété intellectuelle. Ils sont concédés sous licence et soumis à des restrictions

d’utilisation et de divulgation. Sauf disposition de votre contrat de licence ou de la loi, vous ne pouvez pas copier, reproduire, traduire, diuser, modier, breveter,

transmettre, distribuer, exposer, exécuter, publier ou acher le logiciel, même partiellement, sous quelque forme et par quelque procédé que ce soit. Par ailleurs, il est

interdit de procéder à toute ingénierie inverse du logiciel, de le désassembler ou de le décompiler, excepté à des ns d’interopérabilité avec des logiciels tiers ou tel que

prescrit par la loi.

Les informations fournies dans ce document sont susceptibles de modication sans préavis. Par ailleurs, Oracle Corporation ne garantit pas qu’elles soient exemptes

d’erreurs et vous invite, le cas échéant, à lui en faire part par écrit.

Si ce logiciel, ou la documentation qui l’accompagne, est concédé sous licence au Gouvernement des Etats-Unis, ou à toute entité qui délivre la licence de ce logiciel

ou l’utilise pour le compte du Gouvernement des Etats-Unis, la notice suivante s’applique :

U.S. GOVERNMENT RIGHTS. Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers are

"commercial computer software" or "commercial technical data" pursuant to the applicable Federal Acquisition Regulation and agency-specic supplemental

regulations. As such, the use, duplication, disclosure, modication, and adaptation shall be subject to the restrictions and license terms set forth in the applicable

Government contract, and, to the extent applicable by the terms of the Government contract, the additional rights set forth in FAR 52.227-19, Commercial

Computer Software License (December 2007). Oracle America, Inc., 500 Oracle Parkway, Redwood City, CA 94065.

Ce logiciel ou matériel a été développé pour un usage général dans le cadre d’applications de gestion des informations. Ce logiciel ou matériel n’est pas conçu ni n’est

destiné à être utilisé dans des applications à risque, notamment dans des applications pouvant causer des dommages corporels. Si vous utilisez ce logiciel ou matériel

dans le cadre d’applications dangereuses, il est de votre responsabilité de prendre toutes les mesures de secours, de sauvegarde, de redondance et autres mesures

nécessaires à son utilisation dans des conditions optimales de sécurité. Oracle Corporation et ses aliés déclinent toute responsabilité quant aux dommages causés

par l’utilisation de ce logiciel ou matériel pour ce type d’applications.

Oracle et Java sont des marques déposées d’Oracle Corporation et/ou de ses aliés.Tout autre nom mentionné peut correspondre à des marques appartenant à

d’autres propriétaires qu’Oracle.

AMD, Opteron, le logo AMD et le logo AMD Opteron sont des marques ou des marques déposées d’Advanced Micro Devices. Intel et Intel Xeon sont des marques ou

des marques déposées d’Intel Corporation. Toutes les marques SPARC sont utilisées sous licence et sont des marques ou des marques déposées de SPARC

International, Inc. UNIX est une marque déposée concédé sous license par X/Open Company, Ltd.

130129@25097

Contents

Preface .....................................................................................................................................................5

1 Installing and Maintaining a SCSI RAID Storage Device ............................................................... 11

Restrictions and Requirements .......................................................................................................... 11

Installing Storage Arrays .................................................................................................................... 12

▼ How to Install a Storage Array in a New Cluster ...................................................................... 12

▼ How to Add a Storage Array to an Existing Cluster ................................................................. 16

Conguring Storage Arrays ............................................................................................................... 22

▼ How to Create a LUN ................................................................................................................... 22

▼ How to Delete a LUN ................................................................................................................... 25

▼ How to Reset the LUN Conguration ....................................................................................... 27

▼ How to Correct Mismatched Device ID Numbers ................................................................... 29

Maintaining Storage Arrays ............................................................................................................... 31

FRUs That Do Not Require Oracle Solaris Cluster Maintenance Procedures ...................... 32

▼ How to Remove a Storage Array ................................................................................................ 34

▼ How to Replace a Failed Controller or Restore an Oine Controller ................................... 37

▼ How to Upgrade Controller Module Firmware ....................................................................... 39

▼ How to Add a Disk Drive ............................................................................................................ 40

▼ How to Replace a Disk Drive ...................................................................................................... 41

▼ How to Remove a Disk Drive ...................................................................................................... 43

How to Upgrade Disk Drive Firmware ..................................................................................... 44

▼ How to Replace a Host Adapter .................................................................................................. 44

A Cabling Diagrams ................................................................................................................................49

Sun StorEdge A1000 and Netra st A1000 Cabling Diagrams ......................................................... 49

Installing a Sun StorEdge A1000 or Netra st A1000 Storage Array ........................................ 49

Sun StorEdge A3500 Cabling Diagrams ........................................................................................... 51

Installing a Sun StorEdge A3500 Storage System ..................................................................... 51

Adding a Sun StorEdge A3500 Storage System ........................................................................ 51

Index ......................................................................................................................................................53

Contents

Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual

• May 2011, Revision A

Preface

The Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge

A3500 System Manual provides procedures specic to SCSI RAID storage devices that use

Oracle's Sun StorEdge RAID Manager software in an Oracle Solaris Clusterenvironment.

Note – In this document, references to Oracle Real Application Clusters also apply to Oracle

Parallel Server, unless otherwise stated.

Who Should UseThis Book

This book is for Oracle representatives who are performing the initial installation of an Oracle

Solaris Cluster conguration and for system administrators who are responsible for

maintaining the system.

This document is intended for experienced system administrators with extensive knowledge of

Oracle software and hardware. Do not use this document as a planning or a pre-sales guide. You

should have already determined your system requirements and purchased the appropriate

equipment and software before reading this document.

HowThis Book Is Organized

This book contains the following:

■

Chapter 1, “Installing and Maintaining a SCSI RAID Storage Device,” contains procedures

about installing, conguring, and maintaining SCSI RAID storage devices that use RAID

Manager software.

■

Appendix A, “Cabling Diagrams,” contains cabling diagrams for the various storage devices.

Revision History

The following table lists the information that has been revised or added since the initial release

of this documentation. The table also lists the revision date for these changes.

TABLE P–1 Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge

A3500 System Manual

Revision Date New Information

January 2009 Update links in the Preface to other books and to Sun Cluster documentation.

September 2010 Update product name throughout book and remove old CLI commands for 3.3 release.

May 2011 Changed links to point to Oracle sites for 3.3 5/11 release.

Related Documentation

The following books provide conceptual information or procedures to administer hardware

and applications. If you plan to use this documentation in a hardcopy format, ensure that you

have these books available for your reference.

The following books support the Oracle Solaris Cluster 3.3 release. You can also access the

documentation for the Sun Cluster 3.1 and 3.2 releases. All Sun Cluster and Oracle Solaris

Cluster documentation is available at

http://www.oracle.com/technetwork/indexes/

documentation/index.html

The related books are organized by the following products and subjects:

■

Storage Array and Storage System patches

■

Solaris I/O Multipathing and Sun StorEdge RAID Manager

■

Sun StorEdge A1000 and Netra st A1000 Storage Array

■

Sun StorEdge A3500 system

■

Oracle Solaris Cluster and Sun Cluster Documentation

TABLE P–2 Storage Array and Storage System Patches

Title

Sun StorEdge A1000/Sun StorEdgeA3x00/Sun StorEdge A3500FC/Sun StorEdge Software/Firmware

Conguration Matrix 1.61

Log into My Oracle Support to view this Technical Instruction.

Preface

Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual

• May 2011, Revision A

TABLE P–3 Solaris I/O multipathing and Sun StorEdge RAID Manager

Title Part Number

Sun StorEdge RAID Manager 6.22.1 Release Notes 805-7758–14

Sun StorEdge RAID Manager 6.22 User's Guide 806-0478-10

Solaris Fibre Channel Storage Conguration and Multipathing Support Guide 819-0139

TABLE P–4 Sun StorEdge A1000 and Netra st A1000 Storage Array

Title Part Number

OpenBoot 2.x Command Reference Manual 806-2906-10

Netra st A1000/D1000 Installation and Maintenance Manual 805-7147

Sun StorEdge A1000 and D1000 Installation, Operations, and Service Manual 805-2624

Sun StorEdge D1000 Storage Guide 805-4013

TABLE P–5 Sun StorEdge A3500 Storage System

Title Part Number

OpenBoot 2.x Command Reference Manual 806-2906-10

Sun StorEdge A3500/A3500FC Hardware Conguration Guide 805-4981

TABLE P–6 Oracle Solaris Cluster and Sun Cluster Documentation

Documentation

Oracle Solaris Cluster 3.3

Sun Cluster 3.2

Sun Cluster 3.1

Using UNIX Commands

This document contains information about commands that are used to install, congure, or

upgrade an Oracle Solaris Cluster conguration. This document might not contain complete

information about basic UNIX commands and procedures such as shutting down the system,

booting the system, and conguring devices.

See one or more of the following sources for this information:

■

Online documentation for the Oracle Solaris Operating System (Oracle Solaris OS)

■

Other software documentation that you received with your system

Preface

■

Oracle Solaris Operating System man pages

Getting Help

If you have problems installing or using Oracle Solaris Cluster, contact your service provider

and provide the following information.

■

Your name and email address (if available)

■

Your company name, address, and phone number

■

The model number and serial number of your systems

■

The release number of the operating environment (for example, Oracle Solaris 10)

■

The release number of Oracle Solaris Cluster (for example, Oracle Solaris Cluster 3.3)

Use the following commands to gather information about your system for your service

provider.

Command Function

prtconf -v Displays the size of the system memory and reports information

about peripheral devices

psrinfo -v Displays information about processors

showrev -p Reports which patches are installed

prtdiag -v Displays system diagnostic information

/usr/cluster/bin/clnode show-rev Displays Oracle Solaris Cluster release and package version

information for each node

Also have available the contents of the /var/adm/messages le.

Documentation and Support

See the following web sites for additional resources:

■

Documentation (http://www.oracle.com/technetwork/indexes/documentation/

index.html)

■

Support (http://www.oracle.com/us/support/systems/index.html)

Preface

Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual

• May 2011, Revision A

Oracle Software Resources

Oracle Technology Network (http://www.oracle.com/technetwork/index.html) oers a

range of resources related to Oracle software:

■

Discuss technical problems and solutions on the Discussion Forums

(http://forums.oracle.com)

■

Get hands-on step-by-step tutorials with Oracle By Example (http://www.oracle.com/

technetwork/tutorials/index.html)

Typographic Conventions

The following table describes the typographic conventions that are used in this book.

TABLE P–7 Typographic Conventions

Typeface Meaning Example

AaBbCc123 The names of commands, les, and directories,

and onscreen computer output

Edit your .login le.

Use ls -a to list all les.

machine_name% you have mail.

AaBbCc123 What you type, contrasted with onscreen

computer output

machine_name% su

Password:

aabbcc123 Placeholder: replace with a real name or value The command to remove a le is rm

lename.

AaBbCc123 Book titles, new terms, and terms to be

emphasized

Read Chapter 6 in the User's Guide.

A cache is a copy that is stored

locally.

Do not save the le.

Note: Some emphasized items

appear bold online.

Shell Prompts in Command Examples

The following table shows the default UNIX system prompt and superuser prompt for shells

that are included in the Oracle Solaris OS. Note that the default system prompt that is displayed

in command examples varies, depending on the Oracle Solaris release.

Preface

TABLE P–8 Shell Prompts

Shell Prompt

Bash shell, Korn shell, and Bourne shell $

Bash shell, Korn shell, and Bourne shell for superuser #

C shell machine_name%

C shell for superuser machine_name#

Preface

Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual

• May 2011, Revision A

Installing and Maintaining a SCSI RAID Storage

Device

This chapter describes the procedures about how to install, congure, and maintain SCSI RAID

storage devices that use Sun StorEdge RAID Manager software in an Oracle Solaris Cluster

environment.

The procedures in this chapter apply to the following SCSI RAID storage devices:

■

Oracle's Netra st A1000 array

■

Oracle's Sun StorEdge A1000 array

■

Oracle's Sun StorEdge A3500 system

This chapter contains the following sections:

■

“Restrictions and Requirements” on page 11

■

“Installing Storage Arrays” on page 12

■

“Conguring Storage Arrays” on page 22

■

“Maintaining Storage Arrays” on page 31

Restrictions and Requirements

This section includes only restrictions and support information that have a direct impact on the

procedures in this chapter. For general support information, contact your Oracle service

provider.

■

RAID Manager software 6.22.1 or later version is required.

■

(StorEdge A3500 Only) Do not use LUNs as quorum devices.

CHAPTER 1

Installing Storage Arrays

This section contains the instructions for installing storage arrays both in new clusters and

existing clusters.

TABLE 1–1 Task Map: Installing Storage Arrays

Task Information

Install an array in a new cluster, before the OS and

Oracle Solaris Cluster software are installed.

“How to Install a Storage Array in a New Cluster” on

page 12

Add an array to an operational cluster. “How to Add a Storage Array to an Existing Cluster”

on page 16

▼

How to Install a Storage Array in a New Cluster

This procedure assumes you are installing one or more storage arrays at initial installation of a

cluster.

This procedure uses an updated method for setting the scsi-initiator-id. The method that

was published in earlier documentation is still applicable. However, if your cluster

conguration uses a Sun StorEdge PCI Dual Ultra3 SCSI host adapter to connect to any other

shared storage, you need to update your nvramrc script and set the scsi-initiator-id by

following this procedure.

Before performing this procedure, ensure that you have met the following prerequisites. This

procedure relies on the following prerequisites and assumptions.

■

You have read the entire procedure.

■

You can access necessary patches, drivers, software packages, and hardware.

■

Your nodes are powered o or are at the OpenBoot PROM.

■

Your arrays are powered o.

■

Your interconnect hardware is connected to the nodes in your cluster.

■

No software is installed.

Install the host adapters in the nodes that connect to the storage arrays.

For the procedure about how to install host adapters, see the documentation that shipped with

your host adapters and nodes.

Cable the storage arrays.

For cabling diagrams, see

Appendix A, “Cabling Diagrams.”

BeforeYou Begin

Installing Storage Arrays

Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual

• May 2011, Revision A

Ensure that each device in the SCSI chain has a unique SCSI address.

To avoid SCSI-chain conicts, the following steps instruct you to reserve SCSI address 7 for one

host adapter in the SCSI chain and change the other host adapter's global scsi-initiator-id

to an available SCSI address. Then the steps instruct you to change the scsi-initiator-id for

local devices back to 7.

Note – A slot in the storage array might not be in use. However, do not set the

scsi-initiator-id to a SCSI address for that disk slot. This precaution minimizes future

complications if you install additional disk drives.

a. If necessary, power on the storage devices.

Note – If necessary, halt the nodes so that you can perform OpenBoot PROM (OBP) Monitor

tasks at the ok prompt.

For the procedure about powering on a storage device, see the service manual that shipped

with your storage device.

b. If necessary, power on a node, but do not allow it to boot. If necessary, halt the system to

continue with OBP Monitor tasks.

c. Set the scsi-initiator-id for one node to 6.

{1} ok setenv scsi-initiator-id 6

scsi-initiator-id = 6

d. Find the paths to the host adapters that connect to the local disk drives.

{0} ok show-disks

Use this information to change the SCSI addresses in the nvramrc script. Do not include the

/sd directories in the device paths.

e. Edit the nvramrc script to set the scsi-initiator-id for the local devices on the rst node

to 7.

For a full list of commands, see the

OpenBoot 2.x Command Reference Manual.

Caution – Insert exactly one space after the rst double quote and before

scsi-initiator-id.

{0} ok nvedit

0: probe-all

1: cd /pci@1f,4000/scsi@2

2: 7 encode-int " scsi-initiator-id" property

3: device-end

4: cd /pci@1f,4000/scsi@3

Installing Storage Arrays

Chapter 1 • Installing and Maintaining a SCSI RAID Storage Device 13

5: 7 encode-int " scsi-initiator-id" property

6: device-end

7: install-console

8: banner[Control C]

{0} ok

f. Store the changes.

The changes you make through the nvedit command are recorded on a temporary copy of

the nvramrc script. You can continue to edit this copy without risk. After you complete your

edits, save the changes. If you are not sure about the changes, discard them.

■

To store the changes, type the following command:

{0} ok nvstore

{1} ok

■

To discard the changes, type the following command:

{0} ok nvquit

{1} ok

g. Verify the contents of the nvramrc script that you created, as shown in the following

example.

If the contents of the nvramrc script are incorrect, use the nvedit command to make

corrections.

{0} ok printenv nvramrc

nvramrc = probe-all

cd /pci@1f,4000/scsi@2

7 " scsi-initiator-id" integer-property

device-end

cd /pci@1f,4000/scsi@3

7 " scsi-initiator-id" integer-property

device-end

install-console

banner

{1} ok

h. Instruct the OpenBoot PROM (OBP) Monitor to use the nvramrc script, as shown in the

following example.

{0} ok setenv use-nvramrc? true

use-nvramrc? = true

{1} ok

Verify that the scsi-initiator-id is set correctly on the second node.

a. If necessary, power on the second node, but do not allow it to boot. If necessary, halt the

system to continue with OBP Monitor tasks.

Installing Storage Arrays

Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual

• May 2011, Revision A

b. Verify that the scsi-initiator-id for each host adapter on the second node is set to 7.

Use the show-disks command to nd the paths to the host adapters that are connected to

these enclosures. Select each host adapter's device tree node, and display the node's

properties to conrm that the scsi-initiator-id for each host adapter is set to 7.

{0} ok cd /pci@6,4000/pci@3/scsi@5

{0} ok .properties

scsi-initiator-id 00000007

...

Install the Solaris Operating System, then apply any required Solaris patches.

For the most current list of patches, see

My Oracle Support.

Read the following two conditions carefully to determine whether you must reboot the nodes.

■

If you are using a version of RAID Manager later than 6.22, proceed to Step 7.

■

If you are using a version of the Solaris Operating System earlier than Solaris 8 Update 4,

proceed to

Step 7.

■

If you are using RAID Manager 6.22 and the Solaris 8 Update 4 or later operating

environment, reboot both nodes.

# reboot

Install the RAID Manager software.

For the procedure about how to install the RAID Manager software, see the Sun StorEdge RAID

Manager User’s Guide.

For the required version of the RAID Manager software that Oracle Solaris Cluster software

supports, see

“Restrictions and Requirements” on page 11.

Install patches for the controller modules and RAID Manager software.

For the most current list of patches, see

My Oracle Support.

Check the NVSRAM le revision for the storage arrays. If necessary, install the most recent

revision.

For the NVSRAM le revision number, boot level, and procedure about how to upgrade the

NVSRAM le, see the Sun StorEdge RAID Manager Release Notes.

Check the controller module rmware revision for the storage arrays. If necessary, install the

most recent revision.

For the rmware revision number and boot level, see the Sun StorEdge RAID Manager Release

Notes. For the procedure about how to upgrade the rmware, see the Sun StorEdge RAID

Manager User’s Guide.

Installing Storage Arrays

Chapter 1 • Installing and Maintaining a SCSI RAID Storage Device 15

Set the Rdac parameters in the /etc/osa/rmparams le on both nodes.

Rdac_RetryCount=1

Rdac_NoAltOffline=TRUE

Ensure that the controller module is set to active/active mode.

For more information about controller modes, see the Sun StorEdge RAID Manager Installation

and Support Guide and the Sun StorEdge RAID Manager User’s Guide.

Set up the storage arrays with logical unit numbers (LUNs) and hot spares.

For the procedure about how to set up the storage array with LUNs and hot spares, see the Sun

StorEdge RAID Manager User’s Guide.

Note – Use the format command to verify Solaris logical device names.

Copy the /etc/raid/rdac_address le from the node on which you created the LUNs to the

other node. If you copy this le to the other node, you ensure consistency across both nodes.

Ensure that the new logical name for the LUN that you created in

Step 13 appears in the

/dev/rdsk directory on both nodes.

# /etc/raid/bin/hot_add

To continue with Oracle Solaris Cluster software and data services installation tasks, see your

Oracle Solaris Cluster software installation documentation and the Oracle Solaris Cluster data

services developer's documentation. For a list of Oracle Solaris Cluster documentation, see

“Related Documentation” on page 6.

▼

How to Add a Storage Array to an Existing Cluster

Use this procedure to add a storage device to an existing cluster. If you need to install a storage

device in a new cluster, use the procedure in

“How to Install a Storage Array in a New Cluster”

on page 12

You might want to perform this procedure in the following scenarios.

■

You need to increase available storage.

■

You need to upgrade to a higher-quality or larger storage array.

To upgrade storage arrays, remove the old storage array and then add the new storage array.

To replace a storage array with the same type of storage array, use this procedure.

See Also

Installing Storage Arrays

Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual

• May 2011, Revision A

This procedure relies on the following prerequisites and assumptions.

■

Your cluster is operational.

■

This procedure denes Node A as the node with which you begin working. Node B is the

remaining node.

■

This procedure uses an updated method for setting the scsi-initiator-id. For this

storage array, the method that was published in earlier documentation is still applicable.

However, if your cluster conguration uses a Sun StorEdge PCI Dual Ultra3 SCSI host

adapter to connect to any other shared storage, you need to update your nvramrc script and

set the scsi-initiator-id by using this procedure.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most

commands also have short forms. Except for the forms of the command names, the commands

are identical.

To perform this procedure, become superuser or assume a role that provides

solaris.cluster.read RBAC (role-based access control) authorization.

Install the RAID Manager software.

■

For the required version of the RAID Manager software that Oracle Solaris Cluster software

supports, see

“Restrictions and Requirements” on page 11.

■

For the procedure about how to install RAID Manager software, see the Sun StorEdge RAID

Manager Installation and Support Guide.

■

For the most current list of software, rmware, and patches that your storage array or

storage system requires, refer to the appropriate EarlyNotier that is outlined in

“Related

Documentation” on page 6

. This document is available online to Oracle service providers

and to customers with service contracts at

My Oracle Support.

Install the storage array or storage system patches.

For the location of patches and installation instructions, see your Oracle Solaris Cluster release

notes documentation. For a list of Oracle Solaris Cluster documentation, see

“Related

Documentation” on page 6

Set the Rdac parameters in the /etc/osa/rmparams le.

Rdac_RetryCount=1

Rdac_NoAltOffline=TRUE

Power on the storage array or storage system.

For the procedure about how to power on the storage array or storage system, see your storage

documentation. For a list of storage documentation, see

“Related Documentation” on page 6.

If you are not installing new host adapters in your nodes, skip to

Step 8.

BeforeYou Begin

Installing Storage Arrays

Chapter 1 • Installing and Maintaining a SCSI RAID Storage Device 17

If you are installing new host adapters in your nodes, shut down and power o Node A.

For the procedure about how to shut down and power o a node, see your Oracle Solaris

Cluster system administration documentation. For a list of Oracle Solaris Cluster

documentation, see

“Related Documentation” on page 6.

Install the host adapters in Node A.

For the procedure about how to install host adapters, see the documentation that shipped with

your host adapters and nodes.

Cable the storage array or storage system to Node A.

For cabling diagrams, see

Appendix A, “Cabling Diagrams.”

Ensure that each device in the SCSI chain has a unique SCSI address.

To avoid SCSI-chain conicts, the following steps instruct you to reserve SCSI address 7 for one

host adapter in the SCSI chain and change the other host adapter's global scsi-initiator-id

to an available SCSI address. Then the steps instruct you to change the scsi-initiator-id for

local devices back to 7.

Note – A slot in the storage array might not be in use. However, do not set the

scsi-initiator-id to a SCSI address for that disk slot. This precaution minimizes future

complications if you install additional disk drives.

a. If necessary, power on the storage devices.

Note – If necessary, halt the nodes so that you can perform OpenBoot PROM (OBP) Monitor

tasks at the ok prompt.

For the procedure about powering on a storage device, see the service manual that shipped

with your storage device.

b. If necessary, power on a node, but do not allow it to boot. If necessary, halt the system to

continue with OBP Monitor tasks.

c. Set the scsi-initiator-id for one node to 6.

{1} ok setenv scsi-initiator-id 6

scsi-initiator-id = 6

d. Find the paths to the host adapters that connect to the local disk drives.

{0} ok show-disks

Use this information to change the SCSI addresses in the nvramrc script. Do not include the

/sd directories in the device paths.

Installing Storage Arrays

Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual

• May 2011, Revision A

e. Edit the nvramrc script to set the scsi-initiator-id for the local devices on the rst node

to 7.

For a full list of commands, see the

OpenBoot 2.x Command Reference Manual.

Caution – Insert exactly one space after the rst double quote and before

scsi-initiator-id.

{0} ok nvedit

0: probe-all

1: cd /pci@1f,4000/scsi@2

2: 7 encode-int " scsi-initiator-id" property

3: device-end

4: cd /pci@1f,4000/scsi@3

5: 7 encode-int " scsi-initiator-id" property

6: device-end

7: install-console

8: banner[Control C]

{0} ok

f. Store the changes.

The changes you make through the nvedit command are recorded on a temporary copy of

the nvramrc script. You can continue to edit this copy without risk. After you complete your

edits, save the changes. If you are not sure about the changes, discard them.

■

To store the changes, type the following command:

{0} ok nvstore

{1} ok

■

To discard the changes, type the following command:

{0} ok nvquit

{1} ok

g. Verify the contents of the nvramrc script that you created, as shown in the following

example.

If the contents of the nvramrc script are incorrect, use the nvedit command to make

corrections.

{0} ok printenv nvramrc

nvramrc = probe-all

cd /pci@1f,4000/scsi@2

7 " scsi-initiator-id" integer-property

device-end

cd /pci@1f,4000/scsi@3

7 " scsi-initiator-id" integer-property

device-end

install-console

banner

{1} ok

Installing Storage Arrays

Chapter 1 • Installing and Maintaining a SCSI RAID Storage Device 19

h. Instruct the OpenBoot PROM (OBP) Monitor to use the nvramrc script, as shown in the

following example.

{0} ok setenv use-nvramrc? true

use-nvramrc? = true

{1} ok

If you are not installing new host adapters in Node B,skiptoStep 13.

If you are installing new host adapters in Node B to connect Node B to the storage array or

storage system, shut down and power o the node.

For the procedure about how to shut down and power o a node, see your Oracle Solaris

Cluster system administration documentation. For a list of Oracle Solaris Cluster

documentation, see

“Related Documentation” on page 6.

Install the host adapters in Node B.

For the procedure about how to install host adapters, see the documentation that shipped with

your nodes.

Cable the storage array or storage system to Node B.

For cabling diagrams, see

“Adding a Sun StorEdge A3500 Storage System” on page 51.

If you did not power o Node B to install a host adapter, skip to

Step 17.

If you powered o Node B to install a host adapter, power on Node B and the storage array or

storage system.

Do not enable the node to boot. If necessary, halt the system to continue with OpenBoot PROM

(OBP) Monitor tasks.

Verify that Node B recognizes the new host adapters and disk drives.

If the node does not recognize the new hardware, check all hardware connections and repeat the

installation steps you performed in

Step 12.

{0} ok show-disks

...

b) /sbus@6,0/QLGC,isp@2,10000/sd...

d) /sbus@2,0/QLGC,isp@2,10000/sd...{0} ok

Verify that the scsi-initiator-id is set correctly on the second node.

a. If necessary, power on the second node, but do not allow it to boot. If necessary, halt the

system to continue with OBP Monitor tasks.

Installing Storage Arrays

Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual

• May 2011, Revision A

Page is loading ...

Oracle Solaris Cluster 3.3 System Manual

Brand: Oracle

Model: Solaris Cluster 3.3

Category: Software

Type: System Manual

Download PDF

report

Oracle Solaris Cluster 3.3 System Manual

Oracle Solaris Cluster 3.3 System Manual

Related papers

Other documents