Oracle SuperCluster T5-8 Owner's manual

Oracle

®

SuperCluster T5-8 Owner's Guide

Part No: E40167-17

May 2016

Oracle SuperCluster T5-8 Owner's Guide

Part No: E40167-17

This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except

as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform,

publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is

prohibited.

The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.

If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable:

U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation,

delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental

regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the

hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.

This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently dangerous

applications, including applications that may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall be responsible to take all

appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this

software or hardware in dangerous applications.

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.

Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of

SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered

trademark of The Open Group.

This software or hardware and documentation may provide access to or information about content, products, and services from third parties. Oracle Corporation and its affiliates are

not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services unless otherwise set forth in an applicable agreement

between you and Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content,

products, or services, except as set forth in an applicable agreement between you and Oracle.

Access to Oracle Support

Oracle customers that have purchased support have access to electronic support through My Oracle Support. For information, visit http://www.oracle.com/pls/topic/lookup?

ctx=acc&id=info or visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs if you are hearing impaired.

Référence: E40167-17

Ce logiciel et la documentation qui l'accompagne sont protégés par les lois sur la propriété intellectuelle. Ils sont concédés sous licence et soumis à des restrictions d'utilisation et

de divulgation. Sauf stipulation expresse de votre contrat de licence ou de la loi, vous ne pouvez pas copier, reproduire, traduire, diffuser, modifier, accorder de licence, transmettre,

distribuer, exposer, exécuter, publier ou afficher le logiciel, même partiellement, sous quelque forme et par quelque procédé que ce soit. Par ailleurs, il est interdit de procéder à toute

ingénierie inverse du logiciel, de le désassembler ou de le décompiler, excepté à des fins d'interopérabilité avec des logiciels tiers ou tel que prescrit par la loi.

Les informations fournies dans ce document sont susceptibles de modification sans préavis. Par ailleurs, Oracle Corporation ne garantit pas qu'elles soient exemptes d'erreurs et vous

invite, le cas échéant, à lui en faire part par écrit.

Si ce logiciel, ou la documentation qui l'accompagne, est livré sous licence au Gouvernement des Etats-Unis, ou à quiconque qui aurait souscrit la licence de ce logiciel pour le

compte du Gouvernement des Etats-Unis, la notice suivante s'applique :

U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation,

delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental

regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the

hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.

Ce logiciel ou matériel a été développé pour un usage général dans le cadre d'applications de gestion des informations. Ce logiciel ou matériel n'est pas conçu ni n'est destiné à être

utilisé dans des applications à risque, notamment dans des applications pouvant causer un risque de dommages corporels. Si vous utilisez ce logiciel ou ce matériel dans le cadre

d'applications dangereuses, il est de votre responsabilité de prendre toutes les mesures de secours, de sauvegarde, de redondance et autres mesures nécessaires à son utilisation dans

des conditions optimales de sécurité. Oracle Corporation et ses affiliés déclinent toute responsabilité quant aux dommages causés par l'utilisation de ce logiciel ou matériel pour des

applications dangereuses.

Oracle et Java sont des marques déposées d'Oracle Corporation et/ou de ses affiliés. Tout autre nom mentionné peut correspondre à des marques appartenant à d'autres propriétaires

qu'Oracle.

Intel et Intel Xeon sont des marques ou des marques déposées d'Intel Corporation. Toutes les marques SPARC sont utilisées sous licence et sont des marques ou des marques

déposées de SPARC International, Inc. AMD, Opteron, le logo AMD et le logo AMD Opteron sont des marques ou des marques déposées d'Advanced Micro Devices. UNIX est une

marque déposée de The Open Group.

Ce logiciel ou matériel et la documentation qui l'accompagne peuvent fournir des informations ou des liens donnant accès à des contenus, des produits et des services émanant de

tiers. Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée

dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des

dommages causés par l'accès à des contenus, produits ou services tiers, ou à leur utilisation, sauf mention contraire stipulée dans un contrat entre vous et Oracle.

Accès aux services de support Oracle

Les clients Oracle qui ont souscrit un contrat de support ont accès au support électronique via My Oracle Support. Pour plus d'informations, visitez le site http://www.oracle.com/

pls/topic/lookup?ctx=acc&id=info ou le site http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs si vous êtes malentendant.

Contents

Using This Documentation ................................................................................ 13

Understanding the System ................................................................................ 15

Understanding Oracle SuperCluster T5-8 ........................................................... 15

Spares Kit Components .......................................................................... 16

Oracle SuperCluster T5-8 Restrictions ....................................................... 17

Identifying Hardware Components ................................................................... 19

Full Rack Components ........................................................................... 20

Half Rack Components ........................................................................... 22

Understanding the Hardware Components and Connections .................................. 23

Understanding the Hardware Components .................................................. 23

Understanding the Physical Connections .................................................... 26

Understanding the Software Configurations ........................................................ 46

Understanding Domains .......................................................................... 46

Understanding General Configuration Information ....................................... 58

Understanding Half Rack Configurations ................................................... 61

Understanding Full Rack Configurations ................................................... 69

Understanding Clustering Software ................................................................... 84

Cluster Software for the Database Domain ................................................. 85

Cluster Software for the Oracle Solaris Application Domains ........................ 85

Understanding the Network Requirements ......................................................... 86

Network Requirements Overview ............................................................. 86

Network Connection Requirements for Oracle SuperCluster T5-8 ................... 89

Understanding Default IP Addresses ......................................................... 90

Preparing the Site ............................................................................................. 95

Cautions and Considerations ............................................................................ 95

Reviewing System Specifications ..................................................................... 96

5

Contents

Physical Specifications ........................................................................... 96

Installation and Service Area ................................................................... 96

Rack and Floor Cutout Dimensions .......................................................... 97

Reviewing Power Requirements ....................................................................... 99

Power Consumption ............................................................................... 99

Facility Power Requirements ................................................................. 100

Grounding Requirements ....................................................................... 100

PDU Power Requirements ..................................................................... 101

PDU Thresholds .................................................................................. 104

Preparing for Cooling ................................................................................... 106

Environmental Requirements ................................................................. 107

Heat Dissipation and Airflow Requirements ............................................. 107

Perforated Floor Tiles ........................................................................... 110

Preparing the Unloading Route and Unpacking Area .......................................... 111

Shipping Package Dimensions ............................................................... 111

Loading Dock and Receiving Area Requirements ...................................... 111

Access Route Guidelines ....................................................................... 112

Unpacking Area .................................................................................. 113

Preparing the Network .................................................................................. 113

Network Connection Requirements ......................................................... 113

Network IP Address Requirements ......................................................... 114

▼ Prepare DNS for the System ............................................................. 114

Installing the System ....................................................................................... 117

Installation Overview ................................................................................... 117

Oracle Safety Information ............................................................................. 118

Unpacking the System .................................................................................. 119

Tools for Installation ............................................................................ 119

▼ Find the Unpacking Instructions ........................................................ 119

▼ Unpack and Inspect the System ......................................................... 121

Moving the Rack Into Place .......................................................................... 121

▼ Move Oracle SuperCluster T5-8 ........................................................ 122

▼ Install a Ground Cable (Optional) ...................................................... 124

▼ Adjust the Leveling Feet .................................................................. 125

Powering on the System for the First Time ....................................................... 126

▼ Connect Power Cords to the Rack ..................................................... 126

▼ Power On the System ...................................................................... 130

6 Oracle SuperCluster T5-8 Owner's Guide • May 2016

Contents

▼ Connect a Laptop to the System ........................................................ 134

▼ Connect to a 10-GbE Client Access Network ....................................... 136

Using an Optional Fibre Channel PCIe Card ..................................................... 139

Maintaining the System ................................................................................... 141

Cautions and Warnings ................................................................................. 141

Powering Off the System .............................................................................. 142

Graceful Power Off Sequence ................................................................ 142

▼ Emergency Power Off ..................................................................... 145

▼ Power On the System .............................................................................. 145

▼ Identify the Version of SuperCluster Software .............................................. 145

SuperCluster Tools ....................................................................................... 146

Managing Oracle Solaris 11 Boot Environments ................................................ 147

Advantages to Maintaining Multiple Boot Environments ............................. 147

▼ Create a Boot Environment .............................................................. 148

▼ Mount to a Different Build Environment ............................................. 150

▼ Reboot to the Original Boot Environment ........................................... 151

▼ Remove Unwanted Boot Environments ............................................... 151

Using Dynamic Intimate Shared Memory ......................................................... 151

DISM Restrictions .............................................................................. 152

▼ Disable DISM ................................................................................ 152

Component-Specific Service Procedures .......................................................... 153

Maintaining Exadata Storage Servers .............................................................. 153

▼ Monitor Write-through Caching Mode ................................................ 154

▼ Shut Down or Reboot an Exadata Storage Server .................................. 156

▼ Drop an Exadata Storage Server ........................................................ 158

Tuning the System (ssctuner) ....................................................................... 158

ssctuner Overview .............................................................................. 159

▼ Monitor ssctuner Activity ............................................................... 160

▼ View Log Files .............................................................................. 161

▼ Configure the EMAIL_ADDRESS Property ............................................... 162

▼ Change ssctuner Properties and Disable Features ................................ 163

▼ Configure ssctuner to Run compliance(1M) Benchmarks ...................... 165

▼ Monitor and View the Compliance Benchmark .................................... 166

▼ Install ssctuner ............................................................................. 168

▼ Enable ssctuner ............................................................................ 169

7

Contents

Configuring CPU and Memory Resources (osc-setcoremem) ............................... 170

osc-setcoremem Overview ..................................................................... 171

Minimum and Maximum Resources (Dedicated Domains) ........................... 173

Supported Domain Configurations .......................................................... 174

▼ Plan CPU and Memory Allocations ................................................... 175

▼ Display the Current Domain Configuration (osc-setcoremem) ................. 178

▼ Display the Current Domain Configuration (ldm) .................................. 180

▼ Change CPU/Memory Allocations (Socket Granularity) ......................... 182

▼ Change CPU/Memory Allocations (Core Granularity) ........................... 186

▼ Park Cores and Memory .................................................................. 190

▼ Access osc-setcoremem Log Files ..................................................... 196

▼ View the SP Configuration ............................................................... 199

▼ Revert to a Previous CPU/Memory Configuration ................................. 201

▼ Remove a CPU/Memory Configuration .............................................. 202

Monitoring the System .................................................................................... 205

Monitoring the System Using Auto Service Request .......................................... 205

ASR Overview .................................................................................... 205

ASR Resources ................................................................................... 206

ASR Installation Overview .................................................................... 207

▼ Configure SNMP Trap Destinations for Exadata Storage Servers ............. 208

▼ Configure ASR on the ZFS Storage Appliance ..................................... 210

▼ Configure ASR on SPARC T5-8 Servers (Oracle ILOM) ........................ 213

Configuring ASR on the SPARC T5-8 Servers (Oracle Solaris 11) ................ 215

▼ Approve and Verify ASR Asset Activation .......................................... 219

Monitoring the System Using OCM ................................................................ 221

OCM Overview ................................................................................... 221

▼ Install Oracle Configuration Manager on SPARC T5-8 Servers ................ 222

Monitoring the System Using EM Exadata Plug-in ............................................ 226

System Requirements ........................................................................... 227

Known Issues With EM Exadata Plug-in .................................................. 227

Configuring Exalogic Software ........................................................................ 229

Exalogic Software Overview ......................................................................... 229

Exalogic Software Prerequisites ..................................................................... 230

▼ Enable Domain-Level Enhancements ......................................................... 230

8 Oracle SuperCluster T5-8 Owner's Guide • May 2016

Contents

▼ Enable Cluster-Level Session Replication Enhancements ............................... 231

Configuring Grid Link Data Source for Dept1_Cluster1 ...................................... 234

Grid Link Data Source ......................................................................... 235

▼ Create a GridLink Data Source on Dept1_Cluster1 ............................... 236

Configuring SDP-Enabled JDBC Drivers for Dept1_Cluster1 .............................. 238

▼ Configure the Database to Support Infiniband ...................................... 238

▼ Enable SDP Support for JDBC ......................................................... 239

▼ Monitor SDP Sockets Using netstat on Oracle Solaris ......................... 240

Configuring SDP InfiniBand Listener for Exalogic Connections ........................... 240

▼ Create an SDP Listener on the InfiniBand Network ............................... 241

Understanding Internal Cabling ....................................................................... 245

Connector Locations ..................................................................................... 245

Identifying InfiniBand Fabric Connections ....................................................... 253

IB Spine Switch .................................................................................. 253

IB Leaf Switch No. 1 ........................................................................... 253

IB Leaf Switch No. 2 ........................................................................... 254

Ethernet Management Switch Connections ....................................................... 256

ZFS Storage Appliance Connections ............................................................... 258

Single-Phase PDU Cabling ............................................................................ 258

Three-Phase PDU Cabling ............................................................................. 259

Connecting Multiple Oracle SuperCluster T5-8 Systems ................................. 261

Multi-Rack Cabling Overview ....................................................................... 261

Two-Rack Cabling ....................................................................................... 263

Three-Rack Cabling ..................................................................................... 265

Four-Rack Cabling ....................................................................................... 267

Five-Rack Cabling ....................................................................................... 270

Six-Rack Cabling ......................................................................................... 273

Seven-Rack Cabling ..................................................................................... 277

Eight-Rack Cabling ...................................................................................... 281

Connecting Expansion Racks ......................................................................... 287

Oracle Exadata Storage Expansion Rack Components ........................................ 287

Preparing for Installation ............................................................................... 288

Reviewing System Specifications ........................................................... 289

9

Contents

Reviewing Power Requirements ............................................................. 289

Preparing for Cooling ........................................................................... 293

Preparing the Unloading Route and Unpacking Area .................................. 296

Preparing the Network .......................................................................... 297

Installing the Oracle Exadata Storage Expansion Rack ........................................ 299

Expansion Rack Default IP Addresses ............................................................. 300

Understanding Expansion Rack Internal Cabling ............................................... 300

Front and Rear Expansion Rack Layout ................................................... 301

Oracle ILOM Cabling ........................................................................... 304

Administrative Gigabit Ethernet Port Cabling Tables .................................. 306

Single-Phase PDU Cabling .................................................................... 308

Three-Phase Power Distribution Unit Cabling ........................................... 309

InfiniBand Network Cabling .................................................................. 311

Connecting an Expansion Rack to Oracle SuperCluster T5-8 ............................... 315

InfiniBand Switch Information for Oracle SuperCluster T5-8 ....................... 315

InfiniBand Switch Information for the Oracle Exadata Storage Expansion

Rack .................................................................................................. 316

Connecting an Oracle Exadata Storage Expansion Quarter Rack to Oracle

SuperCluster T5-8 ................................................................................ 316

Connecting an Oracle Exadata Storage Expansion Half Rack or Oracle Exadata

Storage Expansion Full Rack to Oracle SuperCluster T5-8 .......................... 320

Two-Rack Cabling ............................................................................... 322

Three-Rack Cabling ............................................................................. 324

Four-Rack Cabling ............................................................................... 326

Five-Rack Cabling ............................................................................... 328

Six-Rack Cabling ................................................................................. 332

Seven-Rack Cabling ............................................................................. 336

Eight-Rack Cabling .............................................................................. 340

Nine-Rack Cabling ............................................................................... 345

Ten-Rack Cabling ................................................................................ 345

Eleven-Rack Cabling ............................................................................ 346

Twelve-Rack Cabling ........................................................................... 347

Thirteen-Rack Cabling .......................................................................... 348

Fourteen-Rack Cabling ......................................................................... 348

Fifteen-Rack Cabling ............................................................................ 349

Sixteen-Rack Cabling ........................................................................... 350

Seventeen-Rack Cabling ....................................................................... 351

Eighteen-Rack Cabling ......................................................................... 351

10 Oracle SuperCluster T5-8 Owner's Guide • May 2016

Contents

Index ................................................................................................................ 353

11

12 Oracle SuperCluster T5-8 Owner's Guide • May 2016

Using This Documentation

This document provides and overview of Oracle SuperCluster T5-8, and describes configuration

options, site preparation specifications, installation information, and administration tools.

■

Overview – Describes how to configure, install, tune, and monitor the system.

■

Audience – Technicians, system administrators, and authorized service providers.

■

Required knowledge – Advanced experience in system installation and administration.

Product Documentation Library

Documentation and resources for this product and related products are available on the system.

Access the documentation by using a browser to view this directory on the first compute server

installed in SuperCluster T5-8:

/opt/oracle/node/doc/E40166_01/index.html

Feedback

Provide feedback about this documentation at:

http://www.oracle.com/goto/docfeedback

Using This Documentation 13

14 Oracle SuperCluster T5-8 Owner's Guide • May 2016

Understanding the System

These topics describe the features and hardware components of Oracle SuperCluster T5-8.

These topics also describe the different software configurations that are available.

■

“Understanding Oracle SuperCluster T5-8” on page 15

■

“Identifying Hardware Components” on page 19

■

“Understanding the Hardware Components and Connections” on page 23

■

“Understanding the Software Configurations” on page 46

■

“Understanding Clustering Software” on page 84

■

“Understanding the Network Requirements” on page 86

Understanding Oracle SuperCluster T5-8

Oracle SuperCluster T5-8 is an integrated hardware and software system designed to provide

a complete platform for a wide range of application types and widely varied workloads.

Oracle SuperCluster T5-8 is intended for large-scale, performance-sensitive, mission-critical

application deployments. Oracle SuperCluster T5-8 combines industry-standard hardware and

clustering software, such as optional Oracle Database 11g Real Application Clusters (Oracle

RAC) and optional Oracle Solaris Cluster software. This combination enables a high degree of

isolation between concurrently deployed applications, which have varied security, reliability,

and performance requirements. Oracle SuperCluster T5-8 enables customers to develop a single

environment that can support end-to-end consolidation of their entire applications portfolio.

Oracle SuperCluster T5-8 provides an optimal solution for all database workloads, ranging from

scan-intensive data warehouse applications to highly concurrent online transaction processing

(OLTP) applications. With its combination of smart Oracle Exadata Storage Server Software,

complete and intelligent Oracle Database software, and the latest industry-standard hardware

components, Oracle SuperCluster T5-8 delivers extreme performance in a highly-available,

highly-secure environment. Oracle provides unique clustering and workload management

capabilities so Oracle SuperCluster T5-8 is well-suited for consolidating multiple databases into

a single grid. Delivered as a complete pre-optimized, and pre-configured package of software,

servers, and storage, Oracle SuperCluster T5-8 is fast to implement, and it is ready to tackle

your large-scale business applications.

Understanding the System 15

Understanding Oracle SuperCluster T5-8

Oracle SuperCluster T5-8 does not include any Oracle software licenses. Appropriate licensing

of the following software is required when Oracle SuperCluster T5-8 is used as a database

server:

■

Oracle Database Software

■

Oracle Exadata Storage Server Software

In addition, Oracle recommends that the following software is licensed:

■

Oracle Real Application Clusters

■

Oracle Partitioning

Oracle SuperCluster T5-8 is designed to fully leverage an internal InfiniBand fabric that

connects all of the processing, storage, memory, and external network interfaces within Oracle

SuperCluster T5-8 to form a single, large computing device. Each Oracle SuperCluster T5-8

is connected to data center networks through 10-GbE (traffic) and 1-GbE (management)

interfaces.

You can integrate Oracle SuperCluster T5-8 systems with Exadata or Exalogic machines

by using the available InfiniBand expansion ports and optional data center switches. The

InfiniBand technology used by Oracle SuperCluster T5-8 offers significantly high bandwidth,

low latency, hardware-level reliability, and security. If you are using applications that follow

Oracle's best practices for highly scalable, fault-tolerant systems, you do not need to make any

application architecture or design changes to benefit from Oracle SuperCluster T5-8. You can

connect many Oracle SuperCluster T5-8 systems, or a combination of Oracle SuperCluster T5-8

systems and Oracle Exadata Database Machines, to develop a single, large-scale environment.

You can integrate Oracle SuperCluster T5-8 systems with their current data center infrastructure

using the available 10-GbE ports in each SPARC T5-8 server.

Spares Kit Components

Oracle SuperCluster T5-8 includes a spares kit that includes the following components:

■

One of the following disks as a spare for the Exadata Storage Servers, depending on the

type of Exadata Storage Server:

■

X3-2 Exadata Storage Server:

- 600 GB 10 K RPM High Performance SAS disk

- 3 TB 7.2 K RPM High Capacity SAS disk

■

X4-2 Exadata Storage Server:

- 1.2 TB 10 K RPM High Performance SAS disk

- 4 TB 7.2 K RPM High Capacity SAS disk

16 Oracle SuperCluster T5-8 Owner's Guide • May 2016

Understanding Oracle SuperCluster T5-8

■

X5-2L Exadata Storage Server:

- 1.6 TB Extreme Flash drive

- 8 TB High Capacity SAS disk

■

X6-2L Exadata Storage Server:

- 3.2 TB Extreme Flash drive

- 8 TB High Capacity SAS disk

■

One High Capacity SAS disk as a spare for the ZFS storage appliance:

■

One 3 TB High Capacity SAS disk as a spare for the Sun ZFS Storage 7320 storage

appliance, or

■

One 4 TB High Capacity SAS disk as a spare for the Oracle ZFS Storage ZS3-ES

storage appliance

■

Exadata Smart Flash Cache card

■

InfiniBand cables, used to connect multiple racks together

Oracle SuperCluster T5-8 Restrictions

The following restrictions apply to hardware and software modifications to Oracle SuperCluster

T5-8. Violating these restrictions can result in loss of warranty and support.

■

Oracle SuperCluster T5-8 hardware cannot be modified or customized. There is one

exception to this. The only allowed hardware modification to Oracle SuperCluster T5-8

is to the administrative 48-port Cisco 4948 Gigabit Ethernet switch included with Oracle

SuperCluster T5-8. Customers may choose to the following:

■

Replace the Gigabit Ethernet switch, at customer expense, with an equivalent 1U

48-port Gigabit Ethernet switch that conforms to their internal data center network

standards. This replacement must be performed by the customer, at their expense and

labor, after delivery of Oracle SuperCluster T5-8. If the customer chooses to make

this change, then Oracle cannot make or assist with this change given the numerous

possible scenarios involved, and it is not included as part of the standard installation.

The customer must supply the replacement hardware, and make or arrange for this

change through other means.

■

Remove the CAT5 cables connected to the Cisco 4948 Ethernet switch, and connect

them to the customer's network through an external switch or patch panel. The customer

must perform these changes at their expense and labor. In this case, the Cisco 4948

Ethernet switch in the rack can be turned off and unconnected to the data center

network.

■

The Oracle Exadata Storage Expansion Rack can only be connected to Oracle SuperCluster

T5-8 or an Oracle Exadata Database Machine, and only supports databases running on the

Understanding the System 17

Understanding Oracle SuperCluster T5-8

Oracle Database (DB) Domains in Oracle SuperCluster T5-8 or on the database servers in

the Oracle Exadata Database Machine.

■

Standalone Exadata Storage Servers can only be connected to Oracle SuperCluster T5-8 or

an Oracle Exadata Database Machine, and only support databases running on the Database

Domains in Oracle SuperCluster T5-8 or on the database servers in the Oracle Exadata

Database Machine. The standalone Exadata Storage Servers must be installed in a separate

rack.

■

Earlier Oracle Database releases can be run in Application Domains running Oracle Solaris

10. Non-Oracle databases can be run in either Application Domains running Oracle Solaris

10 or Oracle Solaris 11, depending on the Oracle Solaris version they support.

■

Oracle Exadata Storage Server Software and the operating systems cannot be modified, and

customers cannot install any additional software or agents on the Exadata Storage Servers.

■

Customers cannot update the firmware directly on the Exadata Storage Servers. The

firmware is updated as part of an Exadata Storage Server patch.

■

Customers may load additional software on the Database Domains on the SPARC T5-8

servers. However, to ensure best performance, Oracle discourages adding software except

for agents, such as backup agents and security monitoring agents, on the Database Domains.

Loading non-standard kernel modules to the operating system of the Database Domains is

allowed but discouraged. Oracle will not support questions or issues with the non-standard

modules. If a server crashes, and Oracle suspects the crash may have been caused by a non-

standard module, then Oracle support may refer the customer to the vendor of the non-

standard module or ask that the issue be reproduced without the non-standard module.

Modifying the Database Domain operating system other than by applying official patches

and upgrades is not supported. InfiniBand-related packages should always be maintained at

the officially supported release.

■

Oracle SuperCluster T5-8 supports separate domains dedicated to applications, with high

throughput/low latency access to the database domains through InfiniBand. Since Oracle

Database is by nature a client server, applications running in the Application Domains can

connect to database instances running in the Database Domain. Applications can be run in

the Database Domain, although it is discouraged.

■

Customers cannot connect USB devices to the Exadata Storage Servers except as

documented in Oracle Exadata Storage Server Software User's Guide and this guide. In

those documented situations, the USB device should not draw more than 100 mA of power.

■

The network ports on the SPARC T5-8 servers can be used to connect to external non-

Exadata Storage Servers using iSCSI or NFS. However, the Fibre Channel Over Ethernet

(FCoE) protocol is not supported.

■

Only switches specified for use in Oracle SuperCluster T5-8, Oracle Exadata Rack

and Oracle Exalogic Elastic Cloud may be connected to the InfiniBand network. It is

not supported to connect third-party switches and other switches not used in Oracle

SuperCluster T5-8, Oracle Exadata Rack and Oracle Exalogic Elastic Cloud.

18 Oracle SuperCluster T5-8 Owner's Guide • May 2016

Identifying Hardware Components

Oracle SuperCluster T5-8 consists of SPARC T5-8 servers, Exadata Storage Servers, and the

ZFS storage appliance (Sun ZFS Storage 7320 appliance or Oracle ZFS Storage ZS3-ES storage

appliance), as well as required InfiniBand and Ethernet networking components.

This section contains the following topics:

■

“Full Rack Components” on page 20

■

“Half Rack Components” on page 22

Understanding the System 19

Identifying Hardware Components

Full Rack Components

FIGURE 1

Oracle SuperCluster T5-8 Full Rack Layout, Front View

20 Oracle SuperCluster T5-8 Owner's Guide • May 2016

Page is loading ...

Oracle SuperCluster T5-8 Owner's manual

Oracle SuperCluster T5-8 Owner's manual

Related papers

Other documents