2. Computers & electronics
  3. Networking
  4. Oracle
  5. SuperCluster T5-8

Oracle SuperCluster T5-8 Owner's manual

  • Hello! I am an AI chatbot trained to assist you with the Oracle SuperCluster T5-8 Owner's manual. I’ve already reviewed the document and can help you find the information you need or explain it in simple terms. Just ask your questions, and providing more details will help me assist you more effectively!
Oracle
®
SuperCluster T5-8 Owner's Guide
Part No: E40167-17
May 2016
Oracle SuperCluster T5-8 Owner's Guide
Part No: E40167-17
Copyright © 2015 , Oracle and/or its affiliates. All rights reserved.
This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except
as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform,
publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is
prohibited.
The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.
If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable:
U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation,
delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental
regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the
hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.
This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently dangerous
applications, including applications that may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall be responsible to take all
appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this
software or hardware in dangerous applications.
Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.
Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of
SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered
trademark of The Open Group.
This software or hardware and documentation may provide access to or information about content, products, and services from third parties. Oracle Corporation and its affiliates are
not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services unless otherwise set forth in an applicable agreement
between you and Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content,
products, or services, except as set forth in an applicable agreement between you and Oracle.
Access to Oracle Support
Oracle customers that have purchased support have access to electronic support through My Oracle Support. For information, visit http://www.oracle.com/pls/topic/lookup?
ctx=acc&id=info or visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs if you are hearing impaired.
Référence: E40167-17
Copyright © 2015 , Oracle et/ou ses affiliés. Tous droits réservés.
Ce logiciel et la documentation qui l'accompagne sont protégés par les lois sur la propriété intellectuelle. Ils sont concédés sous licence et soumis à des restrictions d'utilisation et
de divulgation. Sauf stipulation expresse de votre contrat de licence ou de la loi, vous ne pouvez pas copier, reproduire, traduire, diffuser, modifier, accorder de licence, transmettre,
distribuer, exposer, exécuter, publier ou afficher le logiciel, même partiellement, sous quelque forme et par quelque procédé que ce soit. Par ailleurs, il est interdit de procéder à toute
ingénierie inverse du logiciel, de le désassembler ou de le décompiler, excepté à des fins d'interopérabilité avec des logiciels tiers ou tel que prescrit par la loi.
Les informations fournies dans ce document sont susceptibles de modification sans préavis. Par ailleurs, Oracle Corporation ne garantit pas qu'elles soient exemptes d'erreurs et vous
invite, le cas échéant, à lui en faire part par écrit.
Si ce logiciel, ou la documentation qui l'accompagne, est livré sous licence au Gouvernement des Etats-Unis, ou à quiconque qui aurait souscrit la licence de ce logiciel pour le
compte du Gouvernement des Etats-Unis, la notice suivante s'applique :
U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation,
delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental
regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the
hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.
Ce logiciel ou matériel a été développé pour un usage général dans le cadre d'applications de gestion des informations. Ce logiciel ou matériel n'est pas conçu ni n'est destiné à être
utilisé dans des applications à risque, notamment dans des applications pouvant causer un risque de dommages corporels. Si vous utilisez ce logiciel ou ce matériel dans le cadre
d'applications dangereuses, il est de votre responsabilité de prendre toutes les mesures de secours, de sauvegarde, de redondance et autres mesures nécessaires à son utilisation dans
des conditions optimales de sécurité. Oracle Corporation et ses affiliés déclinent toute responsabilité quant aux dommages causés par l'utilisation de ce logiciel ou matériel pour des
applications dangereuses.
Oracle et Java sont des marques déposées d'Oracle Corporation et/ou de ses affiliés. Tout autre nom mentionné peut correspondre à des marques appartenant à d'autres propriétaires
qu'Oracle.
Intel et Intel Xeon sont des marques ou des marques déposées d'Intel Corporation. Toutes les marques SPARC sont utilisées sous licence et sont des marques ou des marques
déposées de SPARC International, Inc. AMD, Opteron, le logo AMD et le logo AMD Opteron sont des marques ou des marques déposées d'Advanced Micro Devices. UNIX est une
marque déposée de The Open Group.
Ce logiciel ou matériel et la documentation qui l'accompagne peuvent fournir des informations ou des liens donnant accès à des contenus, des produits et des services émanant de
tiers. Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée
dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des
dommages causés par l'accès à des contenus, produits ou services tiers, ou à leur utilisation, sauf mention contraire stipulée dans un contrat entre vous et Oracle.
Accès aux services de support Oracle
Les clients Oracle qui ont souscrit un contrat de support ont accès au support électronique via My Oracle Support. Pour plus d'informations, visitez le site http://www.oracle.com/
pls/topic/lookup?ctx=acc&id=info ou le site http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs si vous êtes malentendant.
Contents
Using This Documentation ................................................................................ 13
Understanding the System ................................................................................ 15
Understanding Oracle SuperCluster T5-8 ...........................................................  15
Spares Kit Components ..........................................................................  16
Oracle SuperCluster T5-8 Restrictions ....................................................... 17
Identifying Hardware Components ...................................................................  19
Full Rack Components ...........................................................................  20
Half Rack Components ........................................................................... 22
Understanding the Hardware Components and Connections ..................................  23
Understanding the Hardware Components .................................................. 23
Understanding the Physical Connections .................................................... 26
Understanding the Software Configurations ........................................................ 46
Understanding Domains .......................................................................... 46
Understanding General Configuration Information ....................................... 58
Understanding Half Rack Configurations ...................................................  61
Understanding Full Rack Configurations ...................................................  69
Understanding Clustering Software ................................................................... 84
Cluster Software for the Database Domain ................................................. 85
Cluster Software for the Oracle Solaris Application Domains ........................  85
Understanding the Network Requirements .........................................................  86
Network Requirements Overview .............................................................  86
Network Connection Requirements for Oracle SuperCluster T5-8 ...................  89
Understanding Default IP Addresses .........................................................  90
Preparing the Site .............................................................................................  95
Cautions and Considerations ............................................................................ 95
Reviewing System Specifications .....................................................................  96
5
Contents
Physical Specifications ...........................................................................  96
Installation and Service Area ...................................................................  96
Rack and Floor Cutout Dimensions ..........................................................  97
Reviewing Power Requirements .......................................................................  99
Power Consumption ...............................................................................  99
Facility Power Requirements .................................................................  100
Grounding Requirements ....................................................................... 100
PDU Power Requirements .....................................................................  101
PDU Thresholds ..................................................................................  104
Preparing for Cooling ...................................................................................  106
Environmental Requirements .................................................................  107
Heat Dissipation and Airflow Requirements .............................................  107
Perforated Floor Tiles ...........................................................................  110
Preparing the Unloading Route and Unpacking Area ..........................................  111
Shipping Package Dimensions ...............................................................  111
Loading Dock and Receiving Area Requirements ......................................  111
Access Route Guidelines ....................................................................... 112
Unpacking Area ..................................................................................  113
Preparing the Network ..................................................................................  113
Network Connection Requirements .........................................................  113
Network IP Address Requirements .........................................................  114
▼ Prepare DNS for the System ............................................................. 114
Installing the System .......................................................................................  117
Installation Overview ...................................................................................  117
Oracle Safety Information .............................................................................  118
Unpacking the System ..................................................................................  119
Tools for Installation ............................................................................  119
▼ Find the Unpacking Instructions ........................................................  119
▼ Unpack and Inspect the System ......................................................... 121
Moving the Rack Into Place ..........................................................................  121
▼ Move Oracle SuperCluster T5-8 ........................................................  122
▼ Install a Ground Cable (Optional) ...................................................... 124
▼ Adjust the Leveling Feet ..................................................................  125
Powering on the System for the First Time ....................................................... 126
▼ Connect Power Cords to the Rack .....................................................  126
▼ Power On the System ...................................................................... 130
6 Oracle SuperCluster T5-8 Owner's Guide • May 2016
Contents
▼ Connect a Laptop to the System ........................................................  134
▼ Connect to a 10-GbE Client Access Network .......................................  136
Using an Optional Fibre Channel PCIe Card ..................................................... 139
Maintaining the System ...................................................................................  141
Cautions and Warnings .................................................................................  141
Powering Off the System ..............................................................................  142
Graceful Power Off Sequence ................................................................  142
▼ Emergency Power Off .....................................................................  145
▼ Power On the System .............................................................................. 145
▼ Identify the Version of SuperCluster Software .............................................. 145
SuperCluster Tools .......................................................................................  146
Managing Oracle Solaris 11 Boot Environments ................................................ 147
Advantages to Maintaining Multiple Boot Environments .............................  147
▼ Create a Boot Environment ..............................................................  148
▼ Mount to a Different Build Environment ............................................. 150
▼ Reboot to the Original Boot Environment ...........................................  151
▼ Remove Unwanted Boot Environments ............................................... 151
Using Dynamic Intimate Shared Memory ......................................................... 151
DISM Restrictions ..............................................................................  152
▼ Disable DISM ................................................................................  152
Component-Specific Service Procedures ..........................................................  153
Maintaining Exadata Storage Servers ..............................................................  153
▼ Monitor Write-through Caching Mode ................................................ 154
▼ Shut Down or Reboot an Exadata Storage Server .................................. 156
▼ Drop an Exadata Storage Server ........................................................  158
Tuning the System (ssctuner) .......................................................................  158
ssctuner Overview .............................................................................. 159
▼ Monitor ssctuner Activity ............................................................... 160
▼ View Log Files ..............................................................................  161
▼ Configure the EMAIL_ADDRESS Property ............................................... 162
▼ Change ssctuner Properties and Disable Features ................................  163
▼ Configure ssctuner to Run compliance(1M) Benchmarks ...................... 165
▼ Monitor and View the Compliance Benchmark ....................................  166
▼ Install ssctuner .............................................................................  168
▼ Enable ssctuner ............................................................................  169
7
Contents
Configuring CPU and Memory Resources (osc-setcoremem) ............................... 170
osc-setcoremem Overview .....................................................................  171
Minimum and Maximum Resources (Dedicated Domains) ........................... 173
Supported Domain Configurations ..........................................................  174
▼ Plan CPU and Memory Allocations ...................................................  175
▼ Display the Current Domain Configuration (osc-setcoremem) ................. 178
▼ Display the Current Domain Configuration (ldm) ..................................  180
▼ Change CPU/Memory Allocations (Socket Granularity) .........................  182
▼ Change CPU/Memory Allocations (Core Granularity) ...........................  186
▼ Park Cores and Memory ..................................................................  190
▼ Access osc-setcoremem Log Files .....................................................  196
▼ View the SP Configuration ...............................................................  199
▼ Revert to a Previous CPU/Memory Configuration ................................. 201
▼ Remove a CPU/Memory Configuration ..............................................  202
Monitoring the System ....................................................................................  205
Monitoring the System Using Auto Service Request ..........................................  205
ASR Overview ....................................................................................  205
ASR Resources ...................................................................................  206
ASR Installation Overview ....................................................................  207
▼ Configure SNMP Trap Destinations for Exadata Storage Servers .............  208
▼ Configure ASR on the ZFS Storage Appliance ..................................... 210
▼ Configure ASR on SPARC T5-8 Servers (Oracle ILOM) ........................ 213
Configuring ASR on the SPARC T5-8 Servers (Oracle Solaris 11) ................  215
▼ Approve and Verify ASR Asset Activation ..........................................  219
Monitoring the System Using OCM ................................................................  221
OCM Overview ...................................................................................  221
▼ Install Oracle Configuration Manager on SPARC T5-8 Servers ................ 222
Monitoring the System Using EM Exadata Plug-in ............................................  226
System Requirements ...........................................................................  227
Known Issues With EM Exadata Plug-in .................................................. 227
Configuring Exalogic Software ........................................................................  229
Exalogic Software Overview .........................................................................  229
Exalogic Software Prerequisites .....................................................................  230
▼ Enable Domain-Level Enhancements .........................................................  230
8 Oracle SuperCluster T5-8 Owner's Guide • May 2016
Contents
▼ Enable Cluster-Level Session Replication Enhancements ...............................  231
Configuring Grid Link Data Source for Dept1_Cluster1 ...................................... 234
Grid Link Data Source .........................................................................  235
▼ Create a GridLink Data Source on Dept1_Cluster1 ...............................  236
Configuring SDP-Enabled JDBC Drivers for Dept1_Cluster1 ..............................  238
▼ Configure the Database to Support Infiniband ......................................  238
▼ Enable SDP Support for JDBC .........................................................  239
▼ Monitor SDP Sockets Using netstat on Oracle Solaris .........................  240
Configuring SDP InfiniBand Listener for Exalogic Connections ...........................  240
▼ Create an SDP Listener on the InfiniBand Network ............................... 241
Understanding Internal Cabling ....................................................................... 245
Connector Locations ..................................................................................... 245
Identifying InfiniBand Fabric Connections .......................................................  253
IB Spine Switch ..................................................................................  253
IB Leaf Switch No. 1 ...........................................................................  253
IB Leaf Switch No. 2 ...........................................................................  254
Ethernet Management Switch Connections .......................................................  256
ZFS Storage Appliance Connections ...............................................................  258
Single-Phase PDU Cabling ............................................................................  258
Three-Phase PDU Cabling ............................................................................. 259
Connecting Multiple Oracle SuperCluster T5-8 Systems .................................  261
Multi-Rack Cabling Overview .......................................................................  261
Two-Rack Cabling .......................................................................................  263
Three-Rack Cabling .....................................................................................  265
Four-Rack Cabling .......................................................................................  267
Five-Rack Cabling .......................................................................................  270
Six-Rack Cabling ......................................................................................... 273
Seven-Rack Cabling .....................................................................................  277
Eight-Rack Cabling ......................................................................................  281
Connecting Expansion Racks .........................................................................  287
Oracle Exadata Storage Expansion Rack Components ........................................  287
Preparing for Installation ............................................................................... 288
Reviewing System Specifications ...........................................................  289
9
Contents
Reviewing Power Requirements .............................................................  289
Preparing for Cooling ...........................................................................  293
Preparing the Unloading Route and Unpacking Area ..................................  296
Preparing the Network ..........................................................................  297
Installing the Oracle Exadata Storage Expansion Rack ........................................ 299
Expansion Rack Default IP Addresses .............................................................  300
Understanding Expansion Rack Internal Cabling ...............................................  300
Front and Rear Expansion Rack Layout ...................................................  301
Oracle ILOM Cabling ........................................................................... 304
Administrative Gigabit Ethernet Port Cabling Tables ..................................  306
Single-Phase PDU Cabling ....................................................................  308
Three-Phase Power Distribution Unit Cabling ...........................................  309
InfiniBand Network Cabling ..................................................................  311
Connecting an Expansion Rack to Oracle SuperCluster T5-8 ...............................  315
InfiniBand Switch Information for Oracle SuperCluster T5-8 .......................  315
InfiniBand Switch Information for the Oracle Exadata Storage Expansion
Rack ..................................................................................................  316
Connecting an Oracle Exadata Storage Expansion Quarter Rack to Oracle
SuperCluster T5-8 ................................................................................ 316
Connecting an Oracle Exadata Storage Expansion Half Rack or Oracle Exadata
Storage Expansion Full Rack to Oracle SuperCluster T5-8 ..........................  320
Two-Rack Cabling ...............................................................................  322
Three-Rack Cabling .............................................................................  324
Four-Rack Cabling ...............................................................................  326
Five-Rack Cabling ...............................................................................  328
Six-Rack Cabling ................................................................................. 332
Seven-Rack Cabling .............................................................................  336
Eight-Rack Cabling ..............................................................................  340
Nine-Rack Cabling ............................................................................... 345
Ten-Rack Cabling ................................................................................  345
Eleven-Rack Cabling ............................................................................  346
Twelve-Rack Cabling ...........................................................................  347
Thirteen-Rack Cabling ..........................................................................  348
Fourteen-Rack Cabling .........................................................................  348
Fifteen-Rack Cabling ............................................................................ 349
Sixteen-Rack Cabling ...........................................................................  350
Seventeen-Rack Cabling .......................................................................  351
Eighteen-Rack Cabling .........................................................................  351
10 Oracle SuperCluster T5-8 Owner's Guide • May 2016
Contents
Index ................................................................................................................  353
11
12 Oracle SuperCluster T5-8 Owner's Guide • May 2016
Using This Documentation
This document provides and overview of Oracle SuperCluster T5-8, and describes configuration
options, site preparation specifications, installation information, and administration tools.
■
Overview – Describes how to configure, install, tune, and monitor the system.
■
Audience – Technicians, system administrators, and authorized service providers.
■
Required knowledge – Advanced experience in system installation and administration.
Product Documentation Library
Documentation and resources for this product and related products are available on the system.
Access the documentation by using a browser to view this directory on the first compute server
installed in SuperCluster T5-8:
/opt/oracle/node/doc/E40166_01/index.html
Feedback
Provide feedback about this documentation at:
http://www.oracle.com/goto/docfeedback
Using This Documentation 13
14 Oracle SuperCluster T5-8 Owner's Guide • May 2016
Understanding the System
These topics describe the features and hardware components of Oracle SuperCluster T5-8.
These topics also describe the different software configurations that are available.
■
“Understanding Oracle SuperCluster T5-8” on page 15
■
“Identifying Hardware Components” on page 19
■
“Understanding the Hardware Components and Connections” on page 23
■
“Understanding the Software Configurations” on page 46
■
“Understanding Clustering Software” on page 84
■
“Understanding the Network Requirements” on page 86
Understanding Oracle SuperCluster T5-8
Oracle SuperCluster T5-8 is an integrated hardware and software system designed to provide
a complete platform for a wide range of application types and widely varied workloads.
Oracle SuperCluster T5-8 is intended for large-scale, performance-sensitive, mission-critical
application deployments. Oracle SuperCluster T5-8 combines industry-standard hardware and
clustering software, such as optional Oracle Database 11g Real Application Clusters (Oracle
RAC) and optional Oracle Solaris Cluster software. This combination enables a high degree of
isolation between concurrently deployed applications, which have varied security, reliability,
and performance requirements. Oracle SuperCluster T5-8 enables customers to develop a single
environment that can support end-to-end consolidation of their entire applications portfolio.
Oracle SuperCluster T5-8 provides an optimal solution for all database workloads, ranging from
scan-intensive data warehouse applications to highly concurrent online transaction processing
(OLTP) applications. With its combination of smart Oracle Exadata Storage Server Software,
complete and intelligent Oracle Database software, and the latest industry-standard hardware
components, Oracle SuperCluster T5-8 delivers extreme performance in a highly-available,
highly-secure environment. Oracle provides unique clustering and workload management
capabilities so Oracle SuperCluster T5-8 is well-suited for consolidating multiple databases into
a single grid. Delivered as a complete pre-optimized, and pre-configured package of software,
servers, and storage, Oracle SuperCluster T5-8 is fast to implement, and it is ready to tackle
your large-scale business applications.
Understanding the System 15
Understanding Oracle SuperCluster T5-8
Oracle SuperCluster T5-8 does not include any Oracle software licenses. Appropriate licensing
of the following software is required when Oracle SuperCluster T5-8 is used as a database
server:
■
Oracle Database Software
■
Oracle Exadata Storage Server Software
In addition, Oracle recommends that the following software is licensed:
■
Oracle Real Application Clusters
■
Oracle Partitioning
Oracle SuperCluster T5-8 is designed to fully leverage an internal InfiniBand fabric that
connects all of the processing, storage, memory, and external network interfaces within Oracle
SuperCluster T5-8 to form a single, large computing device. Each Oracle SuperCluster T5-8
is connected to data center networks through 10-GbE (traffic) and 1-GbE (management)
interfaces.
You can integrate Oracle SuperCluster T5-8 systems with Exadata or Exalogic machines
by using the available InfiniBand expansion ports and optional data center switches. The
InfiniBand technology used by Oracle SuperCluster T5-8 offers significantly high bandwidth,
low latency, hardware-level reliability, and security. If you are using applications that follow
Oracle's best practices for highly scalable, fault-tolerant systems, you do not need to make any
application architecture or design changes to benefit from Oracle SuperCluster T5-8. You can
connect many Oracle SuperCluster T5-8 systems, or a combination of Oracle SuperCluster T5-8
systems and Oracle Exadata Database Machines, to develop a single, large-scale environment.
You can integrate Oracle SuperCluster T5-8 systems with their current data center infrastructure
using the available 10-GbE ports in each SPARC T5-8 server.
Spares Kit Components
Oracle SuperCluster T5-8 includes a spares kit that includes the following components:
■
One of the following disks as a spare for the Exadata Storage Servers, depending on the
type of Exadata Storage Server:
■
X3-2 Exadata Storage Server:
- 600 GB 10 K RPM High Performance SAS disk
- 3 TB 7.2 K RPM High Capacity SAS disk
■
X4-2 Exadata Storage Server:
- 1.2 TB 10 K RPM High Performance SAS disk
- 4 TB 7.2 K RPM High Capacity SAS disk
16 Oracle SuperCluster T5-8 Owner's Guide • May 2016
Understanding Oracle SuperCluster T5-8
■
X5-2L Exadata Storage Server:
- 1.6 TB Extreme Flash drive
- 8 TB High Capacity SAS disk
■
X6-2L Exadata Storage Server:
- 3.2 TB Extreme Flash drive
- 8 TB High Capacity SAS disk
■
One High Capacity SAS disk as a spare for the ZFS storage appliance:
■
One 3 TB High Capacity SAS disk as a spare for the Sun ZFS Storage 7320 storage
appliance, or
■
One 4 TB High Capacity SAS disk as a spare for the Oracle ZFS Storage ZS3-ES
storage appliance
■
Exadata Smart Flash Cache card
■
InfiniBand cables, used to connect multiple racks together
Oracle SuperCluster T5-8 Restrictions
The following restrictions apply to hardware and software modifications to Oracle SuperCluster
T5-8. Violating these restrictions can result in loss of warranty and support.
■
Oracle SuperCluster T5-8 hardware cannot be modified or customized. There is one
exception to this. The only allowed hardware modification to Oracle SuperCluster T5-8
is to the administrative 48-port Cisco 4948 Gigabit Ethernet switch included with Oracle
SuperCluster T5-8. Customers may choose to the following:
■
Replace the Gigabit Ethernet switch, at customer expense, with an equivalent 1U
48-port Gigabit Ethernet switch that conforms to their internal data center network
standards. This replacement must be performed by the customer, at their expense and
labor, after delivery of Oracle SuperCluster T5-8. If the customer chooses to make
this change, then Oracle cannot make or assist with this change given the numerous
possible scenarios involved, and it is not included as part of the standard installation.
The customer must supply the replacement hardware, and make or arrange for this
change through other means.
■
Remove the CAT5 cables connected to the Cisco 4948 Ethernet switch, and connect
them to the customer's network through an external switch or patch panel. The customer
must perform these changes at their expense and labor. In this case, the Cisco 4948
Ethernet switch in the rack can be turned off and unconnected to the data center
network.
■
The Oracle Exadata Storage Expansion Rack can only be connected to Oracle SuperCluster
T5-8 or an Oracle Exadata Database Machine, and only supports databases running on the
Understanding the System 17
Understanding Oracle SuperCluster T5-8
Oracle Database (DB) Domains in Oracle SuperCluster T5-8 or on the database servers in
the Oracle Exadata Database Machine.
■
Standalone Exadata Storage Servers can only be connected to Oracle SuperCluster T5-8 or
an Oracle Exadata Database Machine, and only support databases running on the Database
Domains in Oracle SuperCluster T5-8 or on the database servers in the Oracle Exadata
Database Machine. The standalone Exadata Storage Servers must be installed in a separate
rack.
■
Earlier Oracle Database releases can be run in Application Domains running Oracle Solaris
10. Non-Oracle databases can be run in either Application Domains running Oracle Solaris
10 or Oracle Solaris 11, depending on the Oracle Solaris version they support.
■
Oracle Exadata Storage Server Software and the operating systems cannot be modified, and
customers cannot install any additional software or agents on the Exadata Storage Servers.
■
Customers cannot update the firmware directly on the Exadata Storage Servers. The
firmware is updated as part of an Exadata Storage Server patch.
■
Customers may load additional software on the Database Domains on the SPARC T5-8
servers. However, to ensure best performance, Oracle discourages adding software except
for agents, such as backup agents and security monitoring agents, on the Database Domains.
Loading non-standard kernel modules to the operating system of the Database Domains is
allowed but discouraged. Oracle will not support questions or issues with the non-standard
modules. If a server crashes, and Oracle suspects the crash may have been caused by a non-
standard module, then Oracle support may refer the customer to the vendor of the non-
standard module or ask that the issue be reproduced without the non-standard module.
Modifying the Database Domain operating system other than by applying official patches
and upgrades is not supported. InfiniBand-related packages should always be maintained at
the officially supported release.
■
Oracle SuperCluster T5-8 supports separate domains dedicated to applications, with high
throughput/low latency access to the database domains through InfiniBand. Since Oracle
Database is by nature a client server, applications running in the Application Domains can
connect to database instances running in the Database Domain. Applications can be run in
the Database Domain, although it is discouraged.
■
Customers cannot connect USB devices to the Exadata Storage Servers except as
documented in Oracle Exadata Storage Server Software User's Guide and this guide. In
those documented situations, the USB device should not draw more than 100 mA of power.
■
The network ports on the SPARC T5-8 servers can be used to connect to external non-
Exadata Storage Servers using iSCSI or NFS. However, the Fibre Channel Over Ethernet
(FCoE) protocol is not supported.
■
Only switches specified for use in Oracle SuperCluster T5-8, Oracle Exadata Rack
and Oracle Exalogic Elastic Cloud may be connected to the InfiniBand network. It is
not supported to connect third-party switches and other switches not used in Oracle
SuperCluster T5-8, Oracle Exadata Rack and Oracle Exalogic Elastic Cloud.
18 Oracle SuperCluster T5-8 Owner's Guide • May 2016
Identifying Hardware Components
Identifying Hardware Components
Oracle SuperCluster T5-8 consists of SPARC T5-8 servers, Exadata Storage Servers, and the
ZFS storage appliance (Sun ZFS Storage 7320 appliance or Oracle ZFS Storage ZS3-ES storage
appliance), as well as required InfiniBand and Ethernet networking components.
This section contains the following topics:
■
“Full Rack Components” on page 20
■
“Half Rack Components” on page 22
Understanding the System 19
Identifying Hardware Components
Full Rack Components
FIGURE 1
Oracle SuperCluster T5-8 Full Rack Layout, Front View
20 Oracle SuperCluster T5-8 Owner's Guide • May 2016
/