Sun Microsystems CP3220 User manual

Sun Microsystems, Inc.

www.sun.com

Submit comments about this document at: http://www.sun.com/hwdocs/feedback

Sun Netra

™

CP3220 Blade Server

User’s Guide

Part No. 820-1982-12

January 2010, Revision 01

Please

Recycle

This distribution may include materials developed by third parties.

Parts of the product may be derived from Berkeley BSD systems, licensed from the University of California. UNIX is a registered trademark in

the U.S. and in other countries, exclusively licensed through X/Open Company, Ltd.

Sun, Sun Microsystems, the Sun logo, Sun Netra, Netra, Solaris, SunVTS and the Netra logo are trademarks or registered trademarks of Sun

Microsystems, Inc., or its subsidiaries, in the U.S. and other countries.

AMD and Opteron are trademarks or registered trademarks of Advanced Micro Devices. PICMG is a registered trademark and AdvancedTCA

and ATCA are trademarks of the PCI Industrial Computer Manufacturers Group. The Adobe. logo is a registered trademark of Adobe Systems,

Incorporated. The Adobe. logo is a registered trademark of Adobe Systems, Incorporated.

Products covered by and information contained in this service manual are controlled by U.S. Export Control laws and may be subject to the

export or import laws in other countries. Nuclear, missile, chemical biological weapons or nuclear maritime end uses or end users, whether

direct or indirect, are strictly prohibited. Export or reexport to countries subject to U.S. embargo or to entities identiﬁed on U.S. export exclusion

lists, including, but not limited to, the denied persons and specially designated nationals lists is strictly prohibited

Use of any spare or replacement CPUs is limited to repair or one-for-one replacement of CPUs in products exported in compliance with U.S.

export laws. Use of CPUs as product upgrades unless authorized by the U.S. Government is strictly prohibited.

DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES,

INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT,

ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID

Cette distribution peut comprendre des composants développés par des tierces parties.

Des parties de ce produit pourront être dérivées des systèmes Berkeley BSD licenciés par l’Université de Californie. UNIX est une marque

déposée aux Etats-Unis et dans d’autres pays et licenciée exclusivement par X/Open Company, Ltd.

Sun, Sun Microsystems, le logo Sun, Sun Netra, Netra, Solaris, SunVTS et le logo Netra sont des marques de fabrique ou des marques

déposées de Sun Microsystems, Inc., ou ses ﬁliales, aux Etats-Unis et dans d’autres pays.

AMD et Opteron sont des marques de fabrique ou des marques déposées de Advanced Micro Devices. PICMG est une marque déposée et

AdvancedTCA et ATC A des marques de PCI Industrial Computer Manufacturers Group. Le logo Adobe. est une marque déposée de Adobe

Systems, Incorporated.

Ce produit est soumis à la législation américaine en matière de contrôle des exportations et peut être soumis à la règlementation en vigueur

dans d’autres pays dans le domaine des exportations et importations. Les utilisations , ou utilisateurs ﬁnaux, pour des armes nucléaires, des

missiles, des armes biologiques et chimiques ou du nucléaire maritime, directement ou indirectement, sont strictement interdites. Les

exportations ou reexportations vers les pays sous embargo américain, ou vers des entités ﬁgurant sur les listes d’exclusion d’exportation

américaines, y compris, mais de manière non exhaustive, la liste de personnes qui font objet d’un ordre de ne pas participer, d’une façon directe

ou indirecte, aux exportations des produits ou des services qui sont régis par la législation américaine en matière de contrôle des exportations et

la liste de ressortissants spéciﬁquement désignés, sont rigoureusement interdites.

L’utilisation de pièces détachées ou d’unités centrales de remplacement est limitée aux réparations ou à l’échange standard d’unités centrales

pour les produits exportés, conformément à la législation américaine en matière d’exportation. Sauf autorisation par les autorités des Etats-

Unis, l’utilisation d’unités centrales pour procéder à des mises à jour de produits est rigoureusement interdite.

LA DOCUMENTATION EST FOURNIE "EN L’ETAT" ET TOUTES AUTRES CONDITIONS, DECLARATIONS ET GARANTIES EXPRESSES

OU TACITES SONT FORMELLEMENT EXCLUES, DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE, Y COMPRIS NOTAMMENT

TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE, A L’APTITUDE A UNE UTILISATION PARTICULIERE OU A

L’ABSENCE DE CONTREFACON.

iii

Contents

Preface xv

1. Introduction 1–1

1.1 Overview 1–2

1.2 Features 1–2

1.3 Physical Description 1–3

1.3.1 Front Panel Components 1–3

1.3.2 Blade Server Diagram 1–6

1.4 System Configurations 1–7

1.4.1 AMC Modules 1–7

1.4.2 Advanced Rear Transition Module 1–8

1.5 Hot-Swap Support 1–12

1.6 System Components 1–12

1.6.1 Required Hardware Components 1–12

1.6.2 Optional Hardware Components 1–13

1.6.3 Software Components 1–13

1.7 Technical Support and Warranty 1–14

1.7.1 Locating the Blade Server Identification Information 1–14

iv Sun Netra CP3220 Blade Server User’s Guide • January 2010

2. Hardware Installation and Service 2–1

2.1 Safety and Tool Requirements 2–2

2.1.1 Equipment and Operator Safety 2–2

2.1.2 Materials and Tools Required 2–3

2.2 Installing the Blade Server 2–3

2.2.1 Preparing for the Installation 2–3

2.2.1.1 Check Power, Thermal, Environmental, and Space

Requirements 2–4

2.2.1.2 Local Network IP Addresses and Host Names

Worksheet 2–5

2.2.1.3 Installation Procedure Summary 2–6

2.2.2 Configuring the Hardware 2–6

2.2.2.1 Verify Chassis Fan Tray Upgrade 2–7

2.2.2.2 Installing Optional Components 2–7

2.2.2.3 Configuring the Advanced Rear Transition Module

Hardware 2–8

2.2.3 Installing the Sun Netra CP3220 Blade Server in an ATCA Shelf

2–8

2.2.3.1 Installing an Advanced Rear Transition Module 2–8

▼ To Install an ARTM 10

2.2.3.2 Installing the Blade Server Into the Shelf 2–12

2.2.4 Connecting External I/O Cables 2–13

2.2.4.1 Connecting Cables to a System Console Running the

Solaris OS 2–13

2.2.4.2 Connecting Cables to the System Console Not Running

the Solaris OS 2–15

2.2.4.3 Netinstall Boot Device Map 2–15

2.3 Service Procedures 2–17

2.3.1 Hot-Swapping the Sun Netra CP3220 Blade Server 2–17

2.3.2 Powering Off the Sun Netra CP3220 Blade Server 2–17

2.3.3 Removing the Sun Netra CP3220 Blade Server 2–18

Contents v

2.3.4 Powering On the System 2–18

2.3.5 Automatic Power-Off Events 2–18

2.3.6 Servicing DIMMs 2–19

2.3.6.1 DIMM Requirements 2–19

2.3.6.2 Installing a DDR2 DIMM 2–21

2.3.6.3 Removing a DDR2 DIMM 2–22

2.3.7 Installing the Optional Compact Flash Card 2–24

2.3.8 Installing Optional AMC Cards 2–26

2.3.9 Adding or Replacing a TOD Clock Battery 2–29

2.3.10 Changing Jumper Settings 2–29

2.3.10.1 Clearing the CMOS Setting Using Jumper 1 2–29

2.3.10.2 Changing the OOS LED Color 2–32

2.3.11 Changing OOS LED Behavior 2–32

▼ Viewing OOS LED Settings 34

▼ Setting OOS LED Behavior 35

2.3.12 Resetting the Sun Netra CP3220 Blade Server 2–36

3. Software Configuration 3–1

3.1 Operating Systems 3–2

3.2 Software Updates 3–2

3.3 SunVTS Software 3–3

3.4 Configuring Sun Netra CP3220 For 1GbE or 10GbE Switches 3–4

3.5 Configuring Alternate OOS LED Behavior 3–5

▼ Displaying Configuration of OOS LED Behavior 6

▼ Setting Configuration of OOS LED Behavior 7

vi Sun Netra CP3220 Blade Server User’s Guide • January 2010

4. Configuring and Using BIOS Firmware 4–1

4.1 About BIOS Settings 4–2

4.1.1 Navigating BIOS Screens 4–2

4.1.2 BIOS Considerations 4–2

4.1.2.1 BIOS Option ROMs on the Sun Netra CP3220 Blade

Server 4–2

4.1.2.2 AMD PowerNow! Feature Enabled by Default 4–3

4.1.3 Description of the BIOS Screens 4–3

4.2 Changing the Configuration of a BIOS Menu Item 4–4

4.3 Setting the Boot Device Using BIOS Setup Screens 4–5

4.4 Changing the BIOS Continuous Boot Setting 4–9

4.5 Setting Supervisor and User Passwords 4–9

4.6 Resetting the System Time and System Date 4–11

4.7 Updating the BIOS 4–12

4.8 Secondary BIOS Image 4–12

4.9 Use the Secondary BIOS Image 4–12

4.10 Perform a Live Firmware Upgrade 4–13

4.11 Power-On Self-Test 4–14

4.12 Changing POST Options 4–14

5. Hardware Architecture 5–1

5.1 Block Diagram 5–2

5.2 The AMD Opteron Processor 5–3

5.3 Memory 5–4

5.4 Networking and I/O 5–5

5.4.1 nVidia MCP55 5–5

5.4.2 PCI Express Bus 5–6

5.4.3 Dual BIOS 5–6

5.4.4 Trusted Platform Module (TPM) 5–6

Contents vii

5.4.5 Broadcom 5715C Gigabit Ethernet 5–6

5.4.6 Sun Dual 10-Gbit Ethernet/Quad 1-Gbit RGMII Network Interface

Chip (Sun 10 GbE Multithreaded Networking ASIC) 5–7

5.5 I/O Components 5–7

5.5.1 AMC Slots 5–7

5.5.2 EIDE/ATA for Compact Flash 5–8

5.5.3 SAS/SATA 5–8

A. Physical Characteristics A–1

A.1 Form Factor A–2

A.2 Power and Thermal Metrics A–2

A.2.1 Processor Metrics A–2

A.2.2 PICMG Board Cooling Requirements A–3

A.2.3 PICMG ARTM Cooling Requirements A–3

A.3 Connectors and Pinouts A–4

A.3.1 Front Panel Connectors A–4

A.3.1.1 Ethernet Port A–4

A.3.1.2 USB Ports A–5

A.3.1.3 Serial Port A–6

A.3.2 AMC Connectors A–6

A.3.3 Power Connector (Zone 1) A–7

A.3.4 Data Transport Connector (Zone 2) A–9

A.3.5 Advanced Rear Transition Module Connector (Zone 3) A–10

B. BIOS Screens B–1

Index Index–1

viii Sun Netra CP3220 Blade Server User’s Guide • January 2010

ix

Figures

FIGURE 1-1 Sun Netra CP3220 Dual-Core Blade Server (Front View) 1–4

FIGURE 1-2 Sun Netra CP3220 Quad-Core Blade Server (Front View) 1–5

FIGURE 1-3 Sun Netra CP3220 Blade Server (Component Side View) 1–6

FIGURE 1-4 Sun Netra CP3220 Blade Server in Shelf Enclosure 1–7

FIGURE 1-5 Sun Netra CP32x0 SAS Storage Advanced Rear Transition Module, Dual HD 1–8

FIGURE 1-6 Sun Netra CP3220 Blade Server, Backplane, and Relationship to ARTM 1–10

FIGURE 1-7 Sun Netra CP3220 Blade Server Barcode Labeling 1–15

FIGURE 2-1 Installing the Sun Netra CP32x0 ARTM 2–9

FIGURE 2-2 Injector/Ejector Latch and Locking Screw on the ARTM 2–11

FIGURE 2-3 Serial Port on the Sun Netra CP3220 Blade Server 2–14

FIGURE 2-4 Locating DIMM Slots 2–20

FIGURE 2-5 Installing a DIMM 2–22

FIGURE 2-6 Removing a DIMM 2–23

FIGURE 2-7 Compact Flash Location 2–25

FIGURE 2-8 Removing an AMC Filler Panel 2–27

FIGURE 2-9 Installing an AMC Card 2–28

FIGURE 2-10 Jumper 1 in the Run Position 2–30

FIGURE 2-11 Jumper 1 in the Reset Position 2–31

FIGURE 2-12 Jumper 2 in the Red Position 2–32

FIGURE 2-13 Sun Netra CP3220 Blade Server Front Panel 2–36

x Sun Netra CP3220 Blade Server User’s Guide • January 2010

FIGURE 4-1 BIOS Main Menu 4–6

FIGURE 4-2 Boot Settings Menu 4–7

FIGURE 4-3 Boot Device Priority Menu 4–8

FIGURE 4-4 Security Settings Menu 4–10

FIGURE 4-5 Change Password Menu 4–10

FIGURE 5-1 Block Diagram 5–2

FIGURE 5-2 AMD Opteron Processors Block Diagram 5–4

FIGURE A-1 Ethernet RJ-45 Connector A–4

FIGURE A-2 Front Panel USB Connector A–5

FIGURE A-3 Front Panel Serial RJ-45 Connector A–6

FIGURE A-4 Power Distribution Connector (Zone 1) P10 A–7

FIGURE A-5 Zone 2 Connector A–9

FIGURE A-6 Zone 3 Connector A–11

FIGURE B-1 BIOS Menu Tree B–2

FIGURE B-2 BIOS Main Menu B–3

FIGURE B-3 Advanced Configuration Menu B–3

FIGURE B-4 CPU Configuration Menu B–4

FIGURE B-5 IDE Configuration Menu B–4

FIGURE B-6 Super IO Configuration Menu B–5

FIGURE B-7 ACPI Settings Menu B–5

FIGURE B-8 Event Logging Details Menu B–6

FIGURE B-9 MPS Configuration Menu B–6

FIGURE B-10 PCI Express Configuration Menu B–7

FIGURE B-11 SMBIOS Configuration Menu B–7

FIGURE B-12 Remote Access Configuration Menu B–8

FIGURE B-13 USB Configuration Menu B–8

FIGURE B-14 Advanced PCI/PnP Settings Menu B–9

FIGURE B-15 Advanced PCI/PnP Settings Menu Continued B–9

FIGURE B-16 Boot Settings Menu B–10

FIGURE B-17 Boot Settings Configuration Menu B–10

Figures xi

FIGURE B-18 Boot Device Priority Menu B–11

FIGURE B-19 Boot Hard Disk Drive Priority Menu B–11

FIGURE B-20 Security Settings Menu B–12

FIGURE B-21 Change Password Settings Menu B–12

FIGURE B-22 Chipset Main Menu B–13

FIGURE B-23 NorthBridge Chipset Configuration Menu B–13

FIGURE B-24 NorthBridge Chipset Memory Configuration Menu B–14

FIGURE B-25 NorthBridge Chipset ECC Configuration Menu B–14

FIGURE B-26 NorthBridge Chipset DRAM Configuration Menu B–15

FIGURE B-27 SouthBridge Chipset Configuration Menu B–15

FIGURE B-28 Hyper Transport Configuration Menu B–16

FIGURE B-29 Exit Options Menu B–16

xii Sun Netra CP3220 Blade Server User’s Guide • January 2010

xiii

Tables

TABLE 1-1 I/O Configurations 1–11

TABLE 2-1 Local Area Network Information 2–5

TABLE 2-2 Netinstall Boot Device Table 2–15

TABLE 2-3 Extra MAC Addresses for Virtual LAN Configuration 2–16

TABLE 2-4 Pin Functions on Jumper 1 2–30

TABLE 4-1 BIOS Setup Screens Summary 4–3

TABLE 4-2 POST Options 4–15

TABLE A-1 Airflow Requirements A–3

TABLE A-2 ARTM Pressure Drop A–3

TABLE A-3 Ethernet Port Connector Pin Assignments A–4

TABLE A-4 USB Port Pin Assignments A–5

TABLE A-5 Serial Port Mini DIN 8-pin Connector Pinouts A–6

TABLE A-6 Power Distribution Connector Pin Assignments A–7

TABLE A-7 Zone 2 Connector Pin Assignments A–10

TABLE A-8 J31 Connector Pin Assignments A–11

TABLE A-9 J32 Connector Pin Assignments A–12

TABLE A-10 J33 Connector Pin Assignments A–12

xiv Sun Netra CP3220 Blade Server User’s Guide • January 2010

xv

Preface

The Sun Netra CP3220 Blade Server User’s Guide describes the hardware specifications,

function, and physical properties of the Sun Netra™ CP3220 blade server. It also

provides detailed information on the system firmware.

The Sun Netra CP3220 Blade Server User ’s Guide is written for system integration

engineers, field applications and service engineers, and others involved in the

integration of this blade server into systems. This guide is written for personnel who

are familiar with the Solaris™ Operating System, the Linux operating systems and

Advanced Telecommunications Computing Architecture (ATCA) computing

environment.

How This Document Is Organized

Chapter 1 provides an overview of the Sun Netra CP3220 blade server.

Chapter 2 provides instructions on hardware installation.

Chapter 3 provides information on the supported operating systems and on the Sun

Validation Test Suite (SunVTS™) software.

Chapter 4 provides information on the Sun Netra CP3220 blade server firmware.

Chapter 5 provides information on hardware architecture.

Appendix A provides information on the Sun Netra CP3220 blade server physical

characteristics.

Appendix B provides first-level and second-level BIOS menu illustrations.

xvi Sun Netra CP3220 Blade Server User’s Guide • January 2010

Using UNIX Commands

This document might not contain information about basic UNIX

®

commands and

procedures such as shutting down the system, booting the system, and configuring

devices. Refer to the following for this information:

■ Software documentation that you received with your system

■ Solaris™ Operating System documentation, which is at:

http://docs.sun.com/app/docs/prod/solaris

Shell Prompts

Shell Prompt

C shell machine-name%

C shell superuser machine-name#

Bourne shell and Korn shell $

Bourne shell and Korn shell superuser #

Preface xvii

Typographic Conventions

Related Documentation

The following table lists the documentation for this product. Except for the Important

Safety Information for Sun Hardware Systems, all the documents listed are available

online at:

http://docs.sun.com/app/docs/prod/cp3220.brd#hic

Typeface

*

* The settings on your browser might differ from these settings.

Meaning Examples

AaBbCc123 The names of commands, files,

and directories; on-screen

computer output

Edit your.login file.

Use ls -a to list all files.

% You have mail.

AaBbCc123 What you type, when contrasted

with on-screen computer output

%

su

Password:

AaBbCc123 Book titles, new words or terms,

words to be emphasized.

Replace command-line variables

with real names or values.

Read Chapter 6 in the User ’s Guide.

These are called class options.

You must be superuser to do this.

To delete a file, type rm filename.

Application Title Part Number Format Location

Getting

Started

Sun Netra CP3220 Blade Server

Getting Started Guide

820-1981 Printed,

PDF,

HTML

Shipkit and Online

Latest

Information

Sun Netra CP3220 Blade Server

Product Notes

820-1980 PDF,

HTML

Online

Installation

and Usage

Sun Netra CP3220 Blade Server

User ’s Guide (this manual)

820-1982 PDF,

HTML

Online

Safety and

Compliance

Sun Netra CP3220 Blade Server

Safety and Compliance Guide

820-1983 PDF,

HTML

Online

Safety Important Safety Information for

Sun Hardware Systems

816-7190 Printed Shipkit

xviii Sun Netra CP3220 Blade Server User’s Guide • January 2010

Documentation, Support, and Training

Third-Party Web Sites

Sun is not responsible for the availability of third-party web sites mentioned in this

document. Sun does not endorse and is not responsible or liable for any content,

advertising, products, or other materials that are available on or through such sites

or resources. Sun will not be responsible or liable for any actual or alleged damage

or loss caused by or in connection with the use of or reliance on any such content,

goods, or services that are available on or through such sites or resources.

Sun Welcomes Your Comments

Sun is interested in improving its documentation and welcomes your comments and

suggestions. You can submit your comments by going to:

http://www.sun.com/hwdocs/feedback

Please include the title and part number of your document with your feedback:

Sun Netra CP3220 Blade Server User’s Guide, part number 820-1982-12.

Sun Function URL

Documentation http://docs.sun.com/documentation

Support http://www.sun.com/support/

Training http://www.sun.com/training/

1-1

CHAPTER

1

Introduction

This chapter provides an overview of the features, configurations, and system

requirements of the Sun Netra CP3220 blade server.

This chapter contains the following topics:

■ Section 1.1, “Overview” on page 1-2

■ Section 1.2, “Features” on page 1-2

■ Section 1.3, “Physical Description” on page 1-3

■ Section 1.4, “System Configurations” on page 1-7

■ Section 1.5, “Hot-Swap Support” on page 1-12

■ Section 1.6, “System Components” on page 1-12

■ Section 1.7, “Technical Support and Warranty” on page 1-14

1-2 Sun Netra CP3220 Blade Server User’s Guide • January 2010

1.1 Overview

The Sun Netra CP3220 blade server is a high-performance, single-board computer

based on an AMD Opteron X64 processor. The blade server is designed for high

availability in a switched network computing environment. This blade server is

compliant with Advanced Telecommunications Computing Architecture (ATCA)

specifications (PICMG 3.0 and PICMG 3.1). It can achieve greater performance levels

than previously supported CompactPCI® (cPCI) standards-based products targeted

for Telco markets.

The ATCA standard comprises the PICMG 3.0, 3.1, 3.2, and 3.3 versions of the

standard. The Sun Netra CP3220 blade server complies with the following

specifications:

■ PICMG 3.0, the base specification that defines the mechanical, power distribution,

system management, data transport, and regulatory guidelines

■ PICMG 3.1, which builds on the PICMG 3.0 base specification and on

IEEE 802.3-2003

1.2 Features

The Sun Netra CP3220 blade server features include:

■ ATCA card 322.25 mm x 280 mm, 1.2 inch slot card height

■ One 1207-pin socket, AMD Opteron dual or quad core versions at up to 68w

■ Double Data Rate (DDR-2) DIMMs, at up to 667 MHz DIMMs (8 modules per

card), up to 4-Gbyte/DIMM, in Very Low Profile design (0.72’ height)

■ nVidia MCP-55 PCIe and Southbridge media controller

■ Two AMC.1 Type 4S2E2 expansion slots (PCIe x4) supporting I/O expansion with

signaling to the Rear Transition Module (RTM)

■ Two 1000 BASE-T Ethernet base fabric (PICMG 3.0) interface ports (using

BCM5715C) from PCIe 4x

■ Two 10 Gigabit XUAI Ethernet Extended Fabric (PICMG 3.1) interface ports

(using Sun 10 GbE Multithreaded Networking ASIC) from PCIe x8

■ One Asychronous Serial port to RJ 45 on front panel, from SuperIO

■ One 10/100/1000BASE-T management port on front panel, with second

management LAN sent to the advanced rear transition module (ARTM)

Page is loading ...

Sun Microsystems CP3220 User manual

Sun Microsystems CP3220 User manual

Related papers

Other documents