IBM High Performance Storage System HPSS User manual

HPSS

Installation Guide

High Performance Storage System

Release 4.5

September 2002 (Revision 2)

2 September 2002 HPSS Installation Guide

Release 4.5, Revision 2

HPSS Installation Guide

California, Sandia Corporation, and Lockheed Martin Energy Research Corporation.

Portions of this work were produced by the University of California, Lawrence Livermore National Labo-

ratory (LLNL) under Contract No. W-7405-ENG-48 with the U.S. Department of Energy (DOE), by the Uni-

versity of California, Lawrence Berkeley National Laboratory (LBNL) under Contract No.

DEAC03776SF00098 with DOE, by the University of California, Los Alamos National Laboratory (LANL)

under Contract No. W-7405-ENG-36 with DOE, by Sandia Corporation, Sandia National Laboratories

(SNL) under Contract No. DEAC0494AL85000 with DOE, and Lockheed Martin Energy Research Corpora-

tion, Oak Ridge National Laboratory (ORNL) under Contract No. DE-AC05-96OR22464 with DOE. The

U.S. Government has certain reserved rights under its prime contracts with the Laboratories.

DISCLAIMER

Portions of this software were sponsored by an agency of the United States Government. Neither the Unit-

ed States, DOE, The Regents of the University of California, Sandia Corporation, Lockheed Martin Energy-

Research Corporation,nor any of their employees, makes any warranty, express or implied, or assumes any

liability or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, prod-

uct, or process disclosed, or represents that its use would not infringe privately owned rights.

Printed in the United States of America.

HPSS Release 4.5

September 2002 (Revision 2)

High Performance Storage System is a registered trademark of International Business Machines Corporation.

HPSS Installation Guide September 2002 3

Release 4.5, Revision 2

Table of Contents

Table of Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

List of Figures. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

List of Tables. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

Preface. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

Chapter 1 HPSS Basics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

1.1 Introduction...............................................................................................................19

1.2 HPSS Capabilities......................................................................................................19

Network-centered Architecture.............................................................................19

High Data Transfer Rate........................................................................................20

Parallel Operation Built In ....................................................................................20

A Design Based on Standard Components............................................................20

Data Integrity Through Transaction Management................................................20

Multiple Hierarchies and Classes of Services.......................................................20

Storage Subsystems...............................................................................................21

Federated Name Space..........................................................................................21

1.3 HPSS Components ....................................................................................................21

HPSS Files, Filesets, Volumes, Storage Segments and Related Metadata ...........22

HPSS Core Servers................................................................................................25

HPSS Storage Subsystems ....................................................................................29

HPSS Infrastructure...............................................................................................31

HPSS User Interfaces............................................................................................33

HPSS Management Interface ................................................................................35

HPSS Policy Modules ...........................................................................................35

1.4 HPSS Hardware Platforms.......................................................................................37

Client Platforms.....................................................................................................37

Server and Mover Platforms..................................................................................38

Chapter 2 HPSS Planning. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39

2.1 Overview.....................................................................................................................39

HPSS Configuration Planning...............................................................................39

Purchasing Hardware and Software ......................................................................41

4 September 2002 HPSS Installation Guide

Release 4.5, Revision 2

HPSS Operational Planning ..................................................................................42

HPSS Deployment Planning .................................................................................43

2.2 Requirements and Intended Usages for HPSS .......................................................43

Storage System Capacity.......................................................................................43

Required Throughputs...........................................................................................44

Load Characterization ...........................................................................................44

Usage Trends.........................................................................................................44

Duplicate File Policy.............................................................................................44

Charging Policy.....................................................................................................44

Security..................................................................................................................45

Availability............................................................................................................46

2.3 Prerequisite Software Considerations.....................................................................46

Overview ...............................................................................................................46

Prerequisite Summary for AIX..............................................................................50

Prerequisite Summary for IRIX ............................................................................50

Prerequisite Summary for Solaris..........................................................................51

Prerequisite Summary for Linux and Intel............................................................52

2.4 Hardware Considerations.........................................................................................53

Network Considerations........................................................................................53

Tape Robots...........................................................................................................54

Tape Devices.........................................................................................................56

Disk Devices..........................................................................................................57

Special Bid Considerations ...................................................................................57

2.5 HPSS Interface Considerations................................................................................58

Client API..............................................................................................................58

Non-DCE Client API.............................................................................................58

FTP........................................................................................................................59

Parallel FTP...........................................................................................................59

NFS........................................................................................................................59

MPI-IO API...........................................................................................................60

DFS........................................................................................................................61

XFS........................................................................................................................62

2.6 HPSS Server Considerations....................................................................................62

Name Server..........................................................................................................62

Bitfile Server .........................................................................................................63

Disk Storage Server...............................................................................................64

Tape Storage Server ..............................................................................................64

Migration/Purge Server.........................................................................................65

Gatekeeper.............................................................................................................68

Location Server .....................................................................................................70

PVL .......................................................................................................................70

PVR .......................................................................................................................71

Mover ....................................................................................................................72

Logging Service ....................................................................................................77

HPSS Installation Guide September 2002 5

Release 4.5, Revision 2

Metadata Monitor..................................................................................................77

NFS Daemons........................................................................................................77

Startup Daemon.....................................................................................................78

Storage System Management................................................................................79

HDM Considerations.............................................................................................79

Non-DCE Client Gateway.....................................................................................81

2.7 Storage Subsystem Considerations..........................................................................81

2.8 Storage Policy Considerations..................................................................................81

Migration Policy....................................................................................................82

Purge Policy ..........................................................................................................84

Accounting Policy and Validation ........................................................................85

Security Policy ......................................................................................................87

Logging Policy ......................................................................................................89

Location Policy......................................................................................................89

Gatekeeping...........................................................................................................90

2.9 Storage Characteristics Considerations..................................................................91

Storage Class.........................................................................................................93

Storage Hierarchy................................................................................................101

Class of Service...................................................................................................102

File Families........................................................................................................105

2.10 HPSS Sizing Considerations...................................................................................105

HPSS Storage Space............................................................................................106

HPSS Metadata Space.........................................................................................106

System Memory and Disk Space.........................................................................132

2.11 HPSS Performance Considerations.......................................................................135

DCE.....................................................................................................................136

Encina..................................................................................................................136

Workstation Configurations ................................................................................137

Bypassing Potential Bottlenecks .........................................................................137

Configuration.......................................................................................................138

FTP/PFTP............................................................................................................138

Client API............................................................................................................139

Name Server........................................................................................................139

Location Server ...................................................................................................139

Logging ...............................................................................................................140

MPI-IO API.........................................................................................................140

Cross Cell ............................................................................................................141

DFS......................................................................................................................141

XFS......................................................................................................................141

Gatekeeping.........................................................................................................142

2.12 HPSS Metadata Backup Considerations...............................................................142

Rules for Backing Up SFS Log Volume and MRA Files ...................................143

Rules for Backing Up SFS Data Volumes and TRB Files..................................143

6 September 2002 HPSS Installation Guide

Release 4.5, Revision 2

Miscellaneous Rules for Backing Up HPSS Metadata .......................................144

Chapter 3 System Preparation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145

3.1 General.....................................................................................................................145

3.2 Setup Filesystems.....................................................................................................146

DCE.....................................................................................................................146

Encina..................................................................................................................147

HPSS ...................................................................................................................147

3.3 Planning for Encina SFS Servers...........................................................................147

AIX......................................................................................................................148

Solaris..................................................................................................................148

3.4 Setup for HPSS Metadata Backup.........................................................................149

3.5 Setup Tape Libraries and Drives...........................................................................149

IBM 3584 ............................................................................................................149

3494.....................................................................................................................150

STK .....................................................................................................................151

AML....................................................................................................................151

Tape Drive Verification.......................................................................................152

3.6 Setup Disk Drives ....................................................................................................155

AIX......................................................................................................................155

Linux ...................................................................................................................157

Solaris & IRIX.....................................................................................................158

3.7 Setup Network Parameters.....................................................................................158

HPSS.conf Configuration File.............................................................................162

SP/x Switch Device Buffer Driver Buffer Pools.................................................174

3.8 Install and Configure Java and hpssadm..............................................................175

Introduction .........................................................................................................175

Installing Java......................................................................................................181

Configuring SSL..................................................................................................183

Configuring the Java Security Policy File...........................................................186

Setting up the Client Authorization File..............................................................188

Setting up the hpssadm Keytab File....................................................................189

Securing the Data Server and Client Host Machines ..........................................190

Updating Expired SSL Certificates.....................................................................191

Background Information .....................................................................................191

3.9 Setup Linux Environment for XFS........................................................................194

Apply the HPSS Linux XFS Patch......................................................................194

Create the DMAPI Device ..................................................................................195

3.10 Setup Linux Environment for Non-DCE Mover..................................................195

3.11 Verify System Readiness.........................................................................................196

HPSS Installation Guide September 2002 7

Release 4.5, Revision 2

Chapter 4 HPSS Installation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 205

4.1 Overview...................................................................................................................205

Distribution Media ..............................................................................................205

Installation Packages...........................................................................................205

Installation Roadmap...........................................................................................206

4.2 Create Owner Account for HPSS Files .................................................................207

4.3 Installation Target Directory Preparation............................................................207

4.4 Install HPSS Package on a Node............................................................................207

AIX Installation...................................................................................................207

Solaris Installation...............................................................................................208

IRIX Installation..................................................................................................209

Linux Installation ................................................................................................209

4.5 Post Installation Procedures...................................................................................209

Verify HPSS Installed Files ................................................................................209

Remake HPSS .....................................................................................................210

Set Up Sammi License Key.................................................................................213

Chapter 5 HPSS Infrastructure Configuration . . . . . . . . . . . . . . . . . . . . . . . 215

5.1 Overview...................................................................................................................215

Infrastructure Road Map .....................................................................................215

5.2 Verify the Prerequisite Software............................................................................215

5.3 Define the HPSS Environment Variables .............................................................216

hpss_env.default..................................................................................................216

hpss_env_defs.h ..................................................................................................221

5.4 Configure the HPSS Infrastructure on a Node.....................................................240

5.5 Using the mkhpss Utility.........................................................................................241

Configure HPSS with DCE.................................................................................242

Configure Encina SFS Server..............................................................................243

Manage SFS Files................................................................................................244

Setup FTP Daemon .............................................................................................244

Setup Startup Daemon.........................................................................................244

Add SSM Administrative User............................................................................244

Start Up SSM Servers/User Session....................................................................245

Re-run hpss_env() ...............................................................................................245

Un-configure HPSS.............................................................................................245

5.6 Customize DCE Keytabs Files................................................................................246

Chapter 6 HPSS Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 249

6.1 Overview...................................................................................................................249

HPSS Configuration Roadmap............................................................................249

8 September 2002 HPSS Installation Guide

Release 4.5, Revision 2

HPSS Configuration Limits.................................................................................250

Using SSM for HPSS Configuration...................................................................251

Server Reconfiguration and Reinitialization.......................................................252

6.2 SSM Configuration and Startup............................................................................252

SSM Server Configuration and Startup...............................................................253

SSM User Session Configuration and Startup ....................................................253

6.3 Global Configuration..............................................................................................255

Configure the Global Configuration Information ...............................................255

Global Configuration Variables ..........................................................................256

6.4 Storage Subsystems Configuration........................................................................259

Storage Subsystem Configuration Variables.......................................................260

6.5 Basic Server Configuration ....................................................................................262

Configure the Basic Server Information .............................................................263

6.6 HPSS Storage Policy Configuration......................................................................279

Configure the Migration Policies ........................................................................280

Configure the Purge Policies...............................................................................285

Configure the Accounting Policy........................................................................289

Configure the Logging Policies...........................................................................293

Configure the Location Policy ............................................................................300

Configure the Remote Site Policy.......................................................................303

6.7 HPSS Storage Characteristics Configuration.......................................................305

Configure the Storage Classes.............................................................................305

Configure the Storage Hierarchies ......................................................................315

Configure the Classes of Service.........................................................................318

File Family Configuration...................................................................................322

6.8 Specific Server Configuration................................................................................323

Bitfile Server Specific Configuration..................................................................324

DMAP Gateway Specific Configuration.............................................................329

Gatekeeper Specific Configuration .....................................................................331

Log Client Specific Configuration ......................................................................333

Log Daemon Specific Configuration ..................................................................336

Metadata Monitor Specific Configuration ..........................................................339

Migration Purge Server Specific Configuration..................................................341

Mover Specific Configuration.............................................................................345

Configure the Name Server Specific Information...............................................354

NFS Daemon Specific Configuration..................................................................357

Non-DCE Client Gateway Specific Configuration .............................................367

Configure the PVL Specific Information............................................................370

Configure the PVR Specific Information............................................................373

Configure the Storage Server Specific Information............................................394

6.9 Configure MVR Devices and PVL Drives.............................................................401

Device and Drive Configuration Variables.........................................................405

Supported Platform/Driver/Tape Drive Combinations .......................................411

HPSS Installation Guide September 2002 9

Release 4.5, Revision 2

Recommended Settings for Tape Devices...........................................................411

Chapter 7 HPSS User Interface Configuration . . . . . . . . . . . . . . . . . . . . . . . 413

7.1 Client API Configuration .......................................................................................413

7.2 Non-DCE Client API Configuration......................................................................415

Configuration Files..............................................................................................415

Environment Variables........................................................................................416

Authentication Setup...........................................................................................418

7.3 FTP Daemon Configuration...................................................................................422

7.4 NFS Daemon Configuration...................................................................................431

The HPSS Exports File........................................................................................432

Examples .............................................................................................................433

Files .....................................................................................................................434

7.5 MPI-IO API Configuration....................................................................................434

7.6 HDM Configuration................................................................................................435

Introduction .........................................................................................................435

Filesets.................................................................................................................436

Configuration.......................................................................................................444

Chapter 8 Initial Startup and Verification . . . . . . . . . . . . . . . . . . . . . . . . . . . 463

8.1 Overview...................................................................................................................463

8.2 Starting the HPSS Servers......................................................................................463

8.3 Unlocking the PVL Drives......................................................................................465

8.4 Creating HPSS Storage Space................................................................................465

8.5 Create Additional HPSS Users...............................................................................465

8.6 Creating File Families.............................................................................................465

8.7 Creating Filesets and Junctions .............................................................................465

8.8 Creating HPSS directories......................................................................................466

8.9 Verifying HPSS Configuration...............................................................................466

Global Configuration...........................................................................................466

Storage Subsystem Configuration.......................................................................466

Servers.................................................................................................................466

Devices and Drives..............................................................................................466

Storage Classes....................................................................................................467

Storage Hierarchies .............................................................................................467

Classes of Service................................................................................................467

File Families, Filesets, and Junctions..................................................................468

User Interfaces.....................................................................................................468

Operational Checklist..........................................................................................468

10 September 2002 HPSS Installation Guide

Release 4.5, Revision 2

Performance.........................................................................................................469

The Global Fileset File........................................................................................469

Appendix A Glossary of Terms and Acronyms . . . . . . . . . . . . . . . . . . . . . . . . . 471

Appendix B References. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 485

Appendix C Developer Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 489

Appendix D Accounting Examples. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 491

D.1 Introduction.............................................................................................................491

D.2 Site Accounting Requirements...............................................................................491

D.3 Processing of HPSS Accounting Data....................................................................491

D.4 Site Accounting Table.............................................................................................493

D.5 Account Apportionment Table...............................................................................493

D.6 Maintaining and/or Modifying the Account Map................................................494

D.7 Accounting Reports.................................................................................................494

D.8 Accounting Intervals and Charges ........................................................................495

Appendix E Infrastructure Configuration Example. . . . . . . . . . . . . . . . . . . . . 497

E.1 AIX Infrastructure Configuration Example.........................................................497

E.2 AIX Infrastructure Un-Configuration Example..................................................509

E.3 Solaris Infrastructure Configuration Example....................................................511

E.4 Solaris Infrastructure Un-Configuration Example..............................................522

Appendix F Additional SSM Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 525

F.1 Using the SSM Windows.........................................................................................525

F.2 SSM On-line Help....................................................................................................527

F.3 Viewing SSM Session Information ........................................................................527

F.4 Customizing SSM and Sammi................................................................................528

F.5 Detailed Information on Setting Up an SSM User...............................................531

F.6 Non-standard SSM Configurations.......................................................................532

HPSS Installation Guide September 2002 11

Release 4.5, Revision 2

Appendix G High Availability. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 535

G.1 Overview...................................................................................................................535

Architecture.........................................................................................................536

G.2 Planning....................................................................................................................537

Before You Begin................................................................................................537

HACMP Planning Guide.....................................................................................537

G.3 System Preparation.................................................................................................545

Physically set up your system and install AIX....................................................545

Mirror rootvg.......................................................................................................545

Diagram the Disk Layout ....................................................................................546

Plan Shared File Systems ....................................................................................546

Mirror Shared JFS logs........................................................................................547

Connect Robotic Tape Libraries..........................................................................547

G.4 Initial Install and Configuration for HACMP......................................................548

Install HACMP....................................................................................................548

Setup the AIX Environment for HACMP...........................................................548

Initial HACMP Configuration.............................................................................549

Configure DCE, SFS, and HPSS.........................................................................558

G.5 Configure HA HPSS................................................................................................558

HA HPSS Scripts.................................................................................................558

Finish the HACMP Configuration ......................................................................561

Define HA HPSS Verification Method...............................................................564

Setup Error Notification......................................................................................565

crontab Considerations........................................................................................567

G.6 Monitoring and Maintenance.................................................................................568

clstat.....................................................................................................................568

G.7 Metadata Backup Considerations..........................................................................569

G.8 Using Secure Shell (ssh)..........................................................................................569

G.9 Important Information ...........................................................................................570

G.10 Routine HA Operations ..........................................................................................570

Startup the Cluster...............................................................................................570

Shutdown the Cluster ..........................................................................................571

Verify the Cluster................................................................................................572

Synchronize the Cluster.......................................................................................572

Move a Resource Group......................................................................................574

Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 575

12 September 2002 HPSS Installation Guide

Release 4.5, Revision 2

HPSS Installation Guide September 2002 13

Release 4.5, Revision 2

List of Figures

Figure 1-1 Migrate and Stage Operations ............................................................................. 24

Figure 1-2 Relationship of HPSS Data Structures ................................................................ 25

Figure 1-3 The HPSS System ............................................................................................... 26

Figure 2-1 The Relationship of Various Server Data Structures .......................................... 63

Figure 2-2 Relationship of Class of Service, Storage Hierarchy, and Storage Class ............ 93

Figure 6-1 HPSS Health and Status Window ..................................................................... 252

Figure 6-2 HPSS Logon Window ....................................................................................... 255

Figure 6-3 HPSS Global Configuration screen ................................................................... 256

Figure 6-4 Storage Subsystem Configuration window ....................................................... 260

Figure 6-5 HPSS Servers Window ...................................................................................... 264

Figure 6-6 Basic Server Configuration Window ................................................................ 265

Figure 6-7 Migration Policy Configuration Window .......................................................... 282

Figure 6-8 Purge Policy Window ........................................................................................ 287

Figure 6-9 Accounting Policy Window .............................................................................. 290

Figure 6-10 HPSS Logging Policies Window ...................................................................... 295

Figure 6-11 Logging Policy Window ................................................................................... 299

Figure 6-12 Location Policy Window ................................................................................... 301

Figure 6-13 Remote HPSS Site Configuration Window ....................................................... 304

Figure 6-14 Disk Storage Class Configuration Window ...................................................... 306

Figure 6-15 Tape Storage Class Configuration Window ...................................................... 307

Figure 6-16 Storage Subsystem-Specific Thresholds window ............................................. 313

Figure 6-17 Storage Hierarchy Configuration Window ........................................................ 316

Figure 6-18 Class of Service Configuration Window ........................................................... 319

Figure 6-19 File Family Configuration Window .................................................................. 322

Figure 6-20 Bitfile Server Configuration Window ............................................................... 325

Figure 6-21 DMAP Gateway Configuration Window .......................................................... 330

Figure 6-22 Gatekeeper Server Configuration window ........................................................ 332

Figure 6-23 Logging Client Configuration Window ............................................................ 334

Figure 6-24 Logging Daemon Configuration Window ......................................................... 337

Figure 6-25 Metadata Monitor Configuration window ......................................................... 340

Figure 6-26 Migration/Purge Server Configuration Window ............................................... 342

Figure 6-27 Mover Configuration window ........................................................................... 346

Figure 6-28 Name Server Configuration Window ................................................................ 355

Figure 6-29 NFS Daemon Configuration Window (left side) .............................................. 359

Figure 6-30 NFS Daemon Configuration window (right side) ............................................. 360

Figure 6-31 Non-DCE Client Gateway Configuration Window ........................................... 368

Figure 6-32 PVL Server Configuration Window .................................................................. 371

Figure 6-33 3494 PVR Server Configuration Window ......................................................... 374

Figure 6-34 3495 PVR Server Configuration Window ......................................................... 375

Figure 6-35 3584 LTO PVR Server Configuration Window ................................................ 376

14 September 2002 HPSS Installation Guide

Release 4.5, Revision 2

Figure 6-36 AML PVR Server Configuration Window ........................................................ 377

Figure 6-37 STK PVR Server Configuration Window ......................................................... 378

Figure 6-38 STK RAIT PVR Server Configuration Window ............................................... 379

Figure 6-39 Operator PVR Server Configuration Window .................................................. 380

Figure 6-40 Disk Storage Server Configuration Window ..................................................... 396

Figure 6-41 Tape Storage Server Configuration Window .................................................... 397

Figure 6-42 HPSS Devices and Drives Window .................................................................. 403

Figure 6-43 Disk Mover Device and PVL Drive Configuration Window ............................ 404

Figure 6-44 Tape Mover Device and PVL Drive Configuration Window ........................... 405

Figure 7-1 DFS/HPSS XDSM Architecture ....................................................................... 438

Figure H-1 HA HPSS Architecture ...................................................................................... 536

Figure H-2 Adding a Cluster Definition .............................................................................. 550

Figure H-3 Adding Cluster Nodes ....................................................................................... 551

Figure H-4 Adding an IP-based Network ............................................................................ 552

Figure H-5 Adding a Non IP-based Network ...................................................................... 552

Figure H-6 Adding an Ethernet Boot Adapter ..................................................................... 554

Figure H-7 Adding an Ethernet Standby Adapter ................................................................ 554

Figure H-8 Adding an Ethernet Service Adapter ................................................................. 555

Figure H-9 Adding a Serial Adapter .................................................................................... 555

Figure H-10 Adding a Resource Group ................................................................................. 556

Figure H-11 Configuring a Resource Group .......................................................................... 557

Figure H-12 Adding an Application Server ........................................................................... 562

Figure H-13 Adding an Application Server to a Resource Group ......................................... 563

Figure H-14 Adding a Custom Verification Method ............................................................. 564

Figure H-15 Configuring AIX Error Notification .................................................................. 566

Figure H-16 Configuring Cluster Event Notification ............................................................ 567

Figure H-17 sample output from ‘clstat -a’ ........................................................................... 568

Figure H-18 Starting Cluster Services ................................................................................... 571

Figure H-19 Verifying the Cluster ......................................................................................... 572

Figure H-20 Moving a Resource Group ................................................................................ 574

HPSS Installation Guide September 2002 15

Release 4.5, Revision 2

List of Tables

Table 1-1 HPSS Client Interface Platforms ......................................................................... 37

Table 2-1 Cartridge/Drive Affinity Table ............................................................................ 56

Table 2-2 Gatekeeping Call Parameters .............................................................................. 90

Table 2-3 Suggested Block Sizes for Disk .......................................................................... 98

Table 2-4 Suggested Block Sizes for Tape .......................................................................... 99

Table 2-5 HPSS Dynamic Variables (Subsystem Independent) ........................................ 122

Table 2-6 HPSS Dynamic Variables (Subsystem Specific) .............................................. 123

Table 2-7 HPSS Static Configuration Values .................................................................... 125

Table 2-8 Paging Space Info .............................................................................................. 135

Table 3-1 Network Options ............................................................................................... 161

Table 3-2 PFTP Client Stanza Fields ................................................................................. 163

Table 3-3 PFTP Client Interfaces Stanza Fields ................................................................ 166

Table 3-4 Multinode Table Stanza Fields .......................................................................... 168

Table 3-5 Realms to DCE Cell Mappings Stanza Fields ................................................... 169

Table 3-6 Network Options Stanza Fields ......................................................................... 171

Table 4-1 Installation Package Sizes and Disk Requirements ........................................... 206

Table 6-1 Global Configuration Variables ........................................................................ 256

Table 6-2 Storage Subsystem Configuration Variables ..................................................... 260

Table 6-3 Basic Server Configuration Variables ............................................................... 266

Table 6-4 Migration Policy Configuration Variables ........................................................ 283

Table 6-5 Purge Policy Configuration Variables ............................................................... 288

Table 6-6 Accounting Policy Configuration Variables ..................................................... 291

Table 6-7 Logging Policies List Configuration Variables ................................................. 295

Table 6-8 Logging Policy Configuration Variables .......................................................... 299

Table 6-9 Location Policy Configuration Variables .......................................................... 301

Table 6-10 Remote HPSS Site Configuration Fields ........................................................... 304

Table 6-11 Storage Class Configuration Variables ............................................................. 308

Table 6-12 Storage Subsystem-Specific Thresholds Variables ........................................... 314

Table 6-13 Storage Hierarchy Configuration Variables ...................................................... 317

Table 6-14 Class of Service Configuration Variables ......................................................... 319

Table 6-15 Configure File Family Variables ....................................................................... 323

Table 6-16 Bitfile Server Configuration Variables .............................................................. 326

Table 6-17 DMAP Gateway Configuration Variables ........................................................ 330

Table 6-18 Gatekeeper Configuration Fields ....................................................................... 332

Table 6-19 Log Client Configuration Variables .................................................................. 334

Table 6-20 Log Daemon Configuration Variables .............................................................. 338

Table 6-21 Metadata Monitor Configuration Variables ...................................................... 341

Table 6-22 Migration/Purge Server Configuration Variables ............................................. 343

Table 6-23 Mover Configuration Variables ......................................................................... 346

Table 6-24 IRIX System Parameters ................................................................................... 351

16 September 2002 HPSS Installation Guide

Release 4.5, Revision 2

Table 6-25 Solaris System Parameters ................................................................................ 352

Table 6-26 Linux System Parameters .................................................................................. 353

Table 6-27 Name Server Configuration Variables .............................................................. 356

Table 6-28 NFS Daemon Configuration Variables ............................................................. 361

Table 6-29 Non-DCE Client Gateway Configuration Variables ......................................... 368

Table 6-30 Physical Volume Library Configuration Variables ........................................... 372

Table 6-31 Physical Volume Repository Configuration Variables ..................................... 380

Table 6-32 Storage Server Configuration Variables ............................................................ 397

Table 6-33 Device/Drive Configuration Variables .............................................................. 405

Table 6-35 Recommended Settings for Tape Devices ......................................................... 411

Table 6-34 Supported Platform/Driver/Tape Drive Combinations ..................................... 411

Table 7-1 Parallel FTP Daemon Options ........................................................................... 423

Table 7-2 Banner Keywords .............................................................................................. 428

Table 7-3 Directory Export Options .................................................................................. 432

Table 7-4 LogRecordMask Keywords ............................................................................... 451

HPSS Installation Guide September 2002 17

Release 4.5, Revision 2

Preface

Conventions Used in This Book

Example commands that should be typed at a command line will be proceeded by a percent sign

(‘%’) and be presented in a boldface courier font:

% sample command

Names of ﬁles, variables, and variable values will appear in a boldface courier font:

Sample ﬁle, variable, or variable value

Any text preceded by a pound sign (‘#’) should be considered shell script comment lines:

# This is a comment

18 September 2002 HPSS Installation Guide

Release 4.5, Revision 2

HPSS Installation Guide September 2002 19

Release 4.5, Revision 2

Chapter 1 HPSS Basics

1.1 Introduction

The High Performance Storage System (HPSS) is software that provides hierarchical storage

management and services for very large storage environments. HPSS may be of interest in

situations having present and future scalability requirements that are very demanding in terms of

total storage capacity, ﬁle sizes, data rates, number of objects stored, and numbers of users. HPSS

is part of an open, distributed environment based on OSF Distributed Computing Environment

(DCE) products that form the infrastructure of HPSS. HPSS is the result of a collaborative effort by

leading US Government supercomputer laboratories and industry to address very real, very urgent

high-end storage requirements. HPSS is offered commercially by IBM Worldwide Government

Industry, Houston, Texas.

HPSS provides scalable parallel storage systems for highly parallel computers aswell as traditional

supercomputers and workstation clusters. Concentrating on meeting the high end of storage

system and data management requirements, HPSS isscalable and designedto store up to petabytes

(10

15

) of data and to use network-connected storage devices to transfer data at rates up to multiple

gigabytes (10

9

) per second.

HPSS provides a large degree of control for the customer site to manage their hierarchical storage

system. Using conﬁguration information deﬁned by the site, HPSS organizes storage devices into

multiple storage hierarchies. Based on policy information deﬁned by the site and actual usage

information, data are then moved to the appropriate storage hierarchy and to appropriate levels in

the storage hierarchy.

1.2 HPSS Capabilities

A central technical goal of HPSS is to move large ﬁles between storage devices and parallel or

clustered computers at speeds many times faster than today’s commercial storage system software

products, and to do this in a way that is more reliable and manageable than is possible with current

systems. In order to accomplish this goal, HPSS is designed and implemented based on the

concepts described in the following subsections.

1.2.1 Network-centered Architecture

The focus of HPSS is the network, not a single server processor as in conventional storage systems.

HPSS provides servers and movers that can be distributed across a high performance network to

Chapter 1 HPSS Basics

20 September 2002 HPSS Installation Guide

Release 4.5, Revision 2

provide scalability and parallelism. The basis for this architecture is the IEEE Mass Storage System

Reference Model, Version 5.

1.2.2 High Data Transfer Rate

HPSS achieves high data transfer rates by eliminating overhead normally associated with data

transfer operations. In general, HPSS servers establish transfer sessions but are not involved in

actual transfer of data.

1.2.3 Parallel Operation Built In

The HPSS Application Program Interface (API) supports parallel or sequential access to storage

devices by clients executing parallel or sequential applications. HPSS also provides a Parallel File

Transfer Protocol. HPSS can even manage data transfers in a situation where the number of data

sources and destination are different. Parallel data transfer is vital in situations that demand fast

access to very large ﬁles.

1.2.4 A Design Based on Standard Components

HPSS runs on UNIX with no kernel modiﬁcations and is written in ANSI C and Java. It uses the

OSF Distributed Computing Environment (DCE) and Encina from Transarc Corporation as the

basis for its portable, distributed, transaction-based architecture. These components are offered on

many vendors’ platforms. Source code is available to vendors and users for porting HPSS to new

platforms. HPSS Movers and the Client API have been ported to non-DCE platforms. HPSS has

been implemented on the IBM AIX and Sun Solaris platforms. In addition, selected components

have been ported to other vendor platforms. The non-DCE Client API and Moverhave been ported

to SGI IRIX, while the Non-DCE Client API has also been ported to Linux. Parallel FTP client

software has been ported to a number of vendor platforms and is also supported on Linux. Refer

to Section 1.4: HPSS Hardware Platforms on page 37 and Section 2.3: Prerequisite Software

Considerations on page 46 for additional information.

1.2.5 Data Integrity Through Transaction Management

Transactional metadata management and Kerberos security enable a reliable design that protects

user data both from unauthorized use and from corruption or loss. A transaction is an atomic

grouping of metadata management functions that either take place together, or none of them take

place. Journaling makes it possible to back out any partially complete transactions if a failure

occurs. Transaction technology is common in relational data management systems but not in

storage systems. HPSS implements transactions through Transarc’s Encina product. Transaction

management is the key to maintaining reliability and security while scaling upward into a large

distributed storage environment.

1.2.6 Multiple Hierarchies and Classes of Services

Most other storage management systems support simple storage hierarchies consisting of one kind

of disk and one kind of tape. HPSS provides multiple hierarchies, which are particularly useful

when inserting new storage technologies over time. As new disks, tapes, or optical media are

Page is loading ...

IBM High Performance Storage System HPSS, Hub/Switch User manual

Related papers

Other documents