Top
PRIMECLUSTER  Installation and Administration Guide4.3

Preface

This manual serves as your starting point for using PRIMECLUSTER. It explains the workflow of the series of operations from installation to operation management of the PRIMECLUSTER system. Since the PRIMECLUSTER system comprises multiple features, there are several other manuals besides this one for each feature. However, by reading this manual first, you will be able to perform the series of operations because this manual refers readers to other manuals that contain feature-specific information that is necessary for the operations.

This manual also provides a functional overview of products that are supported by the PRIMECLUSTER system and describes operation procedures.

This manual only covers the basic operation of PRIMECLUSTER. For operations using different hardware and software configurations, see "Related Documentation."

The table below shows the operation flow from PRIMECLUSTER installation to the start of operation management and indicates the reference location in this manual for each operation.

Flow from PRIMECLUSTER system installation to operation management

PRIMECLUSTER system operation flow

Reference location in this manual

1

Understanding the flow of PRIMECLUSTER system building and designing the PRIMECLUSTER system

Part 1 Planning

2

Installing the PRIMECLUSTER system

Part 2 Installation

3

Monitoring the operation status of the PRIMECLUSTER system

Part 3 Operations

4

Changing the PRIMECLUSTER system configuration after system operation has been started

Part 4 System Configuration Modifications

5

Backing up and restoring the operation environment of the PRIMECLUSTER system

Part 5 Maintenance

6

Building PRIMECLUSTER systems in virtualized environments

Part 6 Virtualized Environments

7

Installing products for the PRIMECLUSTER system

Part 7 PRIMECLUSTER Products

For detailed procedural explanations, refer to the reference manuals that are indicated in the target location of each part.

Target Readers

This manual is intended for all users who use PRIMECLUSTER 4.3 and perform cluster system installation and operation management. It is also intended for programmers who develop applications that operate on PRIMECLUSTER.

Configuration of This Documentation

This manual consists of seven parts, appendices, and a glossary. The contents of each part are described below.

Part 1 Planning

Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes the overall workflow from installation to operation of the PRIMECLUSTER system.

Part 2 Installation

Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes operations for software installation, cluster configuration, and application building.

Part 3 Operations

Audience: System administrators who manage system operations
Contents: This part describes operation methods for operations such as monitoring the PRIMECLUSTER system and investigating failure causes.

Part 4 System Configuration Modification

Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes necessary work items for additions, modifications, and deletions to the PRIMECLUSTER system configuration.

Part 5 Maintenance

Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes the necessary work items for maintaining the operation environment of the PRIMECLUSTER system.

Part 6 Virtualized Environments

Audience: All users who use PRIMECLUSTER systems in virtualized environments
Contents: This part describes configurations and building procedures when using PRIMECLUSTER systems in virtualized environments

Part 7 PRIMECLUSTER Products

Audience: Users who operate PRIMECLUSTER products on PRIMECLUSTER systems
Contents: This part describes the versions and levels of products that are supported by the PRIMECLUSTER system and provides a functional overview of those products.

Appendix A PRIMECLUSTER System Design Worksheets

Audience: Users who design PRIMECLUSTER systems
Contents: This appendix contains the PRIMECLUSTER System Design Worksheet.

Appendix B Manual Pages

Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes the online manual pages that are used by the individual features of the PRIMECLUSTER system.

Appendix C Troubleshooting

Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes corrective actions for problems that may occur in the PRIMECLUSTER system. It also explains how to collect data when requesting a problem investigation.

Appendix D Messages

Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes the contents and actions for messages output by the userApplication Configuration Wizard GUI and messages output by procedure resources in PRIMECLUSTER systems. For other messages, this manual indicates the reference locations in other manuals.

Appendix E Using SynfinityCluster Products in PRIMECLUSTER

Audience: All users who used the SynfinityCluster system
Contents: This appendix describes feature differences and terminology differences between SynfinityCluster and PRIMECLUSTER.

Appendix F Registering, Changing, and Deleting State Transition Procedure Resources for SynfinityCluster Compatibility

Audience: All users who use SynfinityCluster-compatible resources
Contents: This appendix describes procedures for registering, changing, and deleting procedure resources when the cluster applications use procedure resources.

Appendix G SafeCLUSTER Compatibility Function Settings

Audience: All users who are moving from SafeCLUSTER to PRIMECLUSTER and using the clgettrigger command with a state transition procedure executed from the procedure resources
Contents: This appendix describes the settings for when acquiring the cause of state transition to the cluster service for which the clgettrigger command was used.

Appendix H Startup Scripts and Startup Daemons in PRIMECLUSTER

Audience: System administrators who build PRIMECLUSTER systems
Contents: This appendix describes scripts and daemons that are started by PRIMECLUSTER.

Appendix I SMF Services and Port Numbers in PRIMECLUSTER

Audience: System administrators who build PRIMECLUSTER systems
Contents: This appendix describes SMF services and startup daemons for PRIMECLUSTER, and port numbers being used.

Appendix J Changes in Each Version

Audience: All users who have used PRIMECLUSTER 4.2A00 or 4.3A10
Contents: This appendix describes the changes made to the specifications of PRIMECLUSTER 4.3A20.

Appendix K Release Information

Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes the main changes of this manual.

Glossary

Audience: All users who use PRIMECLUSTER systems
Contents: This section explains terms used to describe the PRIMECLUSTER system.

Related Documentation

Refer to the following manuals as necessary when setting up the cluster:

Note

The PRIMECLUSTER documentation includes the following documentation in addition to those listed above:

  • PRIMECLUSTER Software Release Guide and Installation Guide

    The data is stored on "DVD" of each package. For details on the file names, see the documentation.

Manual Series

Manual Printing

If you want to print a manual, use the PDF file found on the DVD for the PRIMECLUSTER product. The correspondences between the PDF file names and manuals are described in the PRIMECLUSTER Installation Guide that comes with the product.

You will need Adobe Reader to read and print the PDF file. To get Adobe Reader, see Adobe Systems Incorporated's website.

Online Manuals

To allow users to view the online manuals, use the Cluster management server to register each user name to one of the user groups (wvroot, clroot, cladmin, or clmon).

For information on user group registration procedures and user group definitions, see "4.2.1 Assigning Users to Manage the Cluster"

Conventions

Notation
Prompts

Command line examples that require system administrator (or root) rights to execute are preceded by the system administrator prompt, the hash sign (#). Entries that do not require system administrator rights are preceded by a dollar sign ($).

Manual page section numbers

References to the UNIX operating system commands are followed by their manual page section numbers in parentheses - for example, cp(1)

The keyboard

Keystrokes that represent nonprintable characters are displayed as key icons such as [Enter] or [F1]. For example, [Enter] means press the key labeled Enter; [Ctrl-b] means hold down the key labeled Ctrl or Control and then press the [B] key.

Typefaces

The following typefaces highlight specific elements in this manual.

Typeface

Usage

Constant Width

Computer output and program listings; commands, file names, manual page names and other literal programming elements in the main body of text.

Italic

Variables that you must replace with an actual value.

Bold

Items in a command line that you must type exactly as shown.

Example 1

Several entries from an /etc/passwd file are shown below:

root:x:0:1:0000-Admin(0000):/:
sysadm:x:0:0:System Admin.:/usr/admin:/usr/sbin/sysadm
setup:x:0:0:System Setup:/usr/admin:/usr/sbin/setup
daemon:x:1:1:0000-Admin(0000):/:

Example 2

To use the cat(1) command to display the contents of a file, enter the following command line:

$ cat file
Notation symbols

Material of particular interest is preceded by the following symbols in this manual:

Point

Contains important information about the subject at hand.

Note

Describes an item to be noted.

Example

Describes operation using an example.

Information

Describes reference information.

See

Provides the names of manuals to be referenced.

Abbreviations
  • Oracle Solaris might be described as Solaris, Solaris Operating System, or Solaris OS.

  • If "Solaris X" is indicated in the reference manual name of the Oracle Solaris manual, replace "Solaris X" with "Oracle Solaris 10 (Solaris 10)" or the "Oracle Solaris 11 (Solaris 11)."

Export Controls

Exportation/release of this document may require necessary procedures in accordance with the regulations of your resident country and/or US export control laws.

Trademarks

UNIX is a registered trademark of The Open Group in the United States and other countries.

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.

Microsoft, Windows, and Internet Explorer are registered trademarks of Microsoft Corporation in the United States and other countries.

CORBA, OMG, and ORB are registered trademarks of Object Management Group (OMG).

NetWorker is a registered trademark or trademark of EMC Corporation in the United States and other countries.

lsof is used for this software.

/*
* Copyright 2002 Purdue Research Foundation, West Lafayette,
* Indiana 47907. All rights reserved.
*
* Written by Victor A. Abell
*
* This software is not subject to any license of the American
* Telephone and Telegraph Company or the Regents of the
* University of California.
*
* Permission is granted to anyone to use this software for
* any purpose on any computer system, and to alter it and
* redistribute it freely, subject to the following
* restrictions:
*
* 1. Neither the authors nor Purdue University are responsible
* for any consequences of the use of this software.
*
* 2. The origin of this software must not be misrepresented,
* either by explicit claim or by omission. Credit to the
* authors and Purdue University must appear in documentation
* and sources.
*
* 3. Altered versions must be plainly marked as such, and must
* not be misrepresented as being the original software.
*
* 4. This notice may not be removed or altered.
*/

Symfoware is a registered trademark of Fujitsu Limited.

PRIMECLUSTER is a registered trademark of Fujitsu Limited.

Other product names are product names, trademarks, or registered trademarks of these companies.

Fujitsu M10 is sold as SPARC M10 by Fujitsu in Japan.

Fujitsu M10 and SPARC M10 are identical products.

Requests

Date of publication and edition

September 2013, Fourth edition
October 2013, 4.1 edition
December 2013, 4.2 edition
February 2014, 4.3 edition
July 2014, 4.4 edition
August 2015, 4.5 edition

Copyright notice

All Rights Reserved, Copyright (C) FUJITSU LIMITED 2012-2015.

Revision History

Revision

Location

Edition

Added the description when using the Oracle VM Server for SPARC P2V tool to migrating a cluster system.

Chapter 15 When Using Oracle VM Server for SPARC P2V Tool to Migrating a Cluster System

4.1

Described two types of migration functions (Live Migration and Cold Migration).

2.2.1.1.2 Migration for a Cluster System in Oracle VM Server for SPARC Environment

4.2

Added the required XSCF information before configuring the shutdown facility.

5.1.2.1.1 Checking XSCF Information

Added the notes on displaying the configuration of the shutdown facility.

5.1.2.1.3 Using the Shutdown Configuration Wizard

Added the description of specific guest domain (node) survival to survival scenarios.

5.1.2.1.3 Using the Shutdown Configuration Wizard

Added the notes on XSCF configuration to use Migration function.

5.1.2.1.3 Using the Shutdown Configuration Wizard

5.1.2.1.4 Setting of the connection method to the XSCF

Changed the description of setting the control domain and configuring guest domains.

12.1.1.1 Cluster System Between Guest Domains Within the Same Physical Partitions

Described the migratable PRIMECLUSTER versions when migrating an environment in which PRIMECLUSTER is used to OSLC environment.

13.1 Design

Changed the procedure to use the Migration function.

Chapter 14 When Using the Migration Function in Oracle VM Server for SPARC Environment

Added the notes on Cold Migration.

2.2.1.1.2 Migration for a Cluster System in Oracle VM Server for SPARC Environment

4.3

Added the description when using Migration function in combination with ServerView Resource Orchestrator Cloud Edition.

2.2.1.1.2 Migration for a Cluster System in Oracle VM Server for SPARC Environment
Chapter 14 When Using the Migration Function in Oracle VM Server for SPARC Environment
14.4 Using with ServerView Resource Orchestrator Cloud Edition

Added the description when changing port numbers for SNMP.

5.1.2.1.2 Setting SNMP
8.12 Changing Port Numbers for SNMP

Changed the description when using the Migration function.

Chapter 14 When Using the Migration Function in Oracle VM Server for SPARC Environment

Added the notes on the virtual machine function.

2.2.1 Virtual Machine Function

4.4

Added the notes on the cluster interconnects.

2.2.1.1.1 Cluster System Configuration in Oracle VM Server for SPARC Environment

5.1.1 Setting Up CF and CIP

Added the descriptions and the notes to configure cluster applications on a control domain.

2.2.1.1.1 Cluster System Configuration in Oracle VM Server for SPARC Environment

12.1.1.1 Cluster System Between Guest Domains Within the Same Physical Partitions

12.1.1.2 Cluster System Between Guest Domains Among Different Physical Partitions

12.1.2.1 Building Cluster Applications on Clusters Between Control Domains

Changed the name of the reference manual.

2.2.1.1.3 When Migrating a Cluster System in the Physical Environment to a Guest Domain in Oracle VM Server for SPARC Environment (Physical to Virtual)

5.2 Setting Up Power Supply Linkage

15.3 Migration with Oracle VM Server for SPARC P2V Tool

Added the notes on the cluster interconnects in Oracle Solaris VM for SPARC environment.

5.1.1 Setting Up CF and CIP

Changed the notes on automatic configuration of shared disks.

6.3.1 Automatic Configuration of Shared Disks

Modified the descriptions to check the registered information when creating Gls resources.

6.7.1.4 Creating Gls Resources

Deleted unnecessary descriptions about node name takeover.

6.7.1.5 Creating Takeover Network Resources

Changed the work area from /tmp to /var/tmp.

11.2 Restoring the PRIMECLUSTER Operation Environment

13.2.3.1 Creating an Archive on the Migration Source Node

13.2.4.3 OS Installation to the Non-Global Zone

13.2.4.6 Global Zone Environment Setup (After Installation of PRIMECLUSTER to the Non-Global Zone)

13.2.4.13 Sharing Non-Global Zone Configuration Information

13.3.3.3 Creating a Flash Archive from the Migration Source Node

13.3.4.2 Creating Containers from a Flash Archive

13.3.4.6 Global Zone Environment Setup (After Installation of PRIMECLUSTER to the Non-Global Zone)

13.3.4.13 Sharing Non-Global Zone Configuration Information

C.1.3 SCF Dump

F.1 Registering a Procedure Resource

F.2.1 Changing a State Transition Procedure

In the cluster configuration procedure in Oracle Solaris zone environment, modified the example in the operation procedure of how to set up the global zone environment.

13.2.4.6 Global Zone Environment Setup (After Installation of PRIMECLUSTER to the Non-Global Zone)

In the cluster configuration procedure in Oracle Solaris zone environment, added the explanation of how to create cluster applications.

13.2.5.4 Creating Cluster Applications

13.3.5.4 Creating Cluster Applications

In the cluster configuration procedure to use OSLC, added the notes on how to create containers from a flash archive when creating non-global zone.

13.3.4 Creating Non-Global Zones

Modified the example in the procedure of how to restart a non-global zone.

13.3.4.2 Creating Containers from a Flash Archive

13.3.4.3 Non-Global Zone Startup and OS Setup

13.5.1 Maintenance Operations on the Non-Global Zone

13.5.2 Maintenance Operations on the Global Zone

13.5.4 Recovery Operation for When an Error Occurs on the Non-Global Zone

Modified the descriptions and added the notes about migration by using P2V tool.

15.3 Migration with Oracle VM Server for SPARC P2V Tool

15.6 Changing the Setting in the Multi-User Mode and Restoration of the Configuration Information of GFS/GDS

Added the explanation and the remarks of SMF service, startup daemons, and used port numbers.

I.2 SMF Service Lists

Changed the description of "Usage confirmation of CF remote services."

5.1.1 Setting Up CF and CIP

4.5

Added the example to use the login user account of the shutdown facility to connect to XSCF via SSH.

5.1.2.1.1 Checking XSCF Information

Added the description of "Checking if the SNMP trap is received."

5.1.2.1.3 Using the Shutdown Configuration Wizard

Added the notes on the mountpoint of the ZFS storage pool.

6.4.1.1 Design for when using ZFS with a Cluster System

Added the note on the non-legacy zfs file system.

6.4.1.3 Notes on the Operation

Added the description of environment variables that can be referred by the Check script.

6.6 Setting Up Online/Offline Scripts

Changed the note on characters that cannot be used in the file path and the arguments.

6.7.1.1 Creating Cmdline Resources

Added the note on using the mountpoint that shares NFS.

6.7.1.2 Creating Fsystem Resources

Changed the example when the mountpoint is not set to the ZFS storage pool and the preparation steps to share a file system in a network (NFS).

6.7.1.2.1 Prerequisites

Changed the note on selecting mount points.

6.7.1.2.2 Setup Method

Added the note on a resource name of the patrol diagnosis facility.

6.7.2.1 Creating Standby Cluster Applications

Deleted the description of the hvreset command.hvreset and added the note on the cluster applications with an exclusive relationship.

6.7.3.1 Setting Exclusive Relationships Between Cluster Applications

Change the operation procedure when changing an IP address on the public LAN.

8.2 Changing an IP Address on the Public LAN

Added the procedure for replacing XSCF.

8.11.3 Replacing XSCF

Changed the procedure for restoring the PRIMECLUSTER operation environment.

11.2 Restoring the PRIMECLUSTER Operation Environment

Added and changed the notes on Live Migration.

12.1.1.2 Cluster System Between Guest Domains Among Different Physical Partitions
Chapter 14 When Using the Migration Function in Oracle VM Server for SPARC Environment

Added the dependency between SMF services of RMS and zones.

13.2.1.6 Setup of Dependency between SMF Services of RMS and Zones

Changed the procedure when newly installing Solaris 10 or Solaris 11.

13.2.4.3 OS Installation to the Non-Global Zone

Added the note on the host name to be set to the non-global zone.

13.2.4.4 Non-Global Zone Startup and OS Setup
13.3.4.3 Non-Global Zone Startup and OS Setup

Changed the description of "Setup of Non-Global Zone RMS."

13.2.4.11 Setup of Non-Global Zone RMS
13.3.4.11 Setup of Non-Global Zone RMS (for single-node cluster operations)

Changed the description of the required value for the resource database.

A.5.1 CF Configuration

Added the maximum value for the number of cluster applications.

A.9 Cluster Application Worksheets

Added and changed the setting contents of the configuration global settings worksheet.

A.9.11 Configuration Global Settings Worksheet

Changed the manual pages of the shutdown facility.

B.8 Shutdown Facility (SF)

Added the note on changing the registration information of the procedure resource.

F.2.3 Changing Registration Information of a Procedure Resource

Added the descriptions about the service names corresponding to each port number to Remarks.

I.2 SMF Service Lists