Top
PRIMECLUSTER  Installation and Administration Guide4.3

Preface

This manual serves as your starting point for using PRIMECLUSTER. It explains the workflow of the series of operations from installation to operation management of the PRIMECLUSTER system. Since the PRIMECLUSTER system comprises multiple features, there are several other manuals besides this one for each feature. However, by reading this manual first, you will be able to perform the series of operations because this manual refers readers to other manuals that contain feature-specific information that is necessary for the operations.

This manual also provides a functional overview of products that are supported by the PRIMECLUSTER system and describes operation procedures.

This manual only covers the basic operation of PRIMECLUSTER. For operations using different hardware and software configurations, see "Related Documentation".

The table below shows the operation flow from PRIMECLUSTER installation to the start of operation management and indicates the reference location in this manual for each operation.

Flow from PRIMECLUSTER system installation to operation management

PRIMECLUSTER system operation flow

Reference location in this manual

1

Understanding the flow of PRIMECLUSTER system building and designing the PRIMECLUSTER system

Part 1 Planning

2

Installing the PRIMECLUSTER system

Part 2 Installation

3

Monitoring the operation status of the PRIMECLUSTER system

Part 3 Operations

4

Changing the PRIMECLUSTER system configuration after system operation has been started

Part 4 System Configuration Modifications

5

Backing up and restoring the operation environment of the PRIMECLUSTER system

Part 5 Maintenance

6

Installing products for the PRIMECLUSTER system

Part 6 PRIMECLUSTER Products

For detailed procedural explanations, refer to the reference manuals that are indicated in the target location of each part.

Target Readers

This manual is intended for all users who use PRIMECLUSTER 4.3 and perform cluster system installation and operation management. It is also intended for programmers who develop applications that operate on PRIMECLUSTER.

Configuration of This Documentation

This manual consists of six parts, appendixes, and a glossary. The contents of each part are described below.

Part 1 Planning

Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes the overall workflow from installation to operation of the PRIMECLUSTER system.

Part 2 Installation

Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes operations for software installation, cluster building, and application building.

Part 3 Operations

Audience: System administrators who manage system operations
Contents: This part describes operation methods for operations such as monitoring the PRIMECLUSTER system and investigating failure causes.

Part 4 System Configuration Modification

Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes necessary work items for additions, modifications, and deletions to the PRIMECLUSTER system configuration.

Part 5 Maintenance

Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes the necessary work items for maintaining the operation environment of the PRIMECLUSTER system.

Part 6 PRIMECLUSTER Products

Audience: Users who operate PRIMECLUSTER products on PRIMECLUSTER systems
Contents: This part describes the versions and levels of products that are supported by the PRIMECLUSTER system and provides a functional overview of those products.

Appendix A PRIMECLUSTER System Design Worksheets

Audience: Users who design PRIMECLUSTER systems
Contents: This appendix contains the PRIMECLUSTER System Design Worksheet.

Appendix B Manual Pages

Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes the online manual pages that are used by the individual features of the PRIMECLUSTER system.

Appendix C Troubleshooting

Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes corrective actions for problems that may occur in the PRIMECLUSTER system. It also explains how to collect data when requesting a problem investigation.

Appendix D Messages

Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes the contents and actions for messages output by the userApplication Configuration Wizard GUI and messages output by procedure resources in PRIMECLUSTER systems. For other messages, this manual indicates the reference locations in other manuals.

Appendix E Using SynfinityCluster Products in PRIMECLUSTER

Audience: All users who used the SynfinityCluster system
Contents: This appendix describes feature differences and terminology differences between SynfinityCluster and PRIMECLUSTER.

Appendix F Registering, Changing, and Deleting State Transition Procedure Resources for SynfinityCluster Compatibility

Audience: All users who use SynfinityCluster-compatible resources
Contents: This appendix describes procedures for registering, changing, and deleting procedure resources when the cluster applications use procedure resources.

Appendix G Using PRIMECLUSTER in Oracle VM Server for SPARC Environments

Audience: All users who use PRIMECLUSTER in Oracle VM Server for SPARC environments
Contents: This appendix explains the setup and configuration procedures for using PRIMECLUSTER systems in Oracle VM Server for SPARC environments.

Appendix H Using PRIMECLUSTER in Oracle Solaris Zones Environments

Audience: All users who use PRIMECLUSTER systems in Oracle Solaris Zones environments
Contents: This appendix explains the setup and configuration procedures for using PRIMECLUSTER systems in Oracle Solaris Zones environments.

Appendix I SafeCLUSTER Compatibility Function Settings

Audience: All users who are moving from SafeCLUSTER to PRIMECLUSTER and using the clgettrigger command with a state transition procedure executed from the procedure resources
Contents: This appendix describes the settings for when acquiring the cause of state transition to the cluster service for which the clgettrigger command was used.

Appendix J Startup Scripts and Startup Daemons in PRIMECLUSTER

Audience: System administrators who build PRIMECLUSTER systems
Contents: This appendix describes scripts and daemons that are started by PRIMECLUSTER.

Appendix K SMF Services and Port Numbers in PRIMECLUSTER

Audience: System administrators who build PRIMECLUSTER systems
Contents: This appendix describes SMF services and startup daemons for PRIMECLUSTER, and port numbers being used.

Appendix L Changes in Each Version

Audience: All users who have used PRIMECLUSTER 4.2A00
Contents: This appendix describes the changes made to the specifications of PRIMECLUSTER 4.3A10.

Glossary

Audience: All users who use PRIMECLUSTER systems
Contents: This section explains terms used to describe the PRIMECLUSTER system.

Related Documentation

Refer to the following manuals as necessary when setting up the cluster:

Note

The PRIMECLUSTER documentation includes the following documentation in addition to those listed above:

  • PRIMECLUSTER Software Release Guide and Installation Guide

    The data is stored on "DVD" of each package. For details on the file names, see the documentation.

Manual Series

Manual Printing

If you want to print a manual, use the PDF file found on the DVD for the PRIMECLUSTER product. The correspondences between the PDF file names and manuals are described in the PRIMECLUSTER Installation Guide that comes with the product.

You will need Adobe Reader to read and print the PDF file. To get Adobe Reader, see Adobe Systems Incorporated's website.

Online Manuals

To allow users to view the online manuals, use the Cluster management server to register each user name to one of the user groups (wvroot, clroot, cladmin, or clmon).

For information on user group registration procedures and user group definitions, see "4.2.1 Assigning Users to Manage the Cluster"

Conventions

Notation
Prompts

Command line examples that require system administrator (or root) rights to execute are preceded by the system administrator prompt, the hash sign (#). Entries that do not require system administrator rights are preceded by a dollar sign ($).

Manual page section numbers

References to the UNIX operating system commands are followed by their manual page section numbers in parentheses - for example, cp(1)

The keyboard

Keystrokes that represent nonprintable characters are displayed as key icons such as [Enter] or [F1]. For example, [Enter] means press the key labeled Enter; [Ctrl-b] means hold down the key labeled Ctrl or Control and then press the [B] key.

Typefaces

The following typefaces highlight specific elements in this manual.

Typeface

Usage

Constant Width

Computer output and program listings; commands, file names, manual page names and other literal programming elements in the main body of text.

Italic

Variables that you must replace with an actual value.

Bold

Items in a command line that you must type exactly as shown.

Example 1

Several entries from an /etc/passwd file are shown below:

root:x:0:1:0000-Admin(0000):/:
sysadm:x:0:0:System Admin.:/usr/admin:/usr/sbin/sysadm
setup:x:0:0:System Setup:/usr/admin:/usr/sbin/setup
daemon:x:1:1:0000-Admin(0000):/:

Example 2

To use the cat(1) command to display the contents of a file, enter the following command line:

$ cat file
Notation symbols

Material of particular interest is preceded by the following symbols in this manual:

Point

Contains important information about the subject at hand.

Note

Describes an item to be noted.

Example

Describes operation using an example.

Information

Describes reference information.

See

Provides the names of manuals to be referenced.

Abbreviations

Export Controls

Exportation/release of this document may require necessary procedures in accordance with the regulations of your resident country and/or US export control laws.

Trademarks

UNIX is a registered trademark of The Open Group in the United States and other countries.

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.

Microsoft, Windows, and Internet Explorer are registered trademarks of Microsoft Corporation in the United States and other countries.

CORBA, OMG, and ORB are registered trademarks of Object Management Group (OMG).

NetWorker is a registered trademark or trademark of EMC Corporation in the United States and other countries.

lsof is used for this software.

/*
* Copyright 2002 Purdue Research Foundation, West Lafayette,
* Indiana 47907. All rights reserved.
*
* Written by Victor A. Abell
*
* This software is not subject to any license of the American
* Telephone and Telegraph Company or the Regents of the
* University of California.
*
* Permission is granted to anyone to use this software for
* any purpose on any computer system, and to alter it and
* redistribute it freely, subject to the following
* restrictions:
*
* 1. Neither the authors nor Purdue University are responsible
* for any consequences of the use of this software.
*
* 2. The origin of this software must not be misrepresented,
* either by explicit claim or by omission. Credit to the
* authors and Purdue University must appear in documentation
* and sources.
*
* 3. Altered versions must be plainly marked as such, and must
* not be misrepresented as being the original software.
*
* 4. This notice may not be removed or altered.
*/

Symfoware is a registered trademark of Fujitsu Limited.

PRIMECLUSTER is a registered trademark of Fujitsu Limited.

Other product names are product names, trademarks, or registered trademarks of these companies.

Requests

Date of publication and edition

February 2012, First edition
April 2012, 1.1 edition
October 2012, 1.2 edition
May 2013, 1.3 edition
August 2013, 1.4 edition
August 2015, 1.5 edition

Copyright notice

All Rights Reserved, Copyright (C) FUJITSU LIMITED 2012-2015.

Revision History

Revision

Location

Edition

Added notes on the installation of the operating system when mirroring the system disk using GDS in a ZFS boot environment.

Chapter 3 Software Installation

1.1

Deleted "Specifying the Timeout Value".

5.1.2.1 For SPARC Enterprise M3000, M4000, M5000, M8000, or M9000

Changed the descriptions of setting up the shutdown agent.

5.1.2.1.2 Using the Shutdown Configuration Wizard

Changed the operation method of setting and changing the shutdown facility from CLI to the shutdown configuration wizard.

5.1.2.2 For SPARC Enterprise T1000, T2000
5.1.2.3 For SPARC Enterprise T5120, T5220, T5140, T5240, T5440, or SPARC T3 series
8.2 Changing an IP Address on the Public LAN
8.3 Changing the User Name and Password to Control the Console

Added a description to Note when specifying shared disk units by the patrol diagnosis.

5.1.3.2 Automatic Configure
6.9 Setting Up Patrol Diagnosis

Changed the descriptions of switching a cluster application.

10.3.2.2 Procedure for Applying Correction by Rolling Update

Changed the descriptions.

Chapter 18 Symfoware Server

Changed the descriptions and Example in Creating Gls Resources.

H.3.2 Creating Cluster Applications on the Global Zone

Added the following incompatible function:
J.1.10 Shutdown Configuration Wizard

J.1 Changes in PRIMECLUSTER 4.2A00 from 4.3A10

Deleted "Console Break agent".

Glossary

Added the patrol diagnosis to Other feature.

2.1.2 Function Selection

1.2

Added notes on umask.

Chapter 3 Software Installation

Added notes on SIS.

4.4.1 Operation Menu Functions

Added the description to IP interconnects.

5.1.1 Setting Up CF and CIP

Modified the description of HV_AUTORECOVER.

6.6 Setting Up Online/Offline Scripts

Added Information to the procedure to add a shared disk device.

9.3.1 Adding a Shared Disk Device

Added notes on message queues.

A.5.2 RMS Configuration

Changed Oracle Solaris Containers environments to Oracle Solaris Zones environments.

Appendix H Using PRIMECLUSTER in Oracle Solaris Zones Environments

Added the description of non-global zone images.

H.2.2.2 Allocation of Non-Global Zone Images

Added notes on monitoring of the non-global zone.

H.2.2.4 Application Monitoring

Added remarks of Gds resources.

H.2.3 Resource Configuration

Added Information to "Creating an Archive on the Migration Source Node".

H.3.3 Preparations for Migrating an Existing Solaris Environment to a Non-Global Zone

Added Appendix of "Startup Scripts and Startup Daemons".

Appendix J Startup Scripts and Startup Daemons in PRIMECLUSTER

Added Appendix of "SMF Services and Port Numbers".

Appendix K SMF Services and Port Numbers in PRIMECLUSTER

Added the description of IP interconnect.

Appendix L Changes in Each Version

Added Note when Oracle Solaris Zones of an exclusive IP zone exist on the system.

3.1 PRIMECLUSTER Installation

1.3

Added Note when making the administrative LAN, used in the shutdown facility, redundant by GLS.

5.1.2 Configuring the Shutdown Facility

Added Note when the connection to the XSCF is SSH connection.

8.2 Changing an IP Address on the Public LAN

Added Note when using the NFS Lock Failover function.

3.1 PRIMECLUSTER Installation
6.4.1.3 Notes on the Operation

1.4

Changed the description in "Notes on using the file lock facility."

6.7.1.2 Creating Fsystem Resources

Changed the descriptions in the following operations.

  • Changed the description of "See" in "2) Set up the NFS service."

  • Changed the description when storing the NFS file lock information in "3) Carry out preparations for enabling NFS Lock Failover."

  • Changed the description in "4) Set up the NFS entry of PRIMECLUSTER."

6.7.1.2.1 Prerequisites

Added the section "7.5 Notes on Operation."

Chapter 7 Operations

Added the description for the messages when executing the fjsnap command.

C.1.1 Executing the fjsnap Command

Added the notes on the mountpoint of the ZFS storage pool.

6.4.1.1 Design for using ZFS with a Cluster System

1.5

Added the note on the non-legacy zfs file system.

6.4.1.3 Notes on the Operation

Added the description of environment variables that can be referred by the Check script.

6.6 Setting Up Online/Offline Scripts

Changed the note on characters that cannot be used in the file path and the arguments.

6.7.1.1 Creating Cmdline Resources

Added the note on using the mountpoint that shares NFS.

6.7.1.2 Creating Fsystem Resources

Changed the example when the mountpoint is not set to the ZFS storage pool and the preparation steps to share a file system in a network (NFS).

6.7.1.2.1 Prerequisites

Changed the note on selecting mount points.

6.7.1.2.2 Setup Method

Added the note on a resource name of the patrol diagnosis facility.

6.7.2.1 Creating Standby Cluster Applications

Deleted the description of the hvreset command.hvreset and added the note on the cluster applications with an exclusive relationship.

6.7.3.1 Setting Exclusive Relationships Between Cluster Applications

Change the operation procedure when changing an IP address on the public LAN.

8.2 Changing an IP Address on the Public LAN

Added the procedure for replacing XSCF.

8.11.3 Replacing XSCF

Changed the procedure for restoring the PRIMECLUSTER operation environment.

11.2 Restoring the PRIMECLUSTER Operation Environment

Changed the description of the required value for the resource database.

A.5.1 CF Configuration

Added the maximum value for the number of cluster applications.

A.9 Cluster Application Worksheets

Added and changed the setting contents of the configuration global settings worksheet.

A.9.11 Configuration Global Settings Worksheet

Changed the manual pages of the shutdown facility.

B.8 Shutdown Facility (SF)

Added the note on changing the registration information of the procedure resource.

F.2.3 Changing Registration Information of a Procedure Resource

Added the dependency between SMF services of RMS and zones.

H.3.1 Creating Global Zone

Changed the procedure when newly installing OS.

H.3.4 Creating Non-Global Zones

Changed the descriptions of "Setup of Non-Global Zone RMS."

H.3.4 Creating Non-Global Zones

Added the note on the host name to be set to the non-global zone.

H.3.4 Creating Non-Global Zones

Added the description to "Creating Cluster Applications" described in the procedure for building clusters in Oracle Solaris Zones environment.

H.3.5 Reconfiguration of Cluster Applications on Global Zone

Added the descriptions about the service names corresponding to each port number to Remarks.

K.2 SMF Service Lists