Top
PRIMECLUSTER  Installation and Administration Guide 4.3

Preface

This manual serves as your starting point for using PRIMECLUSTER. It explains the workflow of the series of operations from installation to operation management of the PRIMECLUSTER system. Since the PRIMECLUSTER system comprises multiple features, there are several other manuals besides this one for each feature. However, by reading this manual first, you will be able to perform the series of operations because this manual refers readers to other manuals that contain feature-specific information that is necessary for the operations.

This manual also provides a functional overview of products that are supported by the PRIMECLUSTER system and describes operation procedures.

This manual only covers the basic operation of PRIMECLUSTER. For operations using different hardware and software configurations, see "Related Documentation."

The table below shows the operation flow from PRIMECLUSTER installation to the start of operation management and indicates the reference location in this manual for each operation.

Flow from PRIMECLUSTER system installation to operation management

PRIMECLUSTER system operation flow

Reference location in this manual

1. Understanding the flow of PRIMECLUSTER system building and designing the PRIMECLUSTER system

Part 1 Planning

2. Installing the PRIMECLUSTER system

Part 2 Installation

3. Monitoring the operation status of the PRIMECLUSTER system

Part 3 Operations

4. Changing the PRIMECLUSTER system configuration after system operation has been started

Part 4 System Configuration Modifications

5. Maintaining the PRIMECLUSTER system

Part 5 Maintenance

6. Installing products for the PRIMECLUSTER system

Part 6 PRIMECLUSTER Products

For detailed procedural explanations, refer to the reference manuals that are indicated in the target location of each part.

Target Readers

This manual is intended for all users who use PRIMECLUSTER 4.3 and perform cluster system installation and operation management. It is also intended for programmers who develop applications that operate on PRIMECLUSTER.

Configuration of This Documentation

This manual consists of six parts, appendixes, and a glossary. The contents of each part are described below.

Part 1 Planning

Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes the overall workflow from installation to operation of the PRIMECLUSTER system.

Part 2 Installation

Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes operations for software installation, cluster building, and application building.

Part 3 Operations

Audience: System administrators who manage system operations
Contents: This part describes operation methods for operations such as monitoring the PRIMECLUSTER system and investigating failure causes.

Part 4 System Configuration Modifications

Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes necessary work items for additions, modifications, and deletions to the PRIMECLUSTER system configuration.

Part 5 Maintenance

Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes the items related to the maintenance of the PRIMECLUSTER system.

Part 6 PRIMECLUSTER Products

Audience: Users who operate PRIMECLUSTER products on PRIMECLUSTER systems
Contents: This part describes the versions and levels of products that are supported by the PRIMECLUSTER system and provides a functional overview of those products.

Appendix A PRIMECLUSTER System Design Worksheets

Audience: Users who design PRIMECLUSTER systems
Contents: This appendix contains the PRIMECLUSTER System Design Worksheet.

Appendix B Manual Pages

Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes the online manual pages that are used by the individual features of the PRIMECLUSTER system.

Appendix C Troubleshooting

Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes corrective actions for problems that may occur in the PRIMECLUSTER system. It also explains how to collect data when requesting a problem investigation.

Appendix D Messages

Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes the contents and actions for messages output by the userApplication Configuration Wizard GUI and messages output by procedure resources in PRIMECLUSTER systems. For other messages, this manual indicates the reference locations in other manuals.

Appendix E Registering, Changing, and Deleting State Transition Procedure Resources for PRIMECLUSTER Compatibility

Audience: All users who use PRIMECLUSTER-compatible resources
Contents: This appendix describes procedures for registering, changing, and deleting procedure resources when the cluster applications use procedure resources.

Appendix F Registering PRIMECLUSTER-compatible Resources

Audience: All users who use PRIMECLUSTER-compatible resources
Contents: This appendix describes procedures for registering PRIMECLUSTER-compatible resources.

Appendix G Configuration Update Service for SA

Audience: All users who use PRIMECLUSTER systems
Contents: This appendix descries Configuration Update Service for SA.

Appendix H Using PRIMECLUSTER in a VMware Environment

Audience: All users who use PRIMECLUSTER systems in a VMware environment
Contents: This appendix describes the installation procedures for using the PRIMECLUSTER system in a VMware environment.

Appendix I Changes in Each Version

Audience: All users who use PRIMECLUSTER 4.0A20, 4.1A20, 4.1A30, 4.2A00 or 4.2A30.
Contents: This appendix describes the changes made to the specifications of PRIMECLUSTER 4.3A00.

Appendix J Release Information

Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes the main changes of this manual.

Glossary

Audience: All users who use PRIMECLUSTER systems
Contents: This section explains terms used to describe the PRIMECLUSTER system.

Related Documentation

Refer to the following manuals as necessary when setting up the cluster:

Note

The PRIMECLUSTER documentations include the following documentation in addition to those listed above:

  • PRIMECLUSTER Installation Guide

    This installation guide (text data) is provided with each PRIMECLUSTER product package.

    The data is stored on "CD3" of each package. For details on the file names, see the documentation provided with each product.

Manual Series

Manual Printing

If you want to print a manual, use the PDF file found on the CD-ROM for the PRIMECLUSTER product. The correspondences between the PDF file names and manuals are described in the Installation Guide for PRIMECLUSTER that comes with the product.

Adobe Reader is required to read and print this PDF file. To get Adobe Reader, see Adobe Systems Incorporated's website.

Online Manuals

To allow users to view the online manuals, use the Cluster management server to register each user name to one of the user groups (wvroot, clroot, cladmin, or clmon).

For information on user group registration procedures and user group definitions, see "4.3.1 Assigning Users to Manage the Cluster".

Conventions

Notation
Prompts

Command line examples that require system administrator (or root) rights to execute are preceded by the system administrator prompt, the hash sign (#). Entries that do not require system administrator rights are preceded by a dollar sign ($).

Manual page section numbers

References to the Linux(R) operating system commands are followed by their manual page section numbers in parentheses - for example, cp(1)

The keyboard

Keystrokes that represent nonprintable characters are displayed as key icons such as [Enter] or [F1]. For example, [Enter] means press the key labeled Enter; [Ctrl-b] means hold down the key labeled Ctrl or Control and then press the [B] key.

Typefaces

The following typefaces highlight specific elements in this manual.

Typeface

Usage

Constant Width

Computer output and program listings; commands, file names, manual page names and other literal programming elements in the main body of text.

Italic

Variables that you must replace with an actual value.

Bold

Items in a command line that you must type exactly as shown.

Example 1

Several entries from an /etc/passwd file are shown below:

root:x:0:0:root:/root:/bin/bash

bin:x:1:1:bin:/bin:/bin/bash

daemon:x:2:2:daemon:/sbin:/bin/bash

lp:x:4:7:lp daemon:/var/spool/lpd:/bin/bash

Example 2

To use the cat(1) command to display the contents of a file, enter the following command line:

$ cat file

Notation symbols

Material of particular interest is preceded by the following symbols in this manual:

Point

Contains important information about the subject at hand.

Note

Describes an item to be noted.

Example

Describes operation using an example.

Information

Describes reference information.

See

Provides the names of manuals to be referenced.

Abbreviations

Trademarks

Linux is a trademark or registered trademark of Mr. Linus Torvalds in the United States and other countries.

Red Hat, RPM and all Red Hat based marks and logos are trademarks or registered trademarks of Red Hat, Inc. in the United States and other countries.

SUSE and all SUSE-related products and logos are trademarks or registered trademarks of SUSE, Inc. in the United States and other countries.

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.

Netscape and Netscape Navigator are trademarks or registered trademarks of Netscape Communications Corporation in the United States and other countries.

Microsoft Internet Explorer is a registered trademark of Microsoft Corporation in the United States and other countries.

Microsoft, Windows, Windows NT, and Windows NT Server are registered trademarks of Microsoft Corporation in the United States and other countries.

CORBA, OMG, and ORB are registered trademarks of Object Management Group (OMG).

NetWorker is a registered trademark or trademark of EMC Corporation in the United States and other countries.

VMware is a registered trademark or trademark of VMware, Inc. in the United States and/or other jurisdictions.

PRIMECLUSTER is a registered trademark of Fujitsu Limited.

Other product names are product names, trademarks, or registered trademarks of these companies.

Requests

Date of publication and edition

April 2008, First edition
October 2008, Second edition
June 2009, Third edition
August 2009, Fourth edition
January 2010, Fifth edition
May 2011, 5.1 edition
August 2011, 5.2 edition
August 2012, 5.3 edition
February 2014, 5.4 edition

Copyright notice

All Rights Reserved, Copyright (C) FUJITSU LIMITED 2008-2014.

Editing record

Additions and changes

Section

Manual code

Added and changed descriptions for the virtual machine function.

1.1 Planning
2.2 System Design
2.2.1 Virtual Machine Function
3.2.2 When building a cluster system between guest OSes on two host OSes (PRIMEQUEST 1000 Series)
5.1.2 Setting Up the Shutdown Facility
5.1.2.4.3 vmSP (Virtual Machine Service Provider)
7.4.2 Corrective Action in the event of the LEFTCLUSTER state when the virtual machine function is used
8.9.2 PRIMEQUEST 1000 series
A.12 System Design Examples (for the Virtual Machine Function used)

J2UZ-5274-05ENZ0(01)
J2UZ-5274-05ENZ2(01)

Changed the path name of the GFS shared file system.

6.4 Initial GFS Setup

Changed the descriptions in the note.

7.2.2.6 Entering maintenance mode for Cluster Application

Added "physical machine".

Glossary

Added descriptions for Configuration Update Service for SA.

Appendix G Configuration Update Service for SA

J2UZ-5274-05ENZ0(02)
J2UZ-5274-05ENZ2(02)

Added and changed descriptions for using a VMware environment.

2.2 System Design
2.2.1 Virtual Machine Function
3.2 Installation and Setup of Related Software (for the Virtual Machine Function used)
A.12 System Design Examples (for the Virtual Machine Function used)
Appendix H Using PRIMECLUSTER in a VMware Environment

J2UZ-5274-05ENZ0(03)
J2UZ-5274-05ENZ2(03)

Added RHEL5.5 to the supported OS.

3.1.4.1 PRIMERGY
A.5 Cluster Installation Environment Worksheet

Changed the descriptions for CF node names.

5.1.1 Setting Up CF and CIP

Added notes.

6.7.3.2 Setting Up Fsystem Resources
7.2.2.1 Starting a Cluster Application
7.4.1.1 Failure Detection and Cause Identification if a Failure Occurs

Added procedures to change the MMB IP address.

8.8.1 Changing the MMB IP Address

Added procedures to change IPMI settings.

8.10 Changing IPMI Settings

Added procedures to change Blade settings.

8.11 Changing Blade Settings

Added procedures to add, delete, and change hardware.

8.12 Adding, Deleting, and Changing Hardware

Added procedures to change the startup priority of a state transition procedure.

E.2 Changing a Procedure Resource

Changed PSA to PSA/SVmco.

3.1.4.2 PRIMEQUEST

J2UZ-5274-05ENZ0(04)
J2UZ-5274-05ENZ2(04)

Added the supported server models.

C.1.3 PSA Information

Added the description on how to collect the SVmco information.

C.1.4 SVmco Information

Added notes for setting up disk units.

3.1.2 Setting Up Disk Units
3.2.1.1 Host OS setup
3.2.2.1 Host OS setup

J2UZ-5274-05ENZ0(05)
J2UZ-5274-05ENZ2(05)

Added and changed descriptions for using a VMware environment with the virtual machine function.

H.1 Cluster Systems in a VMware Environment
H.2.1.1 Installation and Configuration of Related Software
H.2.1.2 Installation and Environment Configuration of Applications
H.2.4.1 Setting Up I/O Fencing

Added notes to the test for forced shutdown of cluster nodes.

1.4 Test

J2UZ-5274-05ENZ0(06)
J2UZ-5274-05ENZ2(06)

Added notes on the operation check after setting up the shutdown agent.

5.1.2.3 Setting up the shutdown agent in PRIMERGY
5.1.2.4 Setting up the shutdown agent in PRIMEQUEST

Added considerations on using the Spanning Tree Protocol with PRIMERGY to Note.

5.1.2.3.1 Setting up the shutdown daemon

Added notes on setting the configuration file for the shutdown agent.

5.1.2.3.2 IPMI
5.1.2.3.3 Blade

Changed the explanation of the environment variable HV_AUTORECOVER.

6.6 Setting Up Online/Offline Scripts

Added a condition to select the userApplication in "Application selection menu."

8.1 Changing the Cluster Configuration

Modified the procedure to change the IP addresses of the shutdown facility or shutdown agent.

8.2.1 Changing the IP address of the public LAN
8.2.2 Changing the IP address of the administrative LAN

Changed the structure of this section to add explanations to change the user name and password for iRMC.

8.10 Changing IPMI Settings
8.10.1 Changing the IPMI IP addresses
8.10.2 Changing the User Name and Password for iRMC

Changed the structure of this section to add explanations to change the slot number of server blades.

8.11 Changing Blade Settings
8.11.1 Changing the IP Address of the Management Blade
8.11.2 Changing the Slot Number of Server Blades

Added conditions where stopping RMS is not necessary to Information.

8.12.1.1 Adding a shared disk device

Added explanations of when setting Gds resources is not necessary.

8.12.1.1 Adding a shared disk device

Changed the explanation for executing failover of the cluster application.

9.3.2.2 Procedure for Applying Correction by Rolling Update

Changed the description of Linux versions in "Notes" in the worksheet table.

A.5 Cluster Installation Environment Worksheet

Changed the attribute and the setting value of the resource operation.

A.10.3 Gds Resource Worksheet

Added explanations of "SA".

Glossary

Added a note in the case of creating a redundant administrative LAN used in the shutdown facility by using GLS.

5.1.2 Setting Up the Shutdown Facility

J2UZ-5274-05ENZ0(07)
J2UZ-5274-05ENZ2(07)

Described the procedure to encrypt the password.

5.1.2.3.2 IPMI

Added notes on characters allowed in passwords.

5.1.2.4.1 MMB

Added notes when nodes were forcibly stopped by the SA_mmbr shutdown agent.

5.1.2.4.1 MMB

Changed the procedure to start the shutdown facility.

5.1.2.4.2 VMGuest (virtual machine)
5.1.2.4.3 vmSP (Virtual Machine Service Provider)

Described the information about the maximum concurrent connections for SSH.

5.1.2.4.2 VMGuest (virtual machine)
5.1.2.4.3 vmSP (Virtual Machine Service Provider)

Added the note on the hvw command.

6.7.2 Setting Up userApplication