This manual serves as your starting point for using PRIMECLUSTER. It explains the workflow of the series of operations from installation to operation management of the PRIMECLUSTER system. Since the PRIMECLUSTER system comprises multiple features, there are several other manuals besides this one for each feature. However, by reading this manual first, you will be able to perform the series of operations because this manual refers readers to other manuals that contain feature-specific information that is necessary for the operations.
This manual also provides a functional overview of products that are supported by the PRIMECLUSTER system and describes operation procedures.
This manual only covers the basic operation of PRIMECLUSTER. For operations using different hardware and software configurations, see "Related Documentation."
The table below shows the operation flow from PRIMECLUSTER installation to the start of operation management and indicates the reference location in this manual for each operation.
PRIMECLUSTER system operation flow | Reference location in this manual |
|---|---|
1. Understanding the flow of PRIMECLUSTER system building and designing the PRIMECLUSTER system | Part 1 Planning |
2. Installing the PRIMECLUSTER system | Part 2 Installation |
3. Monitoring the operation status of the PRIMECLUSTER system | Part 3 Operations |
4. Changing the PRIMECLUSTER system configuration after system operation has been started | Part 4 System Configuration Modifications |
5. Maintaining the PRIMECLUSTER system | Part 5 Maintenance |
6. Installing products for the PRIMECLUSTER system | Part 6 PRIMECLUSTER Products |
For detailed procedural explanations, refer to the reference manuals that are indicated in the target location of each part.
Target Readers
This manual is intended for all users who use PRIMECLUSTER 4.3 and perform cluster system installation and operation management. It is also intended for programmers who develop applications that operate on PRIMECLUSTER.
Configuration of This Documentation
This manual consists of six parts, appendixes, and a glossary. The contents of each part are described below.
Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes the overall workflow from installation to operation of the PRIMECLUSTER system.
Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes operations for software installation, cluster building, and application building.
Audience: System administrators who manage system operations
Contents: This part describes operation methods for operations such as monitoring the PRIMECLUSTER system and investigating failure causes.
Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes necessary work items for additions, modifications, and deletions to the PRIMECLUSTER system configuration.
Audience: System administrators who build PRIMECLUSTER systems
Contents: This part describes the items related to the maintenance of the PRIMECLUSTER system.
Audience: Users who operate PRIMECLUSTER products on PRIMECLUSTER systems
Contents: This part describes the versions and levels of products that are supported by the PRIMECLUSTER system and provides a functional overview of those products.
Audience: Users who design PRIMECLUSTER systems
Contents: This appendix contains the PRIMECLUSTER System Design Worksheet.
Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes the online manual pages that are used by the individual features of the PRIMECLUSTER system.
Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes corrective actions for problems that may occur in the PRIMECLUSTER system. It also explains how to collect data when requesting a problem investigation.
Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes the contents and actions for messages output by the userApplication Configuration Wizard GUI and messages output by procedure resources in PRIMECLUSTER systems. For other messages, this manual indicates the reference locations in other manuals.
Audience: All users who use PRIMECLUSTER-compatible resources
Contents: This appendix describes procedures for registering, changing, and deleting procedure resources when the cluster applications use procedure resources.
Audience: All users who use PRIMECLUSTER-compatible resources
Contents: This appendix describes procedures for registering PRIMECLUSTER-compatible resources.
Audience: All users who use PRIMECLUSTER systems
Contents: This appendix descries Configuration Update Service for SA.
Audience: All users who use PRIMECLUSTER systems in a VMware environment
Contents: This appendix describes the installation procedures for using the PRIMECLUSTER system in a VMware environment.
Audience: System administrators who build PRIMECLUSTER systems
Contents: This appendix provides explanations on scripts and daemons that are started by PRIMECLUSTER, and the port numbers being used.
Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes the procedure when using Firewall in the PRIMECLUSTER system.
Audience: All users who use PRIMECLUSTER 4.0A20, 4.1A20, 4.1A30, 4.2A00, 4.2A30 or 4.3A00.
Contents: This appendix describes the changes made to the specifications of PRIMECLUSTER 4.3A01.
Audience: All users who use PRIMECLUSTER systems
Contents: This appendix describes the main changes of this manual.
Audience: All users who use PRIMECLUSTER systems
Contents: This section explains terms used to describe the PRIMECLUSTER system.
Related Documentation
Refer to the following manuals as necessary when setting up the cluster:
PRIMECLUSTER Concepts Guide
PRIMECLUSTER Cluster Foundation (CF) Configuration and Administration Guide
PRIMECLUSTER Reliant Monitor Services (RMS) with Wizard Tools Configuration and Administration Guide
PRIMECLUSTER Reliant Monitor Services (RMS) Reference Guide
PRIMECLUSTER Global Disk Services Configuration and Administration Guide
PRIMECLUSTER Global File Services Configuration and Administration Guide
PRIMECLUSTER Global Link Services Configuration and Administration Guide : Redundant Line Control Function
PRIMECLUSTER Web-Based Admin View Operation Guide
PRIMECLUSTER Messages
PRIMECLUSTER Wizard for Oracle Configuration and Administration Guide
Interstage Application Server Reference Manual - Command Edition
Interstage Application Server Operator's Guide
PRIMEQUEST 1000 Series User Interface Operating Instructions
PRIMEQUEST 1000 Series Message Reference
PRIMEQUEST 1000 Series Tool Reference
PRIMEQUEST 1000 Series Installation Manual
PRIMEQUEST 1000 Series Administration Manual
Note
The PRIMECLUSTER documentations include the following documentations in addition to those listed above:
Software Release Guide/Installation Guide for PRIMECLUSTER
This Software Release Guide and Installation Guide are provided with each PRIMECLUSTER product package.
The data is stored on "CD" of each package. For details on the file names, see the documentations.
Manual Series
Manual Printing
If you want to print a manual, use the PDF file found on the CD-ROM for the PRIMECLUSTER product. The correspondences between the PDF file names and manuals are described in the Software Release Guide for PRIMECLUSTER that comes with the product.
Adobe Reader is required to read and print this PDF file. To get Adobe Reader, see Adobe Systems Incorporated's website.
Online Manuals
To allow users to view the online manuals, use the Cluster management server to register each user name to one of the user groups (wvroot, clroot, cladmin, or clmon).
For information on user group registration procedures and user group definitions, see "4.3.1 Assigning Users to Manage the Cluster".
Conventions
Command line examples that require system administrator (or root) rights to execute are preceded by the system administrator prompt, the hash sign (#). Entries that do not require system administrator rights are preceded by a dollar sign ($).
References to the Linux(R) operating system commands are followed by their manual page section numbers in parentheses - for example, cp(1)
Keystrokes that represent nonprintable characters are displayed as key icons such as [Enter] or [F1]. For example, [Enter] means press the key labeled Enter; [Ctrl-b] means hold down the key labeled Ctrl or Control and then press the [B] key.
The following typefaces highlight specific elements in this manual.
Typeface | Usage |
|---|---|
Constant Width | Computer output and program listings; commands, file names, manual page names and other literal programming elements in the main body of text. |
Italic | Variables that you must replace with an actual value. |
Bold | Items in a command line that you must type exactly as shown. |
Example 1
Several entries from an /etc/passwd file are shown below:
root:x:0:0:root:/root:/bin/bash
bin:x:1:1:bin:/bin:/bin/bash
daemon:x:2:2:daemon:/sbin:/bin/bash
lp:x:4:7:lp daemon:/var/spool/lpd:/bin/bash
Example 2
To use the cat(1) command to display the contents of a file, enter the following command line:
$ cat file
Material of particular interest is preceded by the following symbols in this manual:
Point
Contains important information about the subject at hand.
Note
Describes an item to be noted.
Example
Describes operation using an example.
Information
Describes reference information.
See
Provides the names of manuals to be referenced.
Microsoft(R) Windows(R) XP operating system is abbreviated as Windows(R) XP.
Microsoft(R) Windows(R) Vista(R) Business operating system is abbreviated as Windows(R) Vista.
Microsoft(R) Windows(R) 7 Professional operating system is abbreviated as Windows(R) 7.
Windows(R) XP, Windows(R) Vista, and Windows(R) 7 are generically referred to as Microsoft(R) Windows.
Red Hat Enterprise Linux is abbreviated as RHEL.
Red Hat Enterprise Linux AS is abbreviated as RHEL-AS.
Red Hat Enterprise Linux ES is abbreviated as RHEL-ES.
RHEL-AS and RHEL-ES are abbreviated as Linux(R).
VMware(R) ESX(R) is abbreviated as ESX.
VMware(R) ESXi(TM) is abbreviated as ESXi.
If you use ESXi, read "ESX" as "ESXi."
VMware vSphere(R) is abbreviated as VMware vSphere.
VMware vSphere(R) High Availability is abbreviated as VMware HA.
VMware vSphere(R) Fault Tolerance is abbreviated as VMware FT.
VMware vSphere(R) Distributed Resource Scheduler(TM) is abbreviated as VMware DRS.
VMware vSphere(R) vMotion(R) is abbreviated as VMware vMotion.
VMware vSphere(R) Storage vMotion(R) is abbreviated as VMware Storage vMotion.
VMware(R) vCenter(TM) Converter(TM) is abbreviated as VMware vCenter Converter.
Export Controls
Exportation/release of this document may require necessary procedures in accordance with the regulations of your resident country and/or US export control laws.
Trademarks
Red Hat is a registered trademark of Red Hat, Inc. in the U.S. and other countries.
Linux is a registered trademark of Linus Torvalds.
Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.
Microsoft, Windows, WindowsXP, WindowsVista, Windows7 and Internet Explorer are registered trademarks of Microsoft Corporation in the United States and other countries.
CORBA, OMG, and ORB are registered trademarks of Object Management Group (OMG).
NetWorker is a registered trademark or trademark of EMC Corporation in the United States and other countries.
VMware is a registered trademark or trademark of VMware, Inc. in the United States and/or other jurisdictions.
PRIMECLUSTER is a registered trademark of Fujitsu Limited.
Other product names are product names, trademarks, or registered trademarks of these companies.
Requests
No part of this documentation may be reproduced or copied without permission of FUJITSU LIMITED.
The contents of this documentation may be revised without prior notice.
Date of publication and edition
April 2008, First edition |
Copyright notice
All Rights Reserved, Copyright (C) FUJITSU LIMITED 2008-2015.
Revision | Location | Edition |
|---|---|---|
Added the setting procedure for the guest OS in the host OS. | 3.2.1.1 Host OS setup | 6.1 |
Added "6.8 Setting Up the RMS Environment." | Chapter 6 Building Cluster Applications | |
Added the item of RMS shutdown wait time. | A.8.1 RMS Setup Worksheet | |
Added the notes for the maximum numbers of resources and detectors. | A.10 Cluster Application Worksheets | |
Changed the description in Note. | H.1 Cluster Systems in a VMware Environment | |
Changed the step 1. | H.2.4.1 Setting Up I/O Fencing | |
Added the notes to the explanation of the test for forced shutdown of cluster nodes. | 1.4 Test | 6.2 |
Changed the use when building a cluster system between guest OSes on one host OS. | 2.2.1 Virtual Machine Function | |
Changed "Attached Driver Guide" to "PRIMEQUEST 1000 SERIES HBA blockage function USER'S GUIDE". | 3.1.4.2 PRIMEQUEST | |
Changed the setting procedure of virtual SCSI devices in a KVM environment. | 3.2.1.1 Host OS setup | |
Changed the setting procedure of virtual bridges in a Xen environment. | 3.2.1.1 Host OS setup | |
Changed the procedure of Host OS failover function. | 3.2.3 When building a cluster system between guest OSes on multiple host OSes using Host OS failover function | |
Added the notes on the operation check after setting up the shutdown agent. | 5.1.2.3 Setting up the shutdown agent in PRIMERGY | |
Added the explanations of examples and notes on setting the configuration file for the shutdown agent. | 5.1.2.3.2 IPMI | |
Added the notes on use of maintenance mode. | 7.2.2.6 Entering maintenance mode for Cluster Application | |
Added the reference when changing the settings in /etc/sysconfig/libvirt-guests. | 3.2.1.1 Host OS setup | 6.3 |
Added the information to be checked when "TestFailed" or "InitFailed" is displayed in Information "About the displayed results." | 5.1.2.5.2 libvirt | |
Added "8.9.2.3 Changing the Settings in /etc/sysconfig/libvirt-guests." | 8.9.2 KVM environment | |
Changed the explanation for executing failover of the cluster application. | 9.3.2.2 Procedure for Applying Correction by Rolling Update | |
Changed the contents in "Setting value" of "Use" in "Item." | A.10.3 Gds Resource Worksheet | |
Added the notes on environments and functions which PRIMECLUSTER supports. | H.1 Cluster Systems in a VMware Environment | |
Changed the descriptions of the setting for SCSI controllers. | H.2.1.1 Installation and Configuration of Related Software | |
Added "I.4 Changes in PRIMECLUSTER 4.3A10 from 4.1A40." | Appendix I Changes in Each Version | |
Added "HV_CONNECT_TIMEOUT" in all versions as an incompatible function. | Appendix I Changes in Each Version | |
Added "Single-node Cluster Operation." | 2.3 Determining the Cluster System Operation Mode | 6.4 |
Added the notes on an immediate cluster failover when an error occurs on an I/O device that a system volume is allocated. | 3.1.2 Setting Up Disk Units | |
Added the notes on the single-node cluster operation. | 4.3.3.1 Initial setup of the operation management server | |
Added the note in the case of creating a redundant administrative LAN used in the shutdown facility by using GLS. | 5.1.2 Setting Up the Shutdown Facility | |
Changed the setting of "weight" of "Node information" found on the Cluster Configuration Worksheet in System Design Examples. | A.11.1.1 Cluster Configuration Worksheet | |
Changed the note on the path policy for the Native Multipathing. | H.1 Cluster Systems in a VMware Environment | |
Changed the note that try not to target a virtual machine that installs PRIMECLUSTER as cluster functions of VMware. | H.1 Cluster Systems in a VMware Environment | |
Changed the descriptions on the installation of VMware vSphere. | H.2.1.1 Installation and Configuration of Related Software | |
Added the section "7.5 Notes on Operation." | Chapter 7 Operations | 6.5 |
Added the description about the setting of kdump. | 3.3 PRIMECLUSTER Installation | 6.6 |
Added the note in the case of creating a redundant administrative LAN used in the shutdown facility by using GLS. | 5.1.2 Setting Up the Shutdown Facility | |
Added the RX500 series for the supported hardware device. | 5.1.2 Setting Up the Shutdown Facility | |
Described the procedure to encrypt the password. | 5.1.2.3.2 IPMI | |
Added the notes on characters allowed in passwords. | 5.1.2.4.1 MMB | |
Added the notes when nodes were forcibly stopped by the SA_mmbr shutdown agent. | 5.1.2.4.1 MMB | |
Changed the procedure to start the shutdown facility. | 5.1.2.5.1 vmSP (Virtual Machine Service Provider) | |
Described the information about the maximum concurrent connections for SSH. | 5.1.2.5.1 vmSP (Virtual Machine Service Provider) | |
Added the note on the hvw command. | 6.7.2 Setting Up userApplication | |
Added the notes on the virtual machine function. | 2.2.1 Virtual Machine Function | 6.7 |
Added the notes on umask. | Chapter 3 Software Installation | |
Deleted the descriptions for "Behavior setup of recovery function." | 3.1.3 Setting Up Hardware Monitoring with ServerView (PRIMERGY) | |
Added the notes on setting up the virtual bridge for the administrative LAN in a KVM environment. | 3.2.1.1 Host OS setup | |
Added the notes when setting /etc/sysconfig/libvirtguests. | 3.2.1.1 Host OS setup | |
Changed the setting procedure of virtual SCSI devices in a KVM environment. | 3.2.1.1 Host OS setup | |
Added the notes on Firewall. | 5.1 Initial Cluster Setup | |
Modified the descriptions of the CF node name. | 5.1.1 Setting Up CF and CIP | |
Changed the procedure to start the shutdown facility. | 5.1.2.3.5 Starting up the shutdown daemon | |
Added the notes on SA_libvirtgp. | 5.1.2.5.2 libvirt | |
Changed the operation procedure to register hardware devices. | 5.1.3.2 Registering Hardware Devices | |
Changed the descriptions for "Preparation prior to displaying fault resource identification and operator intervention request messages." | 5.2 Setting Up Fault Resource Identification and Operator Intervention Request | |
Added the notes on GDS configuration setup. | 6.3 GDS Configuration Setup | |
Added the notes on setting up shared disks. | 6.3.2 Setting Up Shared Disks | |
Changed the explanation of the environment variable HV_AUTORECOVER. | 6.6 Setting Up Online/Offline Scripts | |
Added the reference to set up Online/Offline scripts. | 6.6 Setting Up Online/Offline Scripts | |
Added "PartialCluster" to the attribute of the userApplication. | 6.7.2.1 Creating Standby Cluster Applications | |
Deleted the reference. | 6.7.2.1 Creating Standby Cluster Applications | |
Modified the display example of the hvw command. | 6.7.2.1 Creating Standby Cluster Applications | |
Changed the example of how to execute a command. | 6.7.3.3 Preliminary Setup for Gds Resources | |
Changed the operation procedure to set up takeover network resources. | 6.7.3.6 Setting Up Takeover Network Resources | |
Added the notes on Configuration-Activate. | 6.7.4 Generate and Activate | |
Added the state icon to the table of "State display of other objects." | 7.1.3.1 RMS Tree | |
Changed the operation procedure. | 7.2.2.4 Bringing Faulted Cluster Application to Online State | |
Changed the explanation of maintenance mode. | 7.2.2.6 Entering maintenance mode for Cluster Application | |
Added the state icon to the node state table. | 7.3.1 Monitoring the State of a Node | |
Added the symbols that indicate the state of a cluster application. | 7.3.2 Monitoring the State of a Cluster Application | |
Changed the explanation of how to change PRIMECLUSTER operation attributes. | 8.6 Changing PRIMECLUSTER Operation Attributes | |
Changed the structure of this section to add explanations to change the user name and password for iRMC. | 8.10 Changing IPMI Settings | |
Changed the structure of this section to add explanations to change the slot number of server blades. | 8.11 Changing Blade Settings | |
Added the information of how to stop RMS. | 8.12.1.1 Adding the shared disk device | |
Added the explanations of when setting Gds resources is not necessary. | 8.12.1.1 Adding the shared disk device | |
Added the procedure to add the shared disk device. | 8.12.1.1 Adding the shared disk device | |
Added the procedure "5. Change the device name of the resource of the shared disk device." | 8.12.2.1 Deleting the shared disk device | |
Described the procedure required after execution of the cldelrsc command. | 8.12.2.1 Deleting the shared disk device 8.12.3.1 Changing the shared disk device | |
Added the notes on the GDS configuration file. | 8.12.2.1 Deleting the shared disk device 8.12.3.1 Changing the shared disk device | |
Added the procedure to change the shared disk device. | 8.12.3.1 Changing the shared disk device | |
Changed the descriptions of how to change the hardware. | 8.12.3.2 Changing a network interface card used for the public LAN and the administrative LAN | |
Added the notes when using message queues on applications. | A.6.2 RMS Configuration | |
Changed the Gds Resource worksheet. | A.10.3 Gds Resource Worksheet | |
Changed the notes on configuration on the virtual machine function. | A.12.1 When building a cluster system between guest OSes on one host OS | |
Deleted the following commands from the list of the online manual page for RMS: | B.6 RMS | |
Changed the table of the search procedure. | D.1 Searching for a Message | |
Changed the description of the operation environment for Configuration Update Service for SA. | G.2 Operation Environment | |
Changed the notes on the cluster system in a VMware environment. | H.1 Cluster Systems in a VMware Environment | |
Changed the descriptions of how to configure the /etc/hostid file to run I/O fencing properly. | H.2.1.1 Installation and Configuration of Related Software | |
Added the following appendixes: | Appendixes | |
Changed the descriptions of information on incompatibility. | K.1.2 hvdisp command K.1.10 Node state K.1.11 Operation Procedures and Displayed Items for Cluster Application Setup and Modification K.2.2 hvdisp command K.2.4 Node state K.2.5 Operation Procedures and Displayed Items for Cluster Application Setup and Modification K.3.2 Operation Procedures and Displayed Items for Cluster Application Setup and Modification | |
Changed the description of the settings to enable the fault resource identification and the operator intervention request. | 5.2 Setting Up Fault Resource Identification and Operator Intervention Request | 6.8 |
Added S06clonltrc to the startup script list. | I.2 Startup Script List | |
Changed the note when allowing the port number used by PRIMECLUSTER. | Appendix J Using Firewall |
