Pacemaker is an open source cluster manager software which provide high availability of resources or services in CentOS 7 or RHEL 7 Linux. It has feature of scalable and advanced HA Cluster Manager. This HA cluster manager distributed by ClusterLabs.<\/p>\n\n\n\n
Corosync is the core of Pacemaker Cluster Manager as it is responsible for generating heartbeat communication between cluster nodes which make it capable of deploying High Availability in applications. Corosync is derived from an Open Source project OpenAIS under new BSD License.<\/p>\n\n\n\n
Pcsd is a Pacemaker command line interface (CLI) and GUI for managing the Pacemaker cluster. PCSD command pcs is use for creating, configuring and adding a new node to cluster.<\/p>\n\n\n\n
In this tutorial I will use pcsd in CLI for configuring Active\/Passive Pacemaker Cluster to provide high availability of Nginx webservice in CentOS 7. In this article I have tried to give basic idea of how to configure the Pacemaker cluster on CentOS 7 (applicable same to RHEL 7 as CentOS is mimic of RHEL). For basic cluster configuration I have disable the STONITH and ignore the Quorum but for Production environment I suggest to use STONITH feature of Pacemaker.<\/p>\n\n\n\n
Here is Short Defination of STONITH: STONITH or Shoot The Other Node In The Head is the fencing implementation on Pacemaker. It is a technique for fencing in computer clusters. Fencing is the isolation of a failed node so that it does not cause disruption to a computer cluster.<\/p>\n\n\n\n
For demonstration I have built two VMs (Virtual Machines) on KVM based on my Ubuntu 16.04 base machine and those VMs have private IP addresses.<\/p>\n\n\n\n
Note: I am referring my VMs as Cluster node for better presenting them in rest of the topics.<\/p>\n\n\n\n
Pre-requisite for configuring pacemaker cluster<\/p>\n\n\n\n
Minimum two CentOS 7 Server
\nwebserver01: 192.168.1.33
\nwebserver02: 192.168.1.34
\nFloating IP Address: 192.168.1.30
\nRoot Privilege<\/p>\n\n\n\n
Below are the points which I will follow for Installing and Configuring two node Pacemaker Cluster:<\/p>\n\n\n\n
Steps for Installation and configuration of pacemaker cluster<\/p>\n\n\n\n
As in my test lab I am not using DNS for resolving the both pacemaker cluster node hostname thus I have configured \/etc\/hosts file for resolving hostname of both nodes. But my suggestion is, though you have DNS in your environment for name resolution but still for better Pacemaker Cluster heartbeat communication between cluster nodes you should configure \/etc\/hosts file.<\/p>\n\n\n\n
Edit the \/etc\/hosts file with desire editor in both cluster nodes, below is example of \/etc\/hosts file which I have configured in both cluster nodes.<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# cat \/etc\/hosts
\n127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
\n::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
\n192.168.1.33 webserver01
\n192.168.1.34 webserver02
<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# \n<\/p>\n\n\n
[root@webserver02 ~]<\/p>\n\n\n\n
# cat \/etc\/hosts
\n127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
\n::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
\n192.168.1.33 webserver01
\n192.168.1.34 webserver02
<\/p>\n\n\n
[root@webserver02 ~]<\/p>\n\n\n\n
#
\nPost \/etc\/hosts file configuration we will test the connectivity of both cluster nodes with each other through ping command:
\nExample:\n<\/p>\n\n\n\n
ping -c 3 webserver01
\nping -c 3 webserver02
\nIf we will get reply like below that means our webservers are communicating with each other.<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# ping -c 3 webserver02
\nPING webserver02 (192.168.1.34) 56(84) bytes of data.
\n64 bytes from webserver02 (192.168.1.34): icmp_seq=1 ttl=64 time=1.10 ms
\n64 bytes from webserver02 (192.168.1.34): icmp_seq=2 ttl=64 time=0.727 ms
\n64 bytes from webserver02 (192.168.1.34): icmp_seq=3 ttl=64 time=0.698 ms\n<\/p>\n\n\n\n
— webserver02 ping statistics —
\n3 packets transmitted, 3 received, 0% packet loss, time 2002ms
\nrtt min\/avg\/max\/mdev = 0.698\/0.843\/1.106\/0.188 ms
\n<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
#\n<\/p>\n\n\n
[root@webserver02 ~]<\/p>\n\n\n\n
# ping -c 3 webserver01
\nPING webserver01 (192.168.1.33) 56(84) bytes of data.
\n64 bytes from webserver01 (192.168.1.33): icmp_seq=1 ttl=64 time=0.197 ms
\n64 bytes from webserver01 (192.168.1.33): icmp_seq=2 ttl=64 time=0.123 ms
\n64 bytes from webserver01 (192.168.1.33): icmp_seq=3 ttl=64 time=0.114 ms\n<\/p>\n\n\n\n
— webserver01 ping statistics —
\n3 packets transmitted, 3 received, 0% packet loss, time 1999ms
\nrtt min\/avg\/max\/mdev = 0.114\/0.144\/0.197\/0.039 ms
\n<\/p>\n\n\n
[root@webserver02~]<\/p>\n\n\n\n
#\n<\/p>\n\n\n\n
In this Steps we will install EPEL (Extra Package for Enterprise Linux) repository and then Nginx. For Nginx installation EPEL repository package need to install first.<\/p>\n\n\n\n
yum -y install epel-release
\nNow install Nginx:<\/p>\n\n\n\n
yum -y install nginx<\/p>\n\n\n\n
Now we will install the pacemaker, pcs and corosync package with yum command. These package does not require seperate repository as they will use default CentOS repository.<\/p>\n\n\n\n
yum -y install corosync pacemaker pcs
\nOnce Cluster packages will install successfully enable the cluster services in startup through systemctl commands as mentioned below:<\/p>\n\n\n\n
systemctl enable pcsd
\nsystemctl enable corosync
\nsystemctl enable pacemaker
\nNow Start the pcsd service in both cluster nodes and also enable it in system startup.<\/p>\n\n\n\n
systemctl start pcsd.service
\nsystemctl enable pcsd.service
\nThe pcsd daemon works with the pcs command-line interface to manage synchronizing the corosync configuration across all nodes in the cluster.<\/p>\n\n\n\n
The user hacluster is created automatically with disable password during package installation this account is needed a login credential for syncing the corosync configuration, or starting and stopping the cluster service on other cluster nodes.
\nIn next step we will create a new password for hacluster user and we will use same password for rest cluster node as well.<\/p>\n\n\n\n
passwd hacluster
\nChanging password for user hacluster.
\nNew password:
\nRetype new password:
\npasswd: all authentication tokens updated successfully.<\/p>\n\n\n\n
Note: This steps from Step 4 to 7 will only need to perform on webserver01 server.
\nThis step will cover the creating of new 2 nodes CentOS Linux cluster servers which will host Nginx resources and Floating IP Address.<\/p>\n\n\n\n
First of all to create cluster we need to authorize all servers using the pcs command and the hacluster user.<\/p>\n\n\n\n
Authorize both cluster webservers with the pcs command and hacluster user and password.<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# pcs cluster auth webserver01 webserver02
\nUsername: hacluster
\nPassword:
\nwebserver01: Authorized
\nwebserver02: Authorized
<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
#
\nNote: If you are getting below error after running above auth command:\n<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# pcs cluster auth webserver01 webserver02
\nUsername: hacluster
\nPassword:
\nwebserver01: Authorized
\nError: Unable to communicate with webserver02
\nThen you need to define firewalld rules in both nodes which enable the communication of both Cluster nodes:\n<\/p>\n\n\n\n
Below are the example for adding rules for Cluster and ngnix as well<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# firewall-cmd –permanent –add-service=high-availability
\nsuccess
<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# firewall-cmd –permanent –add-service=http
\nsuccess
<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# firewall-cmd –permanent –add-service=https
\nsuccess
<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# firewall-cmd –reload
\nsuccess
<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# firewall-cmd –list-all
\npublic (active)
\ntarget: default
\nicmp-block-inversion: no
\ninterfaces: eth0
\nsources:
\nservices: ssh dhcpv6-client high-availability http https
\nports:
\nprotocols:
\nmasquerade: no
\nforward-ports:
\nsource-ports:
\nicmp-blocks:
\nrich rules:\n<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
#
\nNow we will define the cluster name and cluster node members.\n<\/p>\n\n\n\n
pcs cluster setup –name web_cluster webserver01 webserver02
\nNext start the all cluster services and enable them in system startup.<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# pcs cluster start –all
\nwebserver02: Starting Cluster\u2026
\nwebserver01: Starting Cluster\u2026
<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# pcs cluster enable –all
\nwebserver01: Cluster Enabled
\nwebserver02: Cluster Enabled
<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
#
\nRun the below command to check the Cluster status\n<\/p>\n\n\n\n
pcs status cluster<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# pcs status cluster
\nCluster Status:
\nStack: corosync
\nCurrent DC: webserver02 (version 1.1.18-11.el7_5.3-2b07d5c5a9) – partition with quorum
\nLast updated: Tue Sep 4 02:38:20 2018
\nLast change: Tue Sep 4 02:33:06 2018 by hacluster via crmd on webserver02
\n2 nodes configured
\n0 resources configured\n<\/p>\n\n\n\n
PCSD Status:
\nwebserver01: Online
\nwebserver02: Online
\n<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
#\n<\/p>\n\n\n\n
Disable the STOITH:<\/p>\n\n\n\n
pcs property set stonith-enabled=false
\nIgnore the Quorum Policy:<\/p>\n\n\n\n
pcs property set no-quorum-policy=ignore
\nNow Check whether STONITH and Quorum policy are disable or not with below command:<\/p>\n\n\n\n
pcs property list
\n<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# pcs property list
\nCluster Properties:
\ncluster-infrastructure: corosync
\ncluster-name: web_cluster
\ndc-version: 1.1.18-11.el7_5.3-2b07d5c5a9
\nhave-watchdog: false
\nno-quorum-policy: ignore
\nstonith-enabled: false
<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
#\n<\/p>\n\n\n\n
Floating IP address are cluster virtual IP address which float or move automatically from one cluster node to another cluster node in event of one Active Cluster node failure or disable which was hosting cluster resources.<\/p>\n\n\n\n
In this step we will add Floating IP and Nginx resources:<\/p>\n\n\n\n
Adding Floating IP<\/p>\n\n\n\n
pcs resource create virtual_ip ocf:heartbeat:IPaddr2 ip=192.168.1.30 cidr_netmask=32 op monitor interval=30s
\nAdding nginx resources<\/p>\n\n\n\n
pcs resource create webserver ocf:heartbeat:nginx configfile=\/etc\/nginx\/nginx.conf op monitor timeout=”5s” interval=”5s”
\nNow check newly added resources from below command:<\/p>\n\n\n\n
pcs status resources <\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# pcs status resources
\nvirtual_ip (ocf::heartbeat:IPaddr2): Started webserver01
\nwebserver (ocf::heartbeat:nginx): Started webserver01
<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# \n<\/p>\n\n\n\n
To check cluster service running status
\nNow We will check the Cluster service status before moving to test nginx webservice failover in event of one Active Cluster node fail.<\/p>\n\n\n\n
To check running cluster service status below is the command with example:<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
# pcs status
\nCluster name: web_cluster
\nStack: corosync
\nCurrent DC: webserver01 (version 1.1.18-11.el7_5.3-2b07d5c5a9) – partition with quorum
\nLast updated: Tue Sep 4 03:55:47 2018
\nLast change: Tue Sep 4 03:15:29 2018 by root via cibadmin on webserver01\n<\/p>\n\n\n\n
2 nodes configured
\n2 resources configured<\/p>\n\n\n\n
Online: [ webserver01 webserver02 ]<\/p>\n\n\n\n
Full list of resources:<\/p>\n\n\n\n
virtual_ip (ocf::heartbeat:IPaddr2): Started webserver01
\nwebserver (ocf::heartbeat:nginx): Started webserver01<\/p>\n\n\n\n
Daemon Status:
\ncorosync: active\/enabled
\npacemaker: active\/enabled
\npcsd: active\/enabled
\n<\/p>\n\n\n
[root@webserver01 ~]<\/p>\n\n\n\n
#
\nTo test ngnix webservice failover:\n<\/p>\n\n\n\n
First of we will create a webpages in both cluster nodes by below command:
\nIn webserver01:<\/p>\n\n\n\n
echo ‘<\/p>\n\n\n\n
‘ > \/usr\/share\/nginx\/html\/index.html
\necho ‘<\/p>\n\n\n\n
‘ > \/usr\/share\/nginx\/html\/index.html
\nNow open this web page with Floating IP address (192.168.1.30) which we had configured with Cluster resources in previous steps, you will see currently webpage is accessible from webserver01:\n<\/p>\n\n\n\n
Now stop the cluster service in webserver01 and after it again open the webpage with same floating IP address. Below is the command for Stopping pacemaker cluster in webserver01:<\/p>\n\n\n\n
pcs cluster stop webserver01
\nAfter stopping the pacemaker cluster in webserver01 this time webpage should be accessed from webserver02:<\/p>\n","protected":false},"excerpt":{"rendered":"\n
Pacemaker is an open source cluster manager software which provide high availability of resources or services in CentOS 7 or RHEL 7 Linux. It has feature of scalable and advanced HA Cluster Manager. This HA cluster manager distributed by ClusterLabs.<\/p>\n
Corosync is the core of Pacemaker Cluster Manager as it is responsible for generating […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[73],"tags":[],"_links":{"self":[{"href":"https:\/\/mohan.sg\/index.php?rest_route=\/wp\/v2\/posts\/7810"}],"collection":[{"href":"https:\/\/mohan.sg\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mohan.sg\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mohan.sg\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mohan.sg\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=7810"}],"version-history":[{"count":1,"href":"https:\/\/mohan.sg\/index.php?rest_route=\/wp\/v2\/posts\/7810\/revisions"}],"predecessor-version":[{"id":7811,"href":"https:\/\/mohan.sg\/index.php?rest_route=\/wp\/v2\/posts\/7810\/revisions\/7811"}],"wp:attachment":[{"href":"https:\/\/mohan.sg\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=7810"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mohan.sg\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=7810"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mohan.sg\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=7810"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}