<html>
<head>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 10pt;
font-family:Tahoma
}
--></style></head>
<body class='hmmessage'><div dir='ltr'>
Hi Friends,<BR>
<BR>
I am having DRBD and Heartbeat setup for Production file server. I am having two servers in cluster with following versions on RHEL 5.8.<BR>
<BR>
[vpatel@Pd02 ~]$ rpm -qa | grep drbd<BR>drbd82-8.2.6-1.el5.centos<BR>kmod-drbd82-8.2.6-2<BR>[vpatel@Pd02 ~]$ rpm -qa | grep heartbeat<BR>heartbeat-gui-2.1.4-11.el5<BR>heartbeat-pils-2.1.4-11.el5<BR>heartbeat-2.1.4-11.el5<BR>heartbeat-ldirectord-2.1.4-11.el5<BR>heartbeat-stonith-2.1.4-11.el5<BR>heartbeat-devel-2.1.4-11.el5<BR><BR>
<BR>
Till now every thing was working fine. Today we had some outage and one of the drbd server was shutdown abruptly. Once server came up both servers became out of sync. On secondary server i found message of split brain detected in logs. <BR>
<BR>
In order to sync two servers when i am running 'connect' command, sync is getting started but gets stalled after few seconds. Below is the output of the commands i tried.<BR>
<BR>
DRBD Secondary Server :<BR>
<BR>
[root@Pd02 ~]# drbdadm disconnect all<BR>[root@Pd02 ~]# drbdadm -- --discard-my-data connect all<BR>[root@Pd02 ~]# cat /proc/drbd<BR>version: 8.2.6 (api:88/proto:86-88)<BR>GIT-hash: 3e69822d3bb4920a8c1bfdf7d647169eba7d2eb4 build by <A href="mailto:buildsvn@c5-x8664-build">buildsvn@c5-x8664-build</A>, 2008-10-03 11:30:17<BR> 0: cs:SyncTarget st:Secondary/Primary ds:Inconsistent/UpToDate B r---<BR> ns:0 nr:0 dw:8041264 dr:929 al:46 bm:102 lo:0 pe:0 ua:0 ap:0 oos:1260216<BR> [>....................] sync'ed: 0.4% (1260216/1260216)K<BR> finish: 1:45:01 speed: 0 (0) K/sec<BR>[root@Pd02 ~]# cat /proc/drbd<BR>version: 8.2.6 (api:88/proto:86-88)<BR>GIT-hash: 3e69822d3bb4920a8c1bfdf7d647169eba7d2eb4 build by <A href="mailto:buildsvn@c5-x8664-build">buildsvn@c5-x8664-build</A>, 2008-10-03 11:30:17<BR> 0: cs:SyncTarget st:Secondary/Primary ds:Inconsistent/UpToDate B r---<BR> ns:0 nr:0 dw:8041264 dr:929 al:46 bm:102 lo:0 pe:0 ua:0 ap:0 oos:1260216<BR> [>....................] sync'ed: 0.4% (1260216/1260216)K<BR> finish: 4:22:32 speed: 0 (0) K/sec<BR>[root@Pd02 ~]# cat /proc/drbd<BR>version: 8.2.6 (api:88/proto:86-88)<BR>GIT-hash: 3e69822d3bb4920a8c1bfdf7d647169eba7d2eb4 build by <A href="mailto:buildsvn@c5-x8664-build">buildsvn@c5-x8664-build</A>, 2008-10-03 11:30:17<BR> 0: cs:SyncTarget st:Secondary/Primary ds:Inconsistent/UpToDate B r---<BR> ns:0 nr:0 dw:8041264 dr:929 al:46 bm:102 lo:0 pe:0 ua:0 ap:0 oos:1260216<BR> [>....................] sync'ed: 0.4% (1260216/1260216)K<BR> finish: 8:45:05 speed: 0 (0) K/sec<BR>[root@Pd02 ~]# cat /proc/drbd<BR>version: 8.2.6 (api:88/proto:86-88)<BR>GIT-hash: 3e69822d3bb4920a8c1bfdf7d647169eba7d2eb4 build by <A href="mailto:buildsvn@c5-x8664-build">buildsvn@c5-x8664-build</A>, 2008-10-03 11:30:17<BR> 0: cs:SyncTarget st:Secondary/Primary ds:Inconsistent/UpToDate B r---<BR> ns:0 nr:412 dw:8020164 dr:929 al:46 bm:102 lo:0 pe:0 ua:0 ap:0 oos:1260216<BR> [>....................] sync'ed: 0.4% (1260216/1260216)K<BR> finish: 17:30:10 speed: 0 (0) K/sec<BR>[root@Pd02 ~]# cat /proc/drbd<BR>version: 8.2.6 (api:88/proto:86-88)<BR>GIT-hash: 3e69822d3bb4920a8c1bfdf7d647169eba7d2eb4 build by <A href="mailto:buildsvn@c5-x8664-build">buildsvn@c5-x8664-build</A>, 2008-10-03 11:30:17<BR> 0: cs:SyncTarget st:Secondary/Primary ds:Inconsistent/UpToDate B r---<BR> ns:0 nr:412 dw:8020164 dr:929 al:46 bm:102 lo:0 pe:0 ua:0 ap:0 oos:1260216<BR> [>....................] sync'ed: 0.4% (1260216/1260216)K<BR> stalled<BR><BR>
I tried to force sync via invalidate command but got following message.<BR>
<BR>
[root@Pd02 ~]# drbdadm invalidate all<BR>Device '/dev/drbd0' is configured!<BR>Command 'drbdmeta /dev/drbd0 v08 /dev/sdb2 0 invalidate' terminated with exit code 20<BR>command exited with code 20<BR><BR>
<BR>
Can anyone tell me how can i sync my drbd servers?<BR>
<BR>
Regards,<BR>
Vijay<BR> </div></body>
</html>