[DRBD-user] Dual Primary dead with 8.4.2

Henning Ryll henning at die-rylls.de
Fri Nov 16 17:01:34 CET 2012

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


Hello,

I have tried to make a dual primary setup, but can't get it work.
I'm using two Celisus 550 Workstations with two sata drives on each machine 
building a softraid 0.
There are dedicated 1GBit network cards for use with drbd directly connected 
with a cross connect calbe.

Creating a drbd device on top of /dev/md3 (on top of /dev/sda3 /dev/sdb3) 
works without problems. The initial sync reports no problems.

It is possible to make one machine primary and the other secondary and vice 
versa. Everything works so far.

But when trying to get both machines primary the system is respondig very slow 
or is not respondig anymore.

In /var/log/messages I found a message which looks like a timing problem. 
"PingAck did not arrive in time"

Then I tried drbd version 8.4.1 and all problems are gone.
Then I tried 8.4.2rc3. Even no problems. Dual primary is working as expected.
Then 8.4.2 again. Only single primay works.
Then I reverted to 8.4.2rc3 and everything is fine again.

So I gess that there is a bug created with 8.4.2 final :(

Here are some logs starting after reboot and console output of things I have 
done until the machine stops. 

Hope someone can find why 8.4.2 stops working ...

Henning



content of /etc/drbd/drbd-sr1.res:
resource drbd-sr1 {
   volume 0 {
      device /dev/drbd0;
      disk /dev/md3;
      meta-disk internal;
   }
   on XS-211 {
      address 10.1.1.211:7788;
      }
   on XS-212 {
      address 10.1.1.212:7788;
   }
}


contend of /etc/drbd/global_common.conf
global {
	usage-count yes;
}

common {
	syncer {
		rate 33M;
	}

	handlers {
		split-brain "/usr/lib/drbd/notify-split-brain.sh root";
	}

	startup {
		become-primary-on both;
	}

	disk {
		#disk-barrier no; #USV
		#disk-flushes no; #USV
	}

	protocol C;
	net {
		sndbuf-size 0;
		allow-two-primaries yes;
		ping-timeout 100;
		shared-secret "85ht9hHruiH";
		after-sb-0pri discard-zero-changes;
		after-sb-1pri consensus;
		after-sb-2pri disconnect;
	}
}




[root at XS-211 ~]# cat /var/log/messages | grep drbd
Nov 11 17:03:00 XS-211 kernel: [   32.209940] events: mcg drbd: 5
Nov 11 17:03:00 XS-211 kernel: [   32.212162] drbd: initialized. Version: 
8.4.2 (api:1/proto:86-101)
Nov 11 17:03:00 XS-211 kernel: [   32.212165] drbd: GIT-hash: 
7ad5f850d711223713d6dcadc3dd48860321070c build by root at localhost.localdomain, 
2012-10-29 13:22:58
Nov 11 17:03:00 XS-211 kernel: [   32.212167] drbd: registered as block device 
major 147
Nov 11 17:03:00 XS-211 kernel: [   32.336528] d-con drbd-sr1: Starting worker 
thread (from drbdsetup [6984])
Nov 11 17:03:00 XS-211 kernel: [   32.336676] block drbd0: disk( Diskless -> 
Attaching ) 
Nov 11 17:03:00 XS-211 kernel: [   32.337015] d-con drbd-sr1: Method to ensure 
write ordering: flush
Nov 11 17:03:00 XS-211 kernel: [   32.337019] block drbd0: max BIO size = 
65536
Nov 11 17:03:00 XS-211 kernel: [   32.337025] block drbd0: drbd_bm_resize 
called with capacity == 1677670072
Nov 11 17:03:00 XS-211 kernel: [   32.347804] block drbd0: resync bitmap: 
bits=209708759 words=6553400 pages=6400
Nov 11 17:03:00 XS-211 kernel: [   32.347819] block drbd0: size = 800 GB 
(838835036 KB)
Nov 11 17:03:01 XS-211 kernel: [   32.466241] block drbd0: bitmap READ of 6400 
pages took 12 jiffies
Nov 11 17:03:01 XS-211 kernel: [   32.502238] block drbd0: recounting of set 
bits took additional 3 jiffies
Nov 11 17:03:01 XS-211 kernel: [   32.502243] block drbd0: 0 KB (0 bits) 
marked out-of-sync by on disk bit-map.
Nov 11 17:03:01 XS-211 kernel: [   32.502253] block drbd0: disk( Attaching -> 
UpToDate ) 
Nov 11 17:03:01 XS-211 kernel: [   32.502257] block drbd0: attached to UUIDs 
FAED0840B50DDA5E:0000000000000000:E91787DC09996421:E91687DC09996421
Nov 11 17:03:01 XS-211 kernel: [   32.502287] block drbd0: Barriers not 
supported on meta data device - disabling
Nov 11 17:03:01 XS-211 kernel: [   32.504162] d-con drbd-sr1: conn( StandAlone 
-> Unconnected ) 
Nov 11 17:03:01 XS-211 kernel: [   32.504181] d-con drbd-sr1: Starting 
receiver thread (from drbd_w_drbd-sr1 [6985])
Nov 11 17:03:01 XS-211 kernel: [   32.504266] d-con drbd-sr1: receiver 
(re)started
Nov 11 17:03:01 XS-211 kernel: [   32.504284] d-con drbd-sr1: conn( 
Unconnected -> WFConnection ) 
Nov 11 17:03:01 XS-211 kernel: [   32.514238] block drbd0: role( Secondary -> 
Primary ) 
Nov 11 17:03:01 XS-211 kernel: [   32.514573] block drbd0: new current UUID 
0B230DF7BDF229AF:FAED0840B50DDA5E:E91787DC09996421:E91687DC09996421
Nov 11 17:06:39 XS-211 kernel: [  251.196646] d-con drbd-sr1: Handshake 
successful: Agreed network protocol version 101
Nov 11 17:06:39 XS-211 kernel: [  251.196691] d-con drbd-sr1: conn( 
WFConnection -> WFReportParams ) 
Nov 11 17:06:39 XS-211 kernel: [  251.196695] d-con drbd-sr1: Starting asender 
thread (from drbd_r_drbd-sr1 [6993])
Nov 11 17:06:39 XS-211 kernel: [  251.284292] d-con drbd-sr1: meta connection 
shut down by peer.
Nov 11 17:06:39 XS-211 kernel: [  251.284317] d-con drbd-sr1: conn( 
WFReportParams -> NetworkFailure ) 
Nov 11 17:06:39 XS-211 kernel: [  251.284320] d-con drbd-sr1: asender 
terminated
Nov 11 17:06:39 XS-211 kernel: [  251.284323] d-con drbd-sr1: Terminating 
asender thread
Nov 11 17:06:39 XS-211 kernel: [  251.286548] d-con drbd-sr1: Connection 
closed
Nov 11 17:06:39 XS-211 kernel: [  251.286633] d-con drbd-sr1: conn( 
NetworkFailure -> Unconnected ) 
Nov 11 17:06:39 XS-211 kernel: [  251.286636] d-con drbd-sr1: receiver 
terminated
Nov 11 17:06:39 XS-211 kernel: [  251.286638] d-con drbd-sr1: Restarting 
receiver thread
Nov 11 17:06:39 XS-211 kernel: [  251.286640] d-con drbd-sr1: receiver 
(re)started
Nov 11 17:06:39 XS-211 kernel: [  251.286647] d-con drbd-sr1: conn( 
Unconnected -> WFConnection ) 


[root at XS-212 ~]# cat /var/log/messages | grep drbd
Nov 11 17:06:38 XS-212 kernel: [   32.463248] events: mcg drbd: 5
Nov 11 17:06:38 XS-212 kernel: [   32.465610] drbd: initialized. Version: 
8.4.2 (api:1/proto:86-101)
Nov 11 17:06:38 XS-212 kernel: [   32.465613] drbd: GIT-hash: 
7ad5f850d711223713d6dcadc3dd48860321070c build by root at localhost.localdomain, 
2012-10-29 13:22:58
Nov 11 17:06:38 XS-212 kernel: [   32.465615] drbd: registered as block device 
major 147
Nov 11 17:06:39 XS-212 kernel: [   32.576723] d-con drbd-sr1: Starting worker 
thread (from drbdsetup [7000])
Nov 11 17:06:39 XS-212 kernel: [   32.576844] block drbd0: disk( Diskless -> 
Attaching ) 
Nov 11 17:06:39 XS-212 kernel: [   32.577189] d-con drbd-sr1: Method to ensure 
write ordering: flush
Nov 11 17:06:39 XS-212 kernel: [   32.577192] block drbd0: max BIO size = 
65536
Nov 11 17:06:39 XS-212 kernel: [   32.577198] block drbd0: drbd_bm_resize 
called with capacity == 1677670072
Nov 11 17:06:39 XS-212 kernel: [   32.586947] block drbd0: resync bitmap: 
bits=209708759 words=6553400 pages=6400
Nov 11 17:06:39 XS-212 kernel: [   32.586965] block drbd0: size = 800 GB 
(838835036 KB)
Nov 11 17:06:39 XS-212 kernel: [   32.707802] block drbd0: bitmap READ of 6400 
pages took 12 jiffies
Nov 11 17:06:39 XS-212 kernel: [   32.747658] block drbd0: recounting of set 
bits took additional 4 jiffies
Nov 11 17:06:39 XS-212 kernel: [   32.747663] block drbd0: 0 KB (0 bits) 
marked out-of-sync by on disk bit-map.
Nov 11 17:06:39 XS-212 kernel: [   32.747674] block drbd0: disk( Attaching -> 
UpToDate ) 
Nov 11 17:06:39 XS-212 kernel: [   32.747677] block drbd0: attached to UUIDs 
FAED0840B50DDA5E:0000000000000000:E91787DC09996420:E91687DC09996421
Nov 11 17:06:39 XS-212 kernel: [   32.747710] block drbd0: Barriers not 
supported on meta data device - disabling
Nov 11 17:06:39 XS-212 kernel: [   32.749834] d-con drbd-sr1: conn( StandAlone 
-> Unconnected ) 
Nov 11 17:06:39 XS-212 kernel: [   32.749857] d-con drbd-sr1: Starting 
receiver thread (from drbd_w_drbd-sr1 [7001])
Nov 11 17:06:39 XS-212 kernel: [   32.749945] d-con drbd-sr1: receiver 
(re)started
Nov 11 17:06:39 XS-212 kernel: [   32.749966] d-con drbd-sr1: conn( 
Unconnected -> WFConnection ) 
Nov 11 17:06:39 XS-212 kernel: [   32.760219] block drbd0: role( Secondary -> 
Primary ) 
Nov 11 17:06:39 XS-212 kernel: [   32.760626] block drbd0: new current UUID 
EE531CBF563726C3:FAED0840B50DDA5E:E91787DC09996420:E91687DC09996421
Nov 11 17:06:39 XS-212 kernel: [   33.246194] d-con drbd-sr1: Handshake 
successful: Agreed network protocol version 101
Nov 11 17:06:39 XS-212 kernel: [   33.246272] d-con drbd-sr1: conn( 
WFConnection -> WFReportParams ) 
Nov 11 17:06:39 XS-212 kernel: [   33.246276] d-con drbd-sr1: Starting asender 
thread (from drbd_r_drbd-sr1 [7006])
Nov 11 17:06:39 XS-212 kernel: [   33.313875] block drbd0: 
drbd_sync_handshake:
Nov 11 17:06:39 XS-212 kernel: [   33.313890] block drbd0: self 
EE531CBF563726C3:FAED0840B50DDA5E:E91787DC09996420:E91687DC09996421 bits:0 
flags:0
Nov 11 17:06:39 XS-212 kernel: [   33.313895] block drbd0: peer 
0B230DF7BDF229AF:FAED0840B50DDA5E:E91787DC09996421:E91687DC09996421 bits:0 
flags:0
Nov 11 17:06:39 XS-212 kernel: [   33.313900] block drbd0: uuid_compare()=100 
by rule 90
Nov 11 17:06:39 XS-212 kernel: [   33.313905] block drbd0: helper command: 
/sbin/drbdadm initial-split-brain minor-0
Nov 11 17:06:39 XS-212 kernel: [   33.315465] block drbd0: helper command: 
/sbin/drbdadm initial-split-brain minor-0 exit code 0 (0x0)
Nov 11 17:06:39 XS-212 kernel: [   33.315477] block drbd0: Split-Brain 
detected but unresolved, dropping connection!
Nov 11 17:06:39 XS-212 kernel: [   33.315484] block drbd0: helper command: 
/sbin/drbdadm split-brain minor-0
Nov 11 17:06:39 XS-212 notify-split-brain.sh[7098]: invoked for drbd-sr1/0 
(drbd0)
Nov 11 17:06:39 XS-212 notify-split-brain.sh[7098]: /usr/lib/drbd/notify-
split-brain.sh: line 110: mail: command not found
Nov 11 17:06:39 XS-212 kernel: [   33.333392] block drbd0: helper command: 
/sbin/drbdadm split-brain minor-0 exit code 127 (0x7f00)
Nov 11 17:06:39 XS-212 kernel: [   33.333423] d-con drbd-sr1: conn( 
WFReportParams -> Disconnecting ) 
Nov 11 17:06:39 XS-212 kernel: [   33.333428] d-con drbd-sr1: error receiving 
ReportState, e: -5 l: 0!
Nov 11 17:06:39 XS-212 kernel: [   33.333442] d-con drbd-sr1: asender 
terminated
Nov 11 17:06:39 XS-212 kernel: [   33.333446] d-con drbd-sr1: Terminating 
asender thread
Nov 11 17:06:39 XS-212 kernel: [   33.333576] d-con drbd-sr1: Connection 
closed
Nov 11 17:06:39 XS-212 kernel: [   33.333641] d-con drbd-sr1: conn( 
Disconnecting -> StandAlone ) 
Nov 11 17:06:39 XS-212 kernel: [   33.333644] d-con drbd-sr1: receiver 
terminated
Nov 11 17:06:39 XS-212 kernel: [   33.333647] d-con drbd-sr1: Terminating 
receiver thread



[root at XS-211 ~]# drbd-overview 
  0:drbd-sr1/0  WFConnection Primary/Unknown UpToDate/DUnknown C r----- 


[root at XS-212 ~]# drbd-overview 
  0:drbd-sr1/0  StandAlone Primary/Unknown UpToDate/DUnknown r----- 


[root at XS-212 ~]# drbdadm secondary drbd-sr1
[root at XS-212 ~]# drbd-overview 
  0:drbd-sr1/0  StandAlone Secondary/Unknown UpToDate/DUnknown r----- 


[root at XS-212 ~]# drbdadm -- --discard-my-data connect drbd-sr1
drbd-sr1: Failure: (102) Local address(port) already in use.
Command 'drbdsetup connect drbd-sr1 ipv4:10.1.1.212:7788 ipv4:10.1.1.211:7788 
--after-sb-2pri=disconnect --after-sb-1pri=consensus --after-sb-0pri=discard-
zero-changes --shared-secret=85ht9hHruiH --allow-two-primaries=yes --sndbuf-
size=0 --protocol=C --discard-my-data' terminated with exit code 10
[root at XS-212 ~]# drbd-overview 
  0:drbd-sr1/0  Connected Secondary/Primary UpToDate/UpToDate C r----- 


[root at XS-211 ~]# cat /var/log/messages | grep drbd
Nov 11 17:17:19 XS-211 kernel: [  891.313566] d-con drbd-sr1: Handshake 
successful: Agreed network protocol version 101
Nov 11 17:17:19 XS-211 kernel: [  891.313612] d-con drbd-sr1: conn( 
WFConnection -> WFReportParams ) 
Nov 11 17:17:19 XS-211 kernel: [  891.313616] d-con drbd-sr1: Starting asender 
thread (from drbd_r_drbd-sr1 [6993])
Nov 11 17:17:20 XS-211 kernel: [  891.483560] block drbd0: 
drbd_sync_handshake:
Nov 11 17:17:20 XS-211 kernel: [  891.483565] block drbd0: self 
0B230DF7BDF229AF:FAED0840B50DDA5E:E91787DC09996421:E91687DC09996421 bits:0 
flags:0
Nov 11 17:17:20 XS-211 kernel: [  891.483570] block drbd0: peer 
EE531CBF563726C2:FAED0840B50DDA5E:E91787DC09996420:E91687DC09996421 bits:0 
flags:1
Nov 11 17:17:20 XS-211 kernel: [  891.483575] block drbd0: uuid_compare()=100 
by rule 90
Nov 11 17:17:20 XS-211 kernel: [  891.483591] block drbd0: helper command: 
/sbin/drbdadm initial-split-brain minor-0
Nov 11 17:17:20 XS-211 kernel: [  891.485400] block drbd0: helper command: 
/sbin/drbdadm initial-split-brain minor-0 exit code 0 (0x0)
Nov 11 17:17:20 XS-211 kernel: [  891.485413] block drbd0: Split-Brain 
detected, 1 primaries, automatically solved. Sync from this node
Nov 11 17:17:20 XS-211 kernel: [  891.485419] block drbd0: peer( Unknown -> 
Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( DUnknown -> Consistent ) 
Nov 11 17:17:20 XS-211 kernel: [  891.496537] block drbd0: send bitmap stats 
[Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
Nov 11 17:17:20 XS-211 kernel: [  891.657337] block drbd0: receive bitmap 
stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
Nov 11 17:17:20 XS-211 kernel: [  891.657344] block drbd0: helper command: 
/sbin/drbdadm before-resync-source minor-0
Nov 11 17:17:20 XS-211 kernel: [  891.659185] block drbd0: helper command: 
/sbin/drbdadm before-resync-source minor-0 exit code 0 (0x0)
Nov 11 17:17:20 XS-211 kernel: [  891.659200] block drbd0: conn( WFBitMapS -> 
SyncSource ) pdsk( Consistent -> Inconsistent ) 
Nov 11 17:17:20 XS-211 kernel: [  891.659208] block drbd0: Began resync as 
SyncSource (will sync 0 KB [0 bits set]).
Nov 11 17:17:20 XS-211 kernel: [  891.659269] block drbd0: updated sync UUID 
0B230DF7BDF229AF:FAEE0840B50DDA5E:FAED0840B50DDA5E:E91787DC09996421
Nov 11 17:17:20 XS-211 kernel: [  891.676704] block drbd0: Resync done (total 
1 sec; paused 0 sec; 0 K/sec)
Nov 11 17:17:20 XS-211 kernel: [  891.676709] block drbd0: updated UUIDs 
0B230DF7BDF229AF:0000000000000000:FAEE0840B50DDA5E:FAED0840B50DDA5E
Nov 11 17:17:20 XS-211 kernel: [  891.676714] block drbd0: conn( SyncSource -> 
Connected ) pdsk( Inconsistent -> UpToDate ) 

[root at XS-212 ~]# cat /var/log/messages | grep drbd
Nov 11 17:17:03 XS-212 kernel: [  656.815632] block drbd0: role( Primary -> 
Secondary ) 
Nov 11 17:17:03 XS-212 kernel: [  656.815744] block drbd0: bitmap WRITE of 0 
pages took 0 jiffies
Nov 11 17:17:03 XS-212 kernel: [  656.815747] block drbd0: 0 KB (0 bits) 
marked out-of-sync by on disk bit-map.
Nov 11 17:17:19 XS-212 kernel: [  672.875771] d-con drbd-sr1: conn( StandAlone 
-> Unconnected ) 
Nov 11 17:17:19 XS-212 kernel: [  672.875799] d-con drbd-sr1: Starting 
receiver thread (from drbd_w_drbd-sr1 [7001])
Nov 11 17:17:19 XS-212 kernel: [  672.875871] d-con drbd-sr1: receiver 
(re)started
Nov 11 17:17:19 XS-212 kernel: [  672.875895] d-con drbd-sr1: conn( 
Unconnected -> WFConnection ) 
Nov 11 17:17:19 XS-212 kernel: [  673.374075] d-con drbd-sr1: Handshake 
successful: Agreed network protocol version 101
Nov 11 17:17:19 XS-212 kernel: [  673.374130] d-con drbd-sr1: conn( 
WFConnection -> WFReportParams ) 
Nov 11 17:17:19 XS-212 kernel: [  673.374134] d-con drbd-sr1: Starting asender 
thread (from drbd_r_drbd-sr1 [9645])
Nov 11 17:17:20 XS-212 kernel: [  673.704473] block drbd0: 
drbd_sync_handshake:
Nov 11 17:17:20 XS-212 kernel: [  673.704478] block drbd0: self 
EE531CBF563726C2:FAED0840B50DDA5E:E91787DC09996420:E91687DC09996421 bits:0 
flags:0
Nov 11 17:17:20 XS-212 kernel: [  673.704482] block drbd0: peer 
0B230DF7BDF229AF:FAED0840B50DDA5E:E91787DC09996421:E91687DC09996421 bits:0 
flags:0
Nov 11 17:17:20 XS-212 kernel: [  673.704487] block drbd0: uuid_compare()=100 
by rule 90
Nov 11 17:17:20 XS-212 kernel: [  673.704493] block drbd0: helper command: 
/sbin/drbdadm initial-split-brain minor-0
Nov 11 17:17:20 XS-212 kernel: [  673.706113] block drbd0: helper command: 
/sbin/drbdadm initial-split-brain minor-0 exit code 0 (0x0)
Nov 11 17:17:20 XS-212 kernel: [  673.706125] block drbd0: Split-Brain 
detected, 1 primaries, automatically solved. Sync from peer node
Nov 11 17:17:20 XS-212 kernel: [  673.706132] block drbd0: peer( Unknown -> 
Primary ) conn( WFReportParams -> WFBitMapT ) disk( UpToDate -> Outdated ) 
pdsk( DUnknown -> UpToDate ) 
Nov 11 17:17:20 XS-212 kernel: [  673.706431] block drbd0: receive bitmap 
stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
Nov 11 17:17:20 XS-212 kernel: [  673.717558] block drbd0: send bitmap stats 
[Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%
Nov 11 17:17:20 XS-212 kernel: [  673.717570] block drbd0: conn( WFBitMapT -> 
WFSyncUUID ) 
Nov 11 17:17:20 XS-212 kernel: [  673.720121] block drbd0: updated sync uuid 
FAEE0840B50DDA5E:0000000000000000:E91787DC09996420:E91687DC09996421
Nov 11 17:17:20 XS-212 kernel: [  673.720408] block drbd0: helper command: 
/sbin/drbdadm before-resync-target minor-0
Nov 11 17:17:20 XS-212 kernel: [  673.721889] block drbd0: helper command: 
/sbin/drbdadm before-resync-target minor-0 exit code 0 (0x0)
Nov 11 17:17:20 XS-212 kernel: [  673.721903] block drbd0: conn( WFSyncUUID -> 
SyncTarget ) disk( Outdated -> Inconsistent ) 
Nov 11 17:17:20 XS-212 kernel: [  673.721915] block drbd0: Began resync as 
SyncTarget (will sync 0 KB [0 bits set]).
Nov 11 17:17:20 XS-212 kernel: [  673.734978] block drbd0: Resync done (total 
1 sec; paused 0 sec; 0 K/sec)
Nov 11 17:17:20 XS-212 kernel: [  673.734986] block drbd0: updated UUIDs 
0B230DF7BDF229AE:0000000000000000:FAEE0840B50DDA5E:FAED0840B50DDA5E
Nov 11 17:17:20 XS-212 kernel: [  673.734994] block drbd0: conn( SyncTarget -> 
Connected ) disk( Inconsistent -> UpToDate ) 
Nov 11 17:17:20 XS-212 kernel: [  673.735264] block drbd0: helper command: 
/sbin/drbdadm after-resync-target minor-0
Nov 11 17:17:20 XS-212 kernel: [  673.736639] block drbd0: helper command: 
/sbin/drbdadm after-resync-target minor-0 exit code 0 (0x0)



[root at XS-212 ~]# drbdadm primary drbd-sr1
[root at XS-212 ~]# drbd-overview 
  0:drbd-sr1/0  StandAlone Primary/Unknown UpToDate/DUnknown r----- 
[root at XS-212 ~]# cat /var/log/messages | grep drbd
Nov 11 17:26:00 XS-212 kernel: [ 1193.804220] d-con drbd-sr1: PingAck did not 
arrive in time.
Nov 11 17:26:00 XS-212 kernel: [ 1193.804254] d-con drbd-sr1: peer( Primary -> 
Unknown ) conn( Connected -> NetworkFailure ) pdsk( UpToDate -> DUnknown ) 
Nov 11 17:26:00 XS-212 kernel: [ 1193.804333] block drbd0: role( Secondary -> 
Primary ) 
Nov 11 17:26:00 XS-212 kernel: [ 1193.804804] d-con drbd-sr1: asender 
terminated
Nov 11 17:26:00 XS-212 kernel: [ 1193.804808] d-con drbd-sr1: Terminating 
asender thread
Nov 11 17:26:00 XS-212 kernel: [ 1193.805411] d-con drbd-sr1: Connection 
closed
Nov 11 17:26:00 XS-212 kernel: [ 1193.805443] block drbd0: new current UUID 
7A82AC13D6E2A441:0B230DF7BDF229AE:FAEE0840B50DDA5E:FAED0840B50DDA5E
Nov 11 17:26:00 XS-212 kernel: [ 1193.805489] d-con drbd-sr1: conn( 
NetworkFailure -> Unconnected ) 
Nov 11 17:26:00 XS-212 kernel: [ 1193.805493] d-con drbd-sr1: receiver 
terminated
Nov 11 17:26:00 XS-212 kernel: [ 1193.805496] d-con drbd-sr1: Restarting 
receiver thread
Nov 11 17:26:00 XS-212 kernel: [ 1193.805498] d-con drbd-sr1: receiver 
(re)started
Nov 11 17:26:00 XS-212 kernel: [ 1193.805504] d-con drbd-sr1: conn( 
Unconnected -> WFConnection ) 
Nov 11 17:26:00 XS-212 kernel: [ 1194.304287] d-con drbd-sr1: Handshake 
successful: Agreed network protocol version 101
Nov 11 17:26:00 XS-212 kernel: [ 1194.304341] d-con drbd-sr1: conn( 
WFConnection -> WFReportParams ) 
Nov 11 17:26:00 XS-212 kernel: [ 1194.304345] d-con drbd-sr1: Starting asender 
thread (from drbd_r_drbd-sr1 [9645])
Nov 11 17:26:01 XS-212 notify-split-brain.sh[9990]: invoked for drbd-sr1/0 
(drbd0)
Nov 11 17:26:01 XS-212 kernel: [ 1194.484292] block drbd0: 
drbd_sync_handshake:
Nov 11 17:26:01 XS-212 kernel: [ 1194.484297] block drbd0: self 
7A82AC13D6E2A441:0B230DF7BDF229AE:FAEE0840B50DDA5E:FAED0840B50DDA5E bits:0 
flags:0
Nov 11 17:26:01 XS-212 kernel: [ 1194.484302] block drbd0: peer 
3718448BC15DB8CD:0B230DF7BDF229AF:FAEE0840B50DDA5E:FAED0840B50DDA5E bits:0 
flags:0
Nov 11 17:26:01 XS-212 kernel: [ 1194.484307] block drbd0: uuid_compare()=100 
by rule 90
Nov 11 17:26:01 XS-212 kernel: [ 1194.484312] block drbd0: helper command: 
/sbin/drbdadm initial-split-brain minor-0
Nov 11 17:26:01 XS-212 kernel: [ 1194.485791] block drbd0: helper command: 
/sbin/drbdadm initial-split-brain minor-0 exit code 0 (0x0)
Nov 11 17:26:01 XS-212 kernel: [ 1194.485802] block drbd0: Split-Brain 
detected but unresolved, dropping connection!
Nov 11 17:26:01 XS-212 kernel: [ 1194.485811] block drbd0: helper command: 
/sbin/drbdadm split-brain minor-0
Nov 11 17:26:01 XS-212 notify-split-brain.sh[9990]: /usr/lib/drbd/notify-
split-brain.sh: line 110: mail: command not found
Nov 11 17:26:01 XS-212 kernel: [ 1194.496559] block drbd0: helper command: 
/sbin/drbdadm split-brain minor-0 exit code 127 (0x7f00)
Nov 11 17:26:01 XS-212 kernel: [ 1194.496585] d-con drbd-sr1: conn( 
WFReportParams -> Disconnecting ) 
Nov 11 17:26:01 XS-212 kernel: [ 1194.496589] d-con drbd-sr1: error receiving 
ReportState, e: -5 l: 0!
Nov 11 17:26:01 XS-212 kernel: [ 1194.496611] d-con drbd-sr1: asender 
terminated
Nov 11 17:26:01 XS-212 kernel: [ 1194.496615] d-con drbd-sr1: Terminating 
asender thread
Nov 11 17:26:01 XS-212 kernel: [ 1194.496742] d-con drbd-sr1: Connection 
closed
Nov 11 17:26:01 XS-212 kernel: [ 1194.496820] d-con drbd-sr1: conn( 
Disconnecting -> StandAlone ) 
Nov 11 17:26:01 XS-212 kernel: [ 1194.496823] d-con drbd-sr1: receiver 
terminated
Nov 11 17:26:01 XS-212 kernel: [ 1194.496825] d-con drbd-sr1: Terminating 
receiver thread



More information about the drbd-user mailing list