[DRBD-user] 0.7.2 Split-Brain, unrecoverable ?

Alex Ongena Alex.Ongena at able.be
Wed Aug 18 09:39:16 CEST 2004

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


Thanks already for looking. In the mean time I had restored
the master <-> slave relation by destroying the meta device
(dd if=/dev/zero of=/dev/lv/drbd-meta) on the slave site.
Afterwards the resync started

> kernel version?
2.4.24

> drbd svn revision?
SVN Revision: 1483:1485 build by ao at build, 2004-08-09 14:00:52

> ouput of
> lsmod | grep drbd;
drbd                  128548   3

>  cat /proc/drbd;
version: 0.7.2 (api:75/proto:74)
SVN Revision: 1483:1485 build by ao at build, 2004-08-09 14:00:52
 0: cs:Standalone st:Primary/Unknown ld:Consistent
    ns:0 nr:243356 dw:243356 dr:0 al:0 bm:109 lo:0 pe:0 ua:0 ap:0
 1: cs:Unconfigured

>  drbdsetup /dev/drbd0 show
Lower device: 58:02   (lvm(58,2))
Meta device: 58:03   (lvm(58,3))
Meta index: 0
Disk options:

# drbdsetup /dev/drbd0 state
Primary/Unknown

> on both nodes?
(sorry, I have it only from the master, but look in the logs below)

> part of the log when they have been up and running for the last time?
> part of the log during the event that lead to connection loss
> at that time?

I did a "grep drbd syslog" on both systems, they are included in-line
and as attachement, so it's easier to look up and to compare them.
Both systems are 'ntp-ed', so timestamps should match.

Be aware that I'am in testing phase, so I intentionaly rebooted several
times either the master, or the slave.

Look at 13:42:02 ...

Thanks already
alex

master:
09:41:52 kernel drbd0: drbd0_receiver [743]: cstate WFConnection -->
WFReportParams
09:41:52 kernel drbd0: Handshake successful: DRBD Network Protocol
version 74
09:41:52 kernel drbd0: Connection established.
09:41:52 kernel drbd0: I am(P): 1:00000002:00000001:00000004:00000001:10
09:41:52 kernel drbd0: Peer(S): 0:00000002:00000001:00000003:00000001:01
09:41:52 kernel drbd0: drbd0_receiver [743]: cstate WFReportParams -->
WFBitMapS
09:41:52 kernel drbd0: Primary/Unknown --> Primary/Secondary
09:41:52 kernel drbd0: drbd0_receiver [743]: cstate WFBitMapS -->
SyncSource
09:41:52 kernel drbd0: Resync started as SyncSource (need to sync 400 KB
[100 bits set]).
09:41:52 kernel drbd: sendpage() omitted: 134/1562246 [XFS' broken IO
requests?]
09:41:53 kernel drbd0: Resync done (total 1 sec; paused 0 sec; 400
K/sec)
09:41:53 kernel drbd0: drbd0_worker [25826]: cstate SyncSource -->
Connected
10:07:45 kernel drbd0: meta connection shut down by peer.
10:07:45 kernel drbd0: drbd0_asender [25846]: cstate Connected -->
NetworkFailure
10:07:45 kernel drbd0: asender terminated
10:07:45 kernel drbd0: drbd0_receiver [743]: cstate NetworkFailure -->
BrokenPipe
10:07:45 kernel drbd0: short read expecting header on sock: r=-512
10:07:45 kernel drbd0: worker terminated
10:07:45 kernel drbd0: drbd0_receiver [743]: cstate BrokenPipe -->
Unconnected
10:07:45 kernel drbd0: Connection lost.
10:07:45 kernel drbd0: drbd0_receiver [743]: cstate Unconnected -->
WFConnection
12:41:43 kernel drbd0: drbd0_receiver [743]: cstate WFConnection -->
WFReportParams
12:41:43 kernel drbd0: Handshake successful: DRBD Network Protocol
version 74
12:41:43 kernel drbd0: Connection established.
12:41:43 kernel drbd0: I am(P): 1:00000002:00000001:00000005:00000001:10
12:41:43 kernel drbd0: Peer(S): 1:00000002:00000001:00000004:00000001:01
12:41:43 kernel drbd0: drbd0_receiver [743]: cstate WFReportParams -->
WFBitMapS
12:41:43 kernel drbd0: Primary/Unknown --> Primary/Secondary
12:41:43 kernel drbd0: drbd0_receiver [743]: cstate WFBitMapS -->
SyncSource
12:41:43 kernel drbd0: Resync started as SyncSource (need to sync 10012
KB [2503 bits set]).
12:41:43 kernel drbd: sendpage() omitted: 135/1563056 [XFS' broken IO
requests?]
12:42:05 kernel drbd0: Resync done (total 21 sec; paused 0 sec; 476
K/sec)
12:42:05 kernel drbd0: drbd0_worker [27508]: cstate SyncSource -->
Connected
13:42:02 kernel drbd: sendpage() omitted: 135/1567097 [XFS' broken IO
requests?]
14:35:33 kernel drbd0: drbd0_receiver [759]: cstate WFConnection -->
WFReportParams
14:35:33 kernel drbd0: Handshake successful: DRBD Network Protocol
version 74
14:35:33 kernel drbd0: Connection established.
14:35:33 kernel drbd0: I am(P): 1:00000002:00000001:00000005:00000002:10
14:35:33 kernel drbd0: Peer(S): 1:00000002:00000001:00000006:00000001:10
14:35:33 kernel drbd0: Current Primary shall become sync TARGET!
Aborting to prevent data corruption.
14:35:33 kernel drbd0: drbd0_receiver [759]: cstate WFReportParams -->
StandAlone
14:35:33 kernel drbd0: error receiving ReportParams, l: 72!
14:35:33 kernel drbd0: asender terminated
14:35:33 kernel drbd0: worker terminated
14:35:33 kernel drbd0: drbd0_receiver [759]: cstate StandAlone -->
StandAlone
14:35:33 kernel drbd0: Connection lost.
14:35:33 kernel drbd0: receiver terminated
15:00:50 kernel drbd0: drbd0_receiver [747]: cstate WFConnection -->
WFReportParams
15:00:50 kernel drbd0: Handshake successful: DRBD Network Protocol
version 74
15:00:50 kernel drbd0: Connection established.
15:00:50 kernel drbd0: I am(P): 1:00000002:00000001:00000006:00000003:10
15:00:50 kernel drbd0: Peer(S): 1:00000002:00000001:00000006:00000002:10
15:00:50 kernel drbd0: drbd0_receiver [747]: cstate WFReportParams -->
WFBitMapS
15:00:51 kernel drbd0: Primary/Unknown --> Primary/Secondary
15:00:51 kernel drbd0: drbd0_receiver [747]: cstate WFBitMapS -->
SyncSource
15:00:51 kernel drbd0: Resync started as SyncSource (need to sync 241664
KB [60416 bits set]).
15:07:46 kernel drbd0: Resync done (total 414 sec; paused 0 sec; 580
K/sec)
15:07:46 kernel drbd0: drbd0_worker [734]: cstate SyncSource -->
Connected
15:50:03 kernel drbd0: drbd0_receiver [715]: cstate WFConnection -->
WFReportParams
15:50:03 kernel drbd0: Handshake successful: DRBD Network Protocol
version 74
15:50:03 kernel drbd0: Connection established.
15:50:03 kernel drbd0: I am(P): 1:00000002:00000001:00000006:00000004:10
15:50:03 kernel drbd0: Peer(S): 1:00000002:00000001:00000007:00000003:10
15:50:03 kernel drbd0: Current Primary shall become sync TARGET!
Aborting to prevent data corruption.
15:50:03 kernel drbd0: drbd0_receiver [715]: cstate WFReportParams -->
StandAlone
15:50:03 kernel drbd0: error receiving ReportParams, l: 72!
15:50:03 kernel drbd0: asender terminated
15:50:03 kernel drbd0: worker terminated
15:50:03 kernel drbd0: drbd0_receiver [715]: cstate StandAlone -->
StandAlone
15:50:03 kernel drbd0: Connection lost.
15:50:03 kernel drbd0: receiver terminated
16:11:33 kernel drbd0: drbd0_receiver [714]: cstate WFConnection -->
WFReportParams
16:11:33 kernel drbd0: Handshake successful: DRBD Network Protocol
version 74
16:11:33 kernel drbd0: Connection established.
16:11:33 kernel drbd0: Split-Brain detected, dropping connection!
16:11:33 kernel drbd0: drbd0_receiver [714]: cstate WFReportParams -->
StandAlone
16:11:33 kernel drbd0: error receiving ReportParams, l: 72!
16:11:33 kernel drbd0: asender terminated
16:11:33 kernel drbd0: worker terminated
16:11:33 kernel drbd0: drbd0_receiver [714]: cstate StandAlone -->
StandAlone
16:11:33 kernel drbd0: Connection lost.
16:11:33 kernel drbd0: receiver terminated



Slave:

09:41:51 kernel drbd: initialised. Version: 0.7.2 (api:75/proto:74)
09:41:51 kernel drbd: SVN Revision: 1483:1485 build by ao at build,
2004-08-09 14:00:52
09:41:51 kernel drbd: registered as block device major 147
09:41:52 kernel drbd0: resync bitmap: bits=1540096 words=48128
09:41:52 kernel drbd0: size = 6160384 KB
09:41:52 kernel drbd0: 0 KB marked out-of-sync by on disk bit-map.
09:41:52 kernel drbd0: Found 4 transactions (16 active extents) in
activity log.
09:41:52 kernel drbd0: drbdsetup [1070]: cstate Unconfigured -->
StandAlone
09:41:52 kernel drbd0: drbdsetup [1083]: cstate StandAlone -->
Unconnected
09:41:52 kernel drbd0: drbd0_receiver [1084]: cstate Unconnected -->
WFConnection
09:41:52 kernel drbd0: drbd0_receiver [1084]: cstate WFConnection -->
WFReportParams
09:41:52 kernel drbd0: Handshake successful: DRBD Network Protocol
version 74
09:41:52 kernel drbd0: Connection established.
09:41:52 kernel drbd0: I am(S): 0:00000002:00000001:00000003:00000001:01
09:41:52 kernel drbd0: Peer(P): 1:00000002:00000001:00000004:00000001:10
09:41:52 kernel drbd0: drbd0_receiver [1084]: cstate WFReportParams -->
WFBitMapT
09:41:52 kernel drbd0: Secondary/Unknown --> Secondary/Primary
09:41:53 kernel drbd0: drbd0_receiver [1084]: cstate WFBitMapT -->
SyncTarget
09:41:53 kernel drbd0: Resync started as SyncTarget (need to sync 400 KB
[100 bits set]).
09:41:53 kernel drbd0: Resync done (total 1 sec; paused 0 sec; 400
K/sec)
09:41:53 kernel drbd0: drbd0_worker [1071]: cstate SyncTarget -->
Connected
12:41:42 kernel drbd: initialised. Version: 0.7.2 (api:75/proto:74)
12:41:42 kernel drbd: SVN Revision: 1483:1485 build by ao at build,
2004-08-09 14:00:52
12:41:42 kernel drbd: registered as block device major 147
12:41:43 kernel drbd0: resync bitmap: bits=1540096 words=48128
12:41:43 kernel drbd0: size = 6160384 KB
12:41:43 kernel drbd0: 0 KB marked out-of-sync by on disk bit-map.
12:41:43 kernel drbd0: Found 4 transactions (16 active extents) in
activity log.
12:41:43 kernel drbd0: drbdsetup [1087]: cstate Unconfigured -->
StandAlone
12:41:43 kernel drbd0: drbdsetup [1100]: cstate StandAlone -->
Unconnected
12:41:43 kernel drbd0: drbd0_receiver [1101]: cstate Unconnected -->
WFConnection
12:41:43 kernel drbd0: drbd0_receiver [1101]: cstate WFConnection -->
WFReportParams
12:41:43 kernel drbd0: Handshake successful: DRBD Network Protocol
version 74
12:41:43 kernel drbd0: Connection established.
12:41:43 kernel drbd0: I am(S): 1:00000002:00000001:00000004:00000001:01
12:41:43 kernel drbd0: Peer(P): 1:00000002:00000001:00000005:00000001:10
12:41:43 kernel drbd0: drbd0_receiver [1101]: cstate WFReportParams -->
WFBitMapT
12:41:43 kernel drbd0: Secondary/Unknown --> Secondary/Primary
12:41:44 kernel drbd0: drbd0_receiver [1101]: cstate WFBitMapT -->
SyncTarget
12:41:44 kernel drbd0: Resync started as SyncTarget (need to sync 10012
KB [2503 bits set]).
12:42:06 kernel drbd0: Resync done (total 21 sec; paused 0 sec; 476
K/sec)
12:42:06 kernel drbd0: drbd0_worker [1088]: cstate SyncTarget -->
Connected
14:23:22 kernel drbd: initialised. Version: 0.7.2 (api:75/proto:74)
14:23:22 kernel drbd: SVN Revision: 1483:1485 build by ao at build,
2004-08-09 14:00:52
14:23:22 kernel drbd: registered as block device major 147
14:23:22 kernel drbd0: resync bitmap: bits=1540096 words=48128
14:23:22 kernel drbd0: size = 6160384 KB
14:23:22 kernel drbd0: 0 KB marked out-of-sync by on disk bit-map.
14:23:22 kernel drbd0: Found 4 transactions (16 active extents) in
activity log.
14:23:22 kernel drbd0: drbdsetup [745]: cstate Unconfigured -->
StandAlone
14:23:22 kernel drbd0: drbdsetup [758]: cstate StandAlone -->
Unconnected
14:23:22 kernel drbd0: drbd0_receiver [759]: cstate Unconnected -->
WFConnection
14:23:28 kernel drbd0: Secondary/Unknown --> Primary/Unknown
14:23:29 kernel EXT3 FS 2.4-0.9.19, 19 August 2002 on drbd(147,0),
internal journal
14:49:05 kernel drbd: initialised. Version: 0.7.2 (api:75/proto:74)
14:49:05 kernel drbd: SVN Revision: 1483:1485 build by ao at build,
2004-08-09 14:00:52
14:49:05 kernel drbd: registered as block device major 147
14:49:05 kernel drbd0: resync bitmap: bits=1540096 words=48128
14:49:05 kernel drbd0: size = 6160384 KB
14:49:05 kernel drbd0: 0 KB marked out-of-sync by on disk bit-map.
14:49:05 kernel drbd0: Found 4 transactions (53 active extents) in
activity log.
14:49:05 kernel drbd0: Marked additional 26624 KB as out-of-sync based
on AL.
14:49:05 kernel drbd0: drbdsetup [733]: cstate Unconfigured -->
StandAlone
14:49:05 kernel drbd0: drbdsetup [746]: cstate StandAlone -->
Unconnected
14:49:05 kernel drbd0: drbd0_receiver [747]: cstate Unconnected -->
WFConnection
14:49:11 kernel drbd0: Secondary/Unknown --> Primary/Unknown
14:49:11 kernel EXT3 FS 2.4-0.9.19, 19 August 2002 on drbd(147,0),
internal journal
15:50:01 kernel drbd: initialised. Version: 0.7.2 (api:75/proto:74)
15:50:01 kernel drbd: SVN Revision: 1483:1485 build by ao at build,
2004-08-09 14:00:52
15:50:01 kernel drbd: registered as block device major 147
15:50:01 kernel drbd0: resync bitmap: bits=1540096 words=48128
15:50:01 kernel drbd0: size = 6160384 KB
15:50:03 kernel drbd0: 0 KB marked out-of-sync by on disk bit-map.
15:50:03 kernel drbd0: Found 4 transactions (53 active extents) in
activity log.
15:50:03 kernel drbd0: Marked additional 26624 KB as out-of-sync based
on AL.
15:50:03 kernel drbd0: drbdsetup [750]: cstate Unconfigured -->
StandAlone
15:50:03 kernel drbd0: drbdsetup [763]: cstate StandAlone -->
Unconnected
15:50:03 kernel drbd0: drbd0_receiver [764]: cstate Unconnected -->
WFConnection
15:50:03 kernel drbd0: drbd0_receiver [764]: cstate WFConnection -->
WFReportParams
15:50:03 kernel drbd0: Handshake successful: DRBD Network Protocol
version 74
15:50:03 kernel drbd0: Connection established.
15:50:03 kernel drbd0: I am(S): 1:00000002:00000001:00000007:00000003:10
15:50:03 kernel drbd0: Peer(P): 1:00000002:00000001:00000006:00000004:10
15:50:03 kernel drbd0: drbd0_receiver [764]: cstate WFReportParams -->
WFBitMapS
15:50:03 kernel drbd0: sock_sendmsg returned -104
15:50:03 kernel drbd0: drbd0_receiver [764]: cstate WFBitMapS -->
BrokenPipe
15:50:03 kernel drbd0: short sent ReportBitMap size=4096 sent=3056
15:50:03 kernel drbd0: Secondary/Unknown --> Secondary/Primary
15:50:03 kernel drbd0: meta connection shut down by peer.
15:50:03 kernel drbd0: asender terminated
15:50:03 kernel drbd0: sock was shut down by peer
15:50:03 kernel drbd0: drbd0_receiver [764]: cstate BrokenPipe -->
BrokenPipe
15:50:03 kernel drbd0: short read expecting header on sock: r=0
15:50:03 kernel drbd0: worker terminated
15:50:03 kernel drbd0: drbd0_receiver [764]: cstate BrokenPipe -->
Unconnected
15:50:03 kernel drbd0: Connection lost.
15:50:03 kernel drbd0: drbd0_receiver [764]: cstate Unconnected -->
WFConnection
15:50:09 kernel drbd0: Secondary/Unknown --> Primary/Unknown
15:50:09 kernel EXT3 FS 2.4-0.9.19, 19 August 2002 on drbd(147,0),
internal journal
15:56:47 kernel drbd: initialised. Version: 0.7.2 (api:75/proto:74)
15:56:47 kernel drbd: SVN Revision: 1483:1485 build by ao at build,
2004-08-09 14:00:52
15:56:47 kernel drbd: registered as block device major 147
15:56:47 kernel drbd0: resync bitmap: bits=1540096 words=48128
15:56:47 kernel drbd0: size = 6160384 KB
15:56:47 kernel drbd0: 212992 KB marked out-of-sync by on disk bit-map.
15:56:47 kernel drbd0: Found 4 transactions (53 active extents) in
activity log.
15:56:47 kernel drbd0: Marked additional 0 KB as out-of-sync based on
AL.
15:56:47 kernel drbd0: drbdsetup [732]: cstate Unconfigured -->
StandAlone
15:56:48 kernel drbd0: drbdsetup [745]: cstate StandAlone -->
Unconnected
15:56:48 kernel drbd0: drbd0_receiver [746]: cstate Unconnected -->
WFConnection
15:56:54 kernel drbd0: Secondary/Unknown --> Primary/Unknown
15:56:54 kernel EXT3 FS 2.4-0.9.19, 19 August 2002 on drbd(147,0),
internal journal
16:11:33 kernel drbd: initialised. Version: 0.7.2 (api:75/proto:74)
16:11:33 kernel drbd: SVN Revision: 1483:1485 build by ao at build,
2004-08-09 14:00:52
16:11:33 kernel drbd: registered as block device major 147
16:11:33 kernel drbd0: resync bitmap: bits=1540096 words=48128
16:11:33 kernel drbd0: size = 6160384 KB
16:11:33 kernel drbd0: 212992 KB marked out-of-sync by on disk bit-map.
16:11:33 kernel drbd0: Found 4 transactions (53 active extents) in
activity log.
16:11:33 kernel drbd0: Marked additional 0 KB as out-of-sync based on
AL.
16:11:33 kernel drbd0: drbdsetup [732]: cstate Unconfigured -->
StandAlone
16:11:33 kernel drbd0: drbdsetup [745]: cstate StandAlone -->
Unconnected
16:11:33 kernel drbd0: drbd0_receiver [746]: cstate Unconnected -->
WFConnection
16:11:33 kernel drbd0: drbd0_receiver [746]: cstate WFConnection -->
WFReportParams
16:11:33 kernel drbd0: Handshake successful: DRBD Network Protocol
version 74
16:11:33 kernel drbd0: Connection established.
16:11:33 kernel drbd0: Split-Brain detected, dropping connection!
16:11:33 kernel drbd0: drbd0_receiver [746]: cstate WFReportParams -->
StandAlone
16:11:33 kernel drbd0: error receiving ReportParams, l: 72!
16:11:33 kernel drbd0: asender terminated
16:11:33 kernel drbd0: worker terminated
16:11:33 kernel drbd0: drbd0_receiver [746]: cstate StandAlone -->
StandAlone
16:11:33 kernel drbd0: Connection lost.
16:11:33 kernel drbd0: receiver terminated
16:12:36 kernel drbd0: Secondary/Unknown --> Primary/Unknown





--
aXs GUARD has completed security and anti-virus checks on this e-mail
(http://www.axsguard.com)
-------------- next part --------------
09:41:52 kernel drbd0: drbd0_receiver [743]: cstate WFConnection --> WFReportParams
09:41:52 kernel drbd0: Handshake successful: DRBD Network Protocol version 74
09:41:52 kernel drbd0: Connection established.
09:41:52 kernel drbd0: I am(P): 1:00000002:00000001:00000004:00000001:10
09:41:52 kernel drbd0: Peer(S): 0:00000002:00000001:00000003:00000001:01
09:41:52 kernel drbd0: drbd0_receiver [743]: cstate WFReportParams --> WFBitMapS
09:41:52 kernel drbd0: Primary/Unknown --> Primary/Secondary
09:41:52 kernel drbd0: drbd0_receiver [743]: cstate WFBitMapS --> SyncSource
09:41:52 kernel drbd0: Resync started as SyncSource (need to sync 400 KB [100 bits set]).
09:41:52 kernel drbd: sendpage() omitted: 134/1562246 [XFS' broken IO requests?]
09:41:53 kernel drbd0: Resync done (total 1 sec; paused 0 sec; 400 K/sec)
09:41:53 kernel drbd0: drbd0_worker [25826]: cstate SyncSource --> Connected
10:07:45 kernel drbd0: meta connection shut down by peer.
10:07:45 kernel drbd0: drbd0_asender [25846]: cstate Connected --> NetworkFailure
10:07:45 kernel drbd0: asender terminated
10:07:45 kernel drbd0: drbd0_receiver [743]: cstate NetworkFailure --> BrokenPipe
10:07:45 kernel drbd0: short read expecting header on sock: r=-512
10:07:45 kernel drbd0: worker terminated
10:07:45 kernel drbd0: drbd0_receiver [743]: cstate BrokenPipe --> Unconnected
10:07:45 kernel drbd0: Connection lost.
10:07:45 kernel drbd0: drbd0_receiver [743]: cstate Unconnected --> WFConnection
12:41:43 kernel drbd0: drbd0_receiver [743]: cstate WFConnection --> WFReportParams
12:41:43 kernel drbd0: Handshake successful: DRBD Network Protocol version 74
12:41:43 kernel drbd0: Connection established.
12:41:43 kernel drbd0: I am(P): 1:00000002:00000001:00000005:00000001:10
12:41:43 kernel drbd0: Peer(S): 1:00000002:00000001:00000004:00000001:01
12:41:43 kernel drbd0: drbd0_receiver [743]: cstate WFReportParams --> WFBitMapS
12:41:43 kernel drbd0: Primary/Unknown --> Primary/Secondary
12:41:43 kernel drbd0: drbd0_receiver [743]: cstate WFBitMapS --> SyncSource
12:41:43 kernel drbd0: Resync started as SyncSource (need to sync 10012 KB [2503 bits set]).
12:41:43 kernel drbd: sendpage() omitted: 135/1563056 [XFS' broken IO requests?]
12:42:05 kernel drbd0: Resync done (total 21 sec; paused 0 sec; 476 K/sec)
12:42:05 kernel drbd0: drbd0_worker [27508]: cstate SyncSource --> Connected
13:42:02 kernel drbd: sendpage() omitted: 135/1567097 [XFS' broken IO requests?]
14:35:33 kernel drbd0: drbd0_receiver [759]: cstate WFConnection --> WFReportParams
14:35:33 kernel drbd0: Handshake successful: DRBD Network Protocol version 74
14:35:33 kernel drbd0: Connection established.
14:35:33 kernel drbd0: I am(P): 1:00000002:00000001:00000005:00000002:10
14:35:33 kernel drbd0: Peer(S): 1:00000002:00000001:00000006:00000001:10
14:35:33 kernel drbd0: Current Primary shall become sync TARGET! Aborting to prevent data corruption.
14:35:33 kernel drbd0: drbd0_receiver [759]: cstate WFReportParams --> StandAlone
14:35:33 kernel drbd0: error receiving ReportParams, l: 72!
14:35:33 kernel drbd0: asender terminated
14:35:33 kernel drbd0: worker terminated
14:35:33 kernel drbd0: drbd0_receiver [759]: cstate StandAlone --> StandAlone
14:35:33 kernel drbd0: Connection lost.
14:35:33 kernel drbd0: receiver terminated
15:00:50 kernel drbd0: drbd0_receiver [747]: cstate WFConnection --> WFReportParams
15:00:50 kernel drbd0: Handshake successful: DRBD Network Protocol version 74
15:00:50 kernel drbd0: Connection established.
15:00:50 kernel drbd0: I am(P): 1:00000002:00000001:00000006:00000003:10
15:00:50 kernel drbd0: Peer(S): 1:00000002:00000001:00000006:00000002:10
15:00:50 kernel drbd0: drbd0_receiver [747]: cstate WFReportParams --> WFBitMapS
15:00:51 kernel drbd0: Primary/Unknown --> Primary/Secondary
15:00:51 kernel drbd0: drbd0_receiver [747]: cstate WFBitMapS --> SyncSource
15:00:51 kernel drbd0: Resync started as SyncSource (need to sync 241664 KB [60416 bits set]).
15:07:46 kernel drbd0: Resync done (total 414 sec; paused 0 sec; 580 K/sec)
15:07:46 kernel drbd0: drbd0_worker [734]: cstate SyncSource --> Connected
15:50:03 kernel drbd0: drbd0_receiver [715]: cstate WFConnection --> WFReportParams
15:50:03 kernel drbd0: Handshake successful: DRBD Network Protocol version 74
15:50:03 kernel drbd0: Connection established.
15:50:03 kernel drbd0: I am(P): 1:00000002:00000001:00000006:00000004:10
15:50:03 kernel drbd0: Peer(S): 1:00000002:00000001:00000007:00000003:10
15:50:03 kernel drbd0: Current Primary shall become sync TARGET! Aborting to prevent data corruption.
15:50:03 kernel drbd0: drbd0_receiver [715]: cstate WFReportParams --> StandAlone
15:50:03 kernel drbd0: error receiving ReportParams, l: 72!
15:50:03 kernel drbd0: asender terminated
15:50:03 kernel drbd0: worker terminated
15:50:03 kernel drbd0: drbd0_receiver [715]: cstate StandAlone --> StandAlone
15:50:03 kernel drbd0: Connection lost.
15:50:03 kernel drbd0: receiver terminated
16:11:33 kernel drbd0: drbd0_receiver [714]: cstate WFConnection --> WFReportParams
16:11:33 kernel drbd0: Handshake successful: DRBD Network Protocol version 74
16:11:33 kernel drbd0: Connection established.
16:11:33 kernel drbd0: Split-Brain detected, dropping connection!
16:11:33 kernel drbd0: drbd0_receiver [714]: cstate WFReportParams --> StandAlone
16:11:33 kernel drbd0: error receiving ReportParams, l: 72!
16:11:33 kernel drbd0: asender terminated
16:11:33 kernel drbd0: worker terminated
16:11:33 kernel drbd0: drbd0_receiver [714]: cstate StandAlone --> StandAlone
16:11:33 kernel drbd0: Connection lost.
16:11:33 kernel drbd0: receiver terminated
-------------- next part --------------
09:41:51 kernel drbd: initialised. Version: 0.7.2 (api:75/proto:74)
09:41:51 kernel drbd: SVN Revision: 1483:1485 build by ao at build, 2004-08-09 14:00:52
09:41:51 kernel drbd: registered as block device major 147
09:41:52 kernel drbd0: resync bitmap: bits=1540096 words=48128
09:41:52 kernel drbd0: size = 6160384 KB
09:41:52 kernel drbd0: 0 KB marked out-of-sync by on disk bit-map.
09:41:52 kernel drbd0: Found 4 transactions (16 active extents) in activity log.
09:41:52 kernel drbd0: drbdsetup [1070]: cstate Unconfigured --> StandAlone
09:41:52 kernel drbd0: drbdsetup [1083]: cstate StandAlone --> Unconnected
09:41:52 kernel drbd0: drbd0_receiver [1084]: cstate Unconnected --> WFConnection
09:41:52 kernel drbd0: drbd0_receiver [1084]: cstate WFConnection --> WFReportParams
09:41:52 kernel drbd0: Handshake successful: DRBD Network Protocol version 74
09:41:52 kernel drbd0: Connection established.
09:41:52 kernel drbd0: I am(S): 0:00000002:00000001:00000003:00000001:01
09:41:52 kernel drbd0: Peer(P): 1:00000002:00000001:00000004:00000001:10
09:41:52 kernel drbd0: drbd0_receiver [1084]: cstate WFReportParams --> WFBitMapT
09:41:52 kernel drbd0: Secondary/Unknown --> Secondary/Primary
09:41:53 kernel drbd0: drbd0_receiver [1084]: cstate WFBitMapT --> SyncTarget
09:41:53 kernel drbd0: Resync started as SyncTarget (need to sync 400 KB [100 bits set]).
09:41:53 kernel drbd0: Resync done (total 1 sec; paused 0 sec; 400 K/sec)
09:41:53 kernel drbd0: drbd0_worker [1071]: cstate SyncTarget --> Connected
12:41:42 kernel drbd: initialised. Version: 0.7.2 (api:75/proto:74)
12:41:42 kernel drbd: SVN Revision: 1483:1485 build by ao at build, 2004-08-09 14:00:52
12:41:42 kernel drbd: registered as block device major 147
12:41:43 kernel drbd0: resync bitmap: bits=1540096 words=48128
12:41:43 kernel drbd0: size = 6160384 KB
12:41:43 kernel drbd0: 0 KB marked out-of-sync by on disk bit-map.
12:41:43 kernel drbd0: Found 4 transactions (16 active extents) in activity log.
12:41:43 kernel drbd0: drbdsetup [1087]: cstate Unconfigured --> StandAlone
12:41:43 kernel drbd0: drbdsetup [1100]: cstate StandAlone --> Unconnected
12:41:43 kernel drbd0: drbd0_receiver [1101]: cstate Unconnected --> WFConnection
12:41:43 kernel drbd0: drbd0_receiver [1101]: cstate WFConnection --> WFReportParams
12:41:43 kernel drbd0: Handshake successful: DRBD Network Protocol version 74
12:41:43 kernel drbd0: Connection established.
12:41:43 kernel drbd0: I am(S): 1:00000002:00000001:00000004:00000001:01
12:41:43 kernel drbd0: Peer(P): 1:00000002:00000001:00000005:00000001:10
12:41:43 kernel drbd0: drbd0_receiver [1101]: cstate WFReportParams --> WFBitMapT
12:41:43 kernel drbd0: Secondary/Unknown --> Secondary/Primary
12:41:44 kernel drbd0: drbd0_receiver [1101]: cstate WFBitMapT --> SyncTarget
12:41:44 kernel drbd0: Resync started as SyncTarget (need to sync 10012 KB [2503 bits set]).
12:42:06 kernel drbd0: Resync done (total 21 sec; paused 0 sec; 476 K/sec)
12:42:06 kernel drbd0: drbd0_worker [1088]: cstate SyncTarget --> Connected
14:23:22 kernel drbd: initialised. Version: 0.7.2 (api:75/proto:74)
14:23:22 kernel drbd: SVN Revision: 1483:1485 build by ao at build, 2004-08-09 14:00:52
14:23:22 kernel drbd: registered as block device major 147
14:23:22 kernel drbd0: resync bitmap: bits=1540096 words=48128
14:23:22 kernel drbd0: size = 6160384 KB
14:23:22 kernel drbd0: 0 KB marked out-of-sync by on disk bit-map.
14:23:22 kernel drbd0: Found 4 transactions (16 active extents) in activity log.
14:23:22 kernel drbd0: drbdsetup [745]: cstate Unconfigured --> StandAlone
14:23:22 kernel drbd0: drbdsetup [758]: cstate StandAlone --> Unconnected
14:23:22 kernel drbd0: drbd0_receiver [759]: cstate Unconnected --> WFConnection
14:23:28 kernel drbd0: Secondary/Unknown --> Primary/Unknown
14:23:29 kernel EXT3 FS 2.4-0.9.19, 19 August 2002 on drbd(147,0), internal journal
14:49:05 kernel drbd: initialised. Version: 0.7.2 (api:75/proto:74)
14:49:05 kernel drbd: SVN Revision: 1483:1485 build by ao at build, 2004-08-09 14:00:52
14:49:05 kernel drbd: registered as block device major 147
14:49:05 kernel drbd0: resync bitmap: bits=1540096 words=48128
14:49:05 kernel drbd0: size = 6160384 KB
14:49:05 kernel drbd0: 0 KB marked out-of-sync by on disk bit-map.
14:49:05 kernel drbd0: Found 4 transactions (53 active extents) in activity log.
14:49:05 kernel drbd0: Marked additional 26624 KB as out-of-sync based on AL.
14:49:05 kernel drbd0: drbdsetup [733]: cstate Unconfigured --> StandAlone
14:49:05 kernel drbd0: drbdsetup [746]: cstate StandAlone --> Unconnected
14:49:05 kernel drbd0: drbd0_receiver [747]: cstate Unconnected --> WFConnection
14:49:11 kernel drbd0: Secondary/Unknown --> Primary/Unknown
14:49:11 kernel EXT3 FS 2.4-0.9.19, 19 August 2002 on drbd(147,0), internal journal
15:50:01 kernel drbd: initialised. Version: 0.7.2 (api:75/proto:74)
15:50:01 kernel drbd: SVN Revision: 1483:1485 build by ao at build, 2004-08-09 14:00:52
15:50:01 kernel drbd: registered as block device major 147
15:50:01 kernel drbd0: resync bitmap: bits=1540096 words=48128
15:50:01 kernel drbd0: size = 6160384 KB
15:50:03 kernel drbd0: 0 KB marked out-of-sync by on disk bit-map.
15:50:03 kernel drbd0: Found 4 transactions (53 active extents) in activity log.
15:50:03 kernel drbd0: Marked additional 26624 KB as out-of-sync based on AL.
15:50:03 kernel drbd0: drbdsetup [750]: cstate Unconfigured --> StandAlone
15:50:03 kernel drbd0: drbdsetup [763]: cstate StandAlone --> Unconnected
15:50:03 kernel drbd0: drbd0_receiver [764]: cstate Unconnected --> WFConnection
15:50:03 kernel drbd0: drbd0_receiver [764]: cstate WFConnection --> WFReportParams
15:50:03 kernel drbd0: Handshake successful: DRBD Network Protocol version 74
15:50:03 kernel drbd0: Connection established.
15:50:03 kernel drbd0: I am(S): 1:00000002:00000001:00000007:00000003:10
15:50:03 kernel drbd0: Peer(P): 1:00000002:00000001:00000006:00000004:10
15:50:03 kernel drbd0: drbd0_receiver [764]: cstate WFReportParams --> WFBitMapS
15:50:03 kernel drbd0: sock_sendmsg returned -104
15:50:03 kernel drbd0: drbd0_receiver [764]: cstate WFBitMapS --> BrokenPipe
15:50:03 kernel drbd0: short sent ReportBitMap size=4096 sent=3056
15:50:03 kernel drbd0: Secondary/Unknown --> Secondary/Primary
15:50:03 kernel drbd0: meta connection shut down by peer.
15:50:03 kernel drbd0: asender terminated
15:50:03 kernel drbd0: sock was shut down by peer
15:50:03 kernel drbd0: drbd0_receiver [764]: cstate BrokenPipe --> BrokenPipe
15:50:03 kernel drbd0: short read expecting header on sock: r=0
15:50:03 kernel drbd0: worker terminated
15:50:03 kernel drbd0: drbd0_receiver [764]: cstate BrokenPipe --> Unconnected
15:50:03 kernel drbd0: Connection lost.
15:50:03 kernel drbd0: drbd0_receiver [764]: cstate Unconnected --> WFConnection
15:50:09 kernel drbd0: Secondary/Unknown --> Primary/Unknown
15:50:09 kernel EXT3 FS 2.4-0.9.19, 19 August 2002 on drbd(147,0), internal journal
15:56:47 kernel drbd: initialised. Version: 0.7.2 (api:75/proto:74)
15:56:47 kernel drbd: SVN Revision: 1483:1485 build by ao at build, 2004-08-09 14:00:52
15:56:47 kernel drbd: registered as block device major 147
15:56:47 kernel drbd0: resync bitmap: bits=1540096 words=48128
15:56:47 kernel drbd0: size = 6160384 KB
15:56:47 kernel drbd0: 212992 KB marked out-of-sync by on disk bit-map.
15:56:47 kernel drbd0: Found 4 transactions (53 active extents) in activity log.
15:56:47 kernel drbd0: Marked additional 0 KB as out-of-sync based on AL.
15:56:47 kernel drbd0: drbdsetup [732]: cstate Unconfigured --> StandAlone
15:56:48 kernel drbd0: drbdsetup [745]: cstate StandAlone --> Unconnected
15:56:48 kernel drbd0: drbd0_receiver [746]: cstate Unconnected --> WFConnection
15:56:54 kernel drbd0: Secondary/Unknown --> Primary/Unknown
15:56:54 kernel EXT3 FS 2.4-0.9.19, 19 August 2002 on drbd(147,0), internal journal
16:11:33 kernel drbd: initialised. Version: 0.7.2 (api:75/proto:74)
16:11:33 kernel drbd: SVN Revision: 1483:1485 build by ao at build, 2004-08-09 14:00:52
16:11:33 kernel drbd: registered as block device major 147
16:11:33 kernel drbd0: resync bitmap: bits=1540096 words=48128
16:11:33 kernel drbd0: size = 6160384 KB
16:11:33 kernel drbd0: 212992 KB marked out-of-sync by on disk bit-map.
16:11:33 kernel drbd0: Found 4 transactions (53 active extents) in activity log.
16:11:33 kernel drbd0: Marked additional 0 KB as out-of-sync based on AL.
16:11:33 kernel drbd0: drbdsetup [732]: cstate Unconfigured --> StandAlone
16:11:33 kernel drbd0: drbdsetup [745]: cstate StandAlone --> Unconnected
16:11:33 kernel drbd0: drbd0_receiver [746]: cstate Unconnected --> WFConnection
16:11:33 kernel drbd0: drbd0_receiver [746]: cstate WFConnection --> WFReportParams
16:11:33 kernel drbd0: Handshake successful: DRBD Network Protocol version 74
16:11:33 kernel drbd0: Connection established.
16:11:33 kernel drbd0: Split-Brain detected, dropping connection!
16:11:33 kernel drbd0: drbd0_receiver [746]: cstate WFReportParams --> StandAlone
16:11:33 kernel drbd0: error receiving ReportParams, l: 72!
16:11:33 kernel drbd0: asender terminated
16:11:33 kernel drbd0: worker terminated
16:11:33 kernel drbd0: drbd0_receiver [746]: cstate StandAlone --> StandAlone
16:11:33 kernel drbd0: Connection lost.
16:11:33 kernel drbd0: receiver terminated
16:12:36 kernel drbd0: Secondary/Unknown --> Primary/Unknown


More information about the drbd-user mailing list