[DRBD-user] ProtocollError using on-congestion pull-ahead

Holger Steinhaus hsteinhaus at gmx.de
Fri Feb 8 18:34:41 CET 2013

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


>
> Known bug in 8.4, supposedly fixed with 8.4.3.

Sorry, I cannot confirm this. I have just upgraded to 8.4.3 - but I see 
still the same  behavior:

initialization:
Feb  8 18:04:10 nas2 kernel: drbd: initialized. Version: 8.4.3 
(api:1/proto:86-101)
Feb  8 18:04:10 nas2 kernel: drbd: GIT-hash: 
89a294209144b68adb3ee85a73221f964d3ee515 build by 
root at sl62-gluster1.home, 2013-02-08 17:44:22
Feb  8 18:04:10 nas2 kernel: drbd: registered as block device major 147
Feb  8 18:04:11 nas2 kernel: d-con main_disk: Starting worker thread 
(from drbdsetup [1760])
Feb  8 18:04:11 nas2 kernel: block drbd0: disk( Diskless -> Attaching )
Feb  8 18:04:11 nas2 kernel: d-con main_disk: Method to ensure write 
ordering: flush
Feb  8 18:04:11 nas2 kernel: block drbd0: max BIO size = 1048576
Feb  8 18:04:11 nas2 kernel: block drbd0: drbd_bm_resize called with 
capacity == 209722032
Feb  8 18:04:11 nas2 kernel: block drbd0: resync bitmap: bits=26215254 
words=409614 pages=801
Feb  8 18:04:11 nas2 kernel: block drbd0: size = 100 GB (104861016 KB)
Feb  8 18:04:11 nas2 kernel: block drbd0: bitmap READ of 801 pages took 
57 jiffies
Feb  8 18:04:11 nas2 kernel: block drbd0: recounting of set bits took 
additional 4 jiffies
Feb  8 18:04:11 nas2 kernel: block drbd0: 0 KB (0 bits) marked 
out-of-sync by on disk bit-map.
Feb  8 18:04:11 nas2 kernel: block drbd0: disk( Attaching -> UpToDate )
Feb  8 18:04:11 nas2 kernel: block drbd0: attached to UUIDs 
B5E1C5DDF619933B:92F2102AB680EF8F:9EE50758DE35D21A:9EE40758DE35D21A

primary node:
Feb  8 18:27:22 nas2 kernel: block drbd0: drbd_sync_handshake:
Feb  8 18:27:22 nas2 kernel: block drbd0: self 
7D5A7B3621E9DF57:06664DA495AF00B0:06654DA495AF00B0:06644DA495AF00B0 
bits:286474 flags:0
Feb  8 18:27:22 nas2 kernel: block drbd0: peer 
06664DA495AF00B0:0000000000000000:B5E2C5DDF619933A:B5E1C5DDF619933B 
bits:283143 flags:0
Feb  8 18:27:22 nas2 kernel: block drbd0: uuid_compare()=1 by rule 70
Feb  8 18:27:22 nas2 kernel: block drbd0: Becoming sync source due to 
disk states.
Feb  8 18:27:22 nas2 kernel: block drbd0: peer( Unknown -> Secondary ) 
conn( WFReportParams -> WFBitMapS )
Feb  8 18:27:22 nas2 kernel: block drbd0: send bitmap stats 
[Bytes(packets)]: plain 0(0), RLE 142(1), total 142; compression: 100.0%
Feb  8 18:27:22 nas2 kernel: block drbd0: receive bitmap stats 
[Bytes(packets)]: plain 0(0), RLE 142(1), total 142; compression: 100.0%
Feb  8 18:27:22 nas2 kernel: block drbd0: helper command: /sbin/drbdadm 
before-resync-source minor-0
Feb  8 18:27:22 nas2 kernel: block drbd0: helper command: /sbin/drbdadm 
before-resync-source minor-0 exit code 0 (0x0)
Feb  8 18:27:22 nas2 kernel: block drbd0: conn( WFBitMapS -> SyncSource )
Feb  8 18:27:22 nas2 kernel: block drbd0: Began resync as SyncSource 
(will sync 1158080 KB [289520 bits set]).
Feb  8 18:27:22 nas2 kernel: block drbd0: updated sync UUID 
7D5A7B3621E9DF57:06674DA495AF00B0:06664DA495AF00B0:06654DA495AF00B0
Feb  8 18:27:22 nas2 kernel: block drbd0: Congestion-fill threshold reached
Feb  8 18:27:22 nas2 kernel: block drbd0: conn( SyncSource -> Ahead )
Feb  8 18:27:22 nas2 kernel: d-con main_disk: BAD! BarrierAck #627 
received with n_writes=1024, expected n_writes=1025!
Feb  8 18:27:22 nas2 kernel: d-con main_disk: peer( Secondary -> Unknown 
) conn( Ahead -> ProtocolError )
Feb  8 18:27:22 nas2 kernel: d-con main_disk: asender terminated
Feb  8 18:27:22 nas2 kernel: d-con main_disk: Terminating drbd_a_main_dis
Feb  8 18:27:22 nas2 kernel: d-con main_disk: Connection closed
Feb  8 18:27:22 nas2 kernel: d-con main_disk: conn( ProtocolError -> 
Unconnected )
Feb  8 18:27:22 nas2 kernel: d-con main_disk: receiver terminated
Feb  8 18:27:22 nas2 kernel: d-con main_disk: Restarting receiver thread
Feb  8 18:27:22 nas2 kernel: d-con main_disk: receiver (re)started
Feb  8 18:27:22 nas2 kernel: d-con main_disk: conn( Unconnected -> 
WFConnection )
Feb  8 18:27:23 nas2 kernel: d-con main_disk: Handshake successful: 
Agreed network protocol version 101
Feb  8 18:27:23 nas2 kernel: d-con main_disk: conn( WFConnection -> 
WFReportParams )
Feb  8 18:27:23 nas2 kernel: d-con main_disk: Starting asender thread 
(from drbd_r_main_dis [1766])
Feb  8 18:27:23 nas2 kernel: block drbd0: drbd_sync_handshake:
Feb  8 18:27:23 nas2 kernel: block drbd0: self 
7D5A7B3621E9DF57:06674DA495AF00B0:06664DA495AF00B0:06654DA495AF00B0 
bits:291056 flags:0
Feb  8 18:27:23 nas2 kernel: block drbd0: peer 
06674DA495AF00B0:0000000000000000:B5E2C5DDF619933A:B5E1C5DDF619933B 
bits:290032 flags:0
Feb  8 18:27:23 nas2 kernel: block drbd0: uuid_compare()=1 by rule 70
Feb  8 18:27:23 nas2 kernel: block drbd0: Becoming sync source due to 
disk states.

secondary node:
Feb  8 18:27:21 nas3 kernel: block drbd0: drbd_sync_handshake:
Feb  8 18:27:21 nas3 kernel: block drbd0: self 
06664DA495AF00B0:0000000000000000:B5E2C5DDF619933A:B5E1C5DDF619933B 
bits:283143 flags:0
Feb  8 18:27:21 nas3 kernel: block drbd0: peer 
7D5A7B3621E9DF57:06664DA495AF00B0:06654DA495AF00B0:06644DA495AF00B0 
bits:286474 flags:0
Feb  8 18:27:21 nas3 kernel: block drbd0: uuid_compare()=-1 by rule 50
Feb  8 18:27:21 nas3 kernel: block drbd0: Becoming sync target due to 
disk states.
Feb  8 18:27:21 nas3 kernel: block drbd0: peer( Unknown -> Primary ) 
conn( WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate )
Feb  8 18:27:22 nas3 kernel: block drbd0: receive bitmap stats 
[Bytes(packets)]: plain 0(0), RLE 142(1), total 142; compression: 100.0%
Feb  8 18:27:22 nas3 kernel: block drbd0: send bitmap stats 
[Bytes(packets)]: plain 0(0), RLE 142(1), total 142; compression: 100.0%
Feb  8 18:27:22 nas3 kernel: block drbd0: conn( WFBitMapT -> WFSyncUUID )
Feb  8 18:27:22 nas3 kernel: block drbd0: updated sync uuid 
06674DA495AF00B0:0000000000000000:B5E2C5DDF619933A:B5E1C5DDF619933B
Feb  8 18:27:22 nas3 kernel: block drbd0: helper command: /sbin/drbdadm 
before-resync-target minor-0
Feb  8 18:27:22 nas3 kernel: block drbd0: helper command: /sbin/drbdadm 
before-resync-target minor-0 exit code 0 (0x0)
Feb  8 18:27:22 nas3 kernel: block drbd0: conn( WFSyncUUID -> SyncTarget )
Feb  8 18:27:22 nas3 kernel: block drbd0: Began resync as SyncTarget 
(will sync 1158080 KB [289520 bits set]).
Feb  8 18:27:22 nas3 kernel: block drbd0: conn( SyncTarget -> Behind )
Feb  8 18:27:22 nas3 kernel: d-con main_disk: meta connection shut down 
by peer.
Feb  8 18:27:22 nas3 kernel: d-con main_disk: peer( Primary -> Unknown ) 
conn( Behind -> NetworkFailure ) pdsk( UpToDate -> DUnknown )
Feb  8 18:27:22 nas3 kernel: d-con main_disk: sock was shut down by peer
Feb  8 18:27:22 nas3 kernel: d-con main_disk: asender terminated
Feb  8 18:27:22 nas3 kernel: d-con main_disk: Terminating drbd_a_main_dis
Feb  8 18:27:22 nas3 kernel: d-con main_disk: Connection closed
Feb  8 18:27:22 nas3 kernel: d-con main_disk: conn( NetworkFailure -> 
Unconnected )
Feb  8 18:27:22 nas3 kernel: d-con main_disk: receiver terminated
Feb  8 18:27:22 nas3 kernel: d-con main_disk: Restarting receiver thread
Feb  8 18:27:22 nas3 kernel: d-con main_disk: receiver (re)started
Feb  8 18:27:22 nas3 kernel: d-con main_disk: conn( Unconnected -> 
WFConnection )
Feb  8 18:27:23 nas3 kernel: d-con main_disk: Handshake successful: 
Agreed network protocol version 101
Feb  8 18:27:23 nas3 kernel: d-con main_disk: conn( WFConnection -> 
WFReportParams )
Feb  8 18:27:23 nas3 kernel: d-con main_disk: Starting asender thread 
(from drbd_r_main_dis [1947])
Feb  8 18:27:23 nas3 kernel: block drbd0: drbd_sync_handshake:
Feb  8 18:27:23 nas3 kernel: block drbd0: self 
06674DA495AF00B0:0000000000000000:B5E2C5DDF619933A:B5E1C5DDF619933B 
bits:290032 flags:0
Feb  8 18:27:23 nas3 kernel: block drbd0: peer 
7D5A7B3621E9DF57:06674DA495AF00B0:06664DA495AF00B0:06654DA495AF00B0 
bits:291056 flags:0
Feb  8 18:27:23 nas3 kernel: block drbd0: uuid_compare()=-1 by rule 50
Feb  8 18:27:23 nas3 kernel: block drbd0: Becoming sync target due to 
disk states.


Regards,
   Holger






More information about the drbd-user mailing list