Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.
I tried updating an 8.3.19 DRBD install (on EL6.9), and when I tried to
connect the updated node to the older node, I got this error:
==[ old node ]==
Sep 23 23:13:47 an-a02n02 kernel: block drbd0: Handshake successful:
Agreed network protocol version 97
Sep 23 23:13:47 an-a02n02 kernel: block drbd0: conn( WFConnection ->
WFReportParams )
Sep 23 23:13:47 an-a02n02 kernel: block drbd0: Starting asender thread
(from drbd0_receiver [12308])
Sep 23 23:13:47 an-a02n02 kernel: block drbd0: incompatible
after-sb-0pri settings
Sep 23 23:13:47 an-a02n02 kernel: block drbd0: conn( WFReportParams ->
Disconnecting )
Sep 23 23:13:47 an-a02n02 kernel: block drbd0: error receiving
ReportProtocol, l: 25!
Sep 23 23:13:47 an-a02n02 kernel: block drbd1: Handshake successful:
Agreed network protocol version 97
Sep 23 23:13:47 an-a02n02 kernel: block drbd1: conn( WFConnection ->
WFReportParams )
Sep 23 23:13:47 an-a02n02 kernel: block drbd1: Starting asender thread
(from drbd1_receiver [7326])
Sep 23 23:13:47 an-a02n02 kernel: block drbd1: incompatible
after-sb-0pri settings
Sep 23 23:13:47 an-a02n02 kernel: block drbd1: conn( WFReportParams ->
Disconnecting )
Sep 23 23:13:47 an-a02n02 kernel: block drbd1: error receiving
ReportProtocol, l: 25!
Sep 23 23:13:47 an-a02n02 kernel: block drbd1: asender terminated
Sep 23 23:13:47 an-a02n02 kernel: block drbd0: asender terminated
Sep 23 23:13:47 an-a02n02 kernel: block drbd1: Terminating drbd1_asender
Sep 23 23:13:47 an-a02n02 kernel: block drbd0: Terminating drbd0_asender
Sep 23 23:13:47 an-a02n02 kernel: block drbd1: Connection closed
Sep 23 23:13:47 an-a02n02 kernel: block drbd0: Connection closed
Sep 23 23:13:47 an-a02n02 kernel: block drbd0: conn( Disconnecting ->
StandAlone )
Sep 23 23:13:47 an-a02n02 kernel: block drbd1: conn( Disconnecting ->
StandAlone )
Sep 23 23:13:47 an-a02n02 kernel: block drbd1: receiver terminated
Sep 23 23:13:47 an-a02n02 kernel: block drbd0: receiver terminated
Sep 23 23:13:47 an-a02n02 kernel: block drbd0: Terminating drbd0_receiver
Sep 23 23:13:47 an-a02n02 kernel: block drbd1: Terminating drbd1_receiver
================
==[ updated node ]==
Sep 23 23:13:47 an-a02n01 kernel: drbd: events: mcg drbd: 2
Sep 23 23:13:47 an-a02n01 kernel: drbd: initialized. Version: 8.4.10-1
(api:1/proto:86-101)
Sep 23 23:13:47 an-a02n01 kernel: drbd: GIT-hash:
a4d5de01fffd7e4cde48a080e2c686f9e8cebf4c build by
root at rhel6-builder-production.alteeve.ca, 2017-06-02 02:04:01
Sep 23 23:13:47 an-a02n01 kernel: drbd: registered as block device major 147
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: Starting worker thread (from
drbdsetup-84 [21363])
Sep 23 23:13:47 an-a02n01 kernel: block drbd0: disk( Diskless ->
Attaching )
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: Method to ensure write
ordering: flush
Sep 23 23:13:47 an-a02n01 kernel: block drbd0: max BIO size = 131072
Sep 23 23:13:47 an-a02n01 kernel: block drbd0: drbd_bm_resize called
with capacity == 2039446672
Sep 23 23:13:47 an-a02n01 kernel: block drbd0: resync bitmap:
bits=254930834 words=3983295 pages=7780
Sep 23 23:13:47 an-a02n01 kernel: block drbd0: size = 972 GB (1019723336 KB)
Sep 23 23:13:47 an-a02n01 kernel: block drbd0: recounting of set bits
took additional 15 jiffies
Sep 23 23:13:47 an-a02n01 kernel: block drbd0: 0 KB (0 bits) marked
out-of-sync by on disk bit-map.
Sep 23 23:13:47 an-a02n01 kernel: block drbd0: disk( Attaching ->
Outdated )
Sep 23 23:13:47 an-a02n01 kernel: block drbd0: attached to UUIDs
56CACAA64BA107A0:0000000000000000:AC1430F5A678F9D5:AC1330F5A678F9D5
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: Starting worker thread (from
drbdsetup-84 [21375])
Sep 23 23:13:47 an-a02n01 kernel: block drbd1: disk( Diskless ->
Attaching )
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: Method to ensure write
ordering: flush
Sep 23 23:13:47 an-a02n01 kernel: block drbd1: max BIO size = 131072
Sep 23 23:13:47 an-a02n01 kernel: block drbd1: drbd_bm_resize called
with capacity == 1961029104
Sep 23 23:13:47 an-a02n01 kernel: block drbd1: resync bitmap:
bits=245128638 words=3830135 pages=7481
Sep 23 23:13:47 an-a02n01 kernel: block drbd1: size = 935 GB (980514552 KB)
Sep 23 23:13:47 an-a02n01 kernel: block drbd1: recounting of set bits
took additional 20 jiffies
Sep 23 23:13:47 an-a02n01 kernel: block drbd1: 0 KB (0 bits) marked
out-of-sync by on disk bit-map.
Sep 23 23:13:47 an-a02n01 kernel: block drbd1: disk( Attaching ->
Outdated )
Sep 23 23:13:47 an-a02n01 kernel: block drbd1: attached to UUIDs
9DEF4211549AF812:0000000000000000:C9A8780599C4CC3F:C9A7780599C4CC3F
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: conn( StandAlone ->
Unconnected )
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: Starting receiver thread
(from drbd_w_r0 [21364])
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: receiver (re)started
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: conn( Unconnected ->
WFConnection )
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: conn( StandAlone ->
Unconnected )
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: Starting receiver thread
(from drbd_w_r1 [21376])
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: receiver (re)started
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: conn( Unconnected ->
WFConnection )
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: Handshake successful: Agreed
network protocol version 97
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: Feature flags enabled on
protocol level: 0x0 none.
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: conn( WFConnection ->
WFReportParams )
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: Starting ack_recv thread
(from drbd_r_r0 [21381])
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: incompatible after-sb-0pri
settings
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: conn( WFReportParams ->
Disconnecting )
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: error receiving
ReportProtocol, e: -5 l: 1!
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: ack_receiver terminated
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: Terminating drbd_a_r0
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: Handshake successful: Agreed
network protocol version 97
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: Feature flags enabled on
protocol level: 0x0 none.
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: conn( WFConnection ->
WFReportParams )
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: Starting ack_recv thread
(from drbd_r_r1 [21384])
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: incompatible after-sb-0pri
settings
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: conn( WFReportParams ->
Disconnecting )
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: error receiving
ReportProtocol, e: -5 l: 1!
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: ack_receiver terminated
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: Terminating drbd_a_r1
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: Connection closed
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: conn( Disconnecting ->
StandAlone )
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: receiver terminated
Sep 23 23:13:47 an-a02n01 kernel: drbd r0: Terminating drbd_r_r0
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: Connection closed
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: conn( Disconnecting ->
StandAlone )
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: receiver terminated
Sep 23 23:13:47 an-a02n01 kernel: drbd r1: Terminating drbd_r_r1
====================
The config is (from 'drbdadm dump'):
====
# /etc/drbd.conf
common {
protocol C;
net {
allow-two-primaries;
after-sb-0pri discard-zero-changes;
after-sb-1pri discard-secondary;
after-sb-2pri disconnect;
}
disk {
fencing resource-and-stonith;
}
syncer {
rate 30M;
}
startup {
wfc-timeout 300;
degr-wfc-timeout 120;
outdated-wfc-timeout 120;
become-primary-on both;
}
handlers {
fence-peer /usr/lib/drbd/rhcs_fence;
}
}
# resource r0 on an-a02n02.example.com: not ignored, not stacked
resource r0 {
on an-a02n01.example.com {
device /dev/drbd0 minor 0;
disk /dev/sda5;
address ipv4 10.10.20.1:7788;
meta-disk internal;
}
on an-a02n02.example.com {
device /dev/drbd0 minor 0;
disk /dev/sda5;
address ipv4 10.10.20.2:7788;
meta-disk internal;
}
}
# resource r1 on an-a02n02.example.com: not ignored, not stacked
resource r1 {
on an-a02n01.example.com {
device /dev/drbd1 minor 1;
disk /dev/sda6;
address ipv4 10.10.20.1:7789;
meta-disk internal;
}
on an-a02n02.example.com {
device /dev/drbd1 minor 1;
disk /dev/sda6;
address ipv4 10.10.20.2:7789;
meta-disk internal;
}
}
====
I downgraded the node back to 8.3.16 and tried to reconnect;
====
Starting DRBD resources: [
r0
no suitable meta data found :(
Command '/sbin/drbdmeta 0 v08 /dev/sda5 internal check-resize'
terminated with exit code 255
drbdadm check-resize r0: exited with code 255
d(r0) 0: Failure: (119) No valid meta-data signature found.
==> Use 'drbdadm create-md res' to initialize meta-data area. <==
[r0] cmd /sbin/drbdsetup 0 disk /dev/sda5 /dev/sda5 internal
--set-defaults --create-device failed - continuing!
r1
no suitable meta data found :(
Command '/sbin/drbdmeta 1 v08 /dev/sda6 internal check-resize'
terminated with exit code 255
drbdadm check-resize r1: exited with code 255
d(r1) 1: Failure: (119) No valid meta-data signature found.
==> Use 'drbdadm create-md res' to initialize meta-data area. <==
[r1] cmd /sbin/drbdsetup 1 disk /dev/sda6 /dev/sda6 internal
--set-defaults --create-device failed - continuing!
n(r0) n(r1) ].
====
When I try to create the MD again, it warns be that it would truncate
and cause errors, so I assume drbd 8.4 updated the metadata and 8.3
doesn't recognize it now...
--
Digimer
Papers and Projects: https://alteeve.com/w/
"I am, somehow, less interested in the weight and convolutions of
Einstein’s brain than in the near certainty that people of equal talent
have lived and died in cotton fields and sweatshops." - Stephen Jay Gould