Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.
Hi,
I'm trying to upgrade DRBD from 8.3.11 to 8.4.0.
This is my work sequence;
hostname
bl460g1n13 -> Primary
bl460g1n14 -> Secondary
I keep bl460g1n13 as Primary and stop DRBD on bl460g1n14 and try to upgrade it.
I could start upgraded DRBD successfully,
but it disk status was "Diskless".
Should I edit drbd.conf on upgraded node?
[root at bl460g1n13 ~]# cat /proc/drbd
version: 8.3.11 (api:88/proto:86-96)
GIT-hash: 0de839cee13a4160eed6037c4bddd066645e23c5 build by
root at bl460g1n13, 2011-07-25 13:44:23
0: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r-----
ns:132 nr:0 dw:4 dr:9771393 al:1 bm:597 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
[root at bl460g1n13 ~]# df
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/cciss/c0d0p6 20315812 784892 18482280 5% /
/dev/cciss/c0d0p3 20315844 262636 19004568 2% /var
/dev/cciss/c0d0p2 20315844 3315216 15951988 18% /usr
/dev/cciss/c0d0p7 20315812 176248 19090924 1% /opt
/dev/cciss/c0d0p5 20315812 258820 19008352 2% /home
/dev/cciss/c0d0p1 124427 12553 105450 11% /boot
tmpfs 8218960 0 8218960 0% /dev/shm
/dev/drbd0 9617876 152688 8976628 2% /drbd0
[root at bl460g1n14 ~]# cat /proc/drbd
version: 8.3.11 (api:88/proto:86-96)
GIT-hash: 0de839cee13a4160eed6037c4bddd066645e23c5 build by
root at bl460g1n14, 2011-07-25 13:44:15
0: cs:Connected ro:Secondary/Primary ds:UpToDate/UpToDate C r-----
ns:0 nr:132 dw:132 dr:9771248 al:0 bm:597 lo:0 pe:0 ua:0 ap:0 ep:1
wo:d oos:0
[root at bl460g1n14 ~]# drbdadm down all
[root at bl460g1n14 ~]# service drbd stop
[root at bl460g1n14 ~]# rpm -qa | grep drbd
drbd-km-2.6.18_238.el5-8.3.11-1
drbd-pacemaker-8.3.11-1
drbd-utils-8.3.11-1
[root at bl460g1n14 ~]# rpm -e drbd-km-2.6.18_238.el5-8.3.11-1
drbd-pacemaker-8.3.11-1 drbd-utils-8.3.11-1
warning: /etc/drbd.conf saved as /etc/drbd.conf.rpmsave
[root at bl460g1n14 ~]# rpm -ihv /home/rpm/8400/drbd-utils-8.4.0-1.x86_64.rpm
[root at bl460g1n14 ~]# rpm -ihv
/home/rpm/8400/drbd-km-2.6.18_238.el5-8.4.0-1.x86_64.rpm
[root at bl460g1n14 ~]# rpm -ihv /home/rpm/8400/drbd-pacemaker-8.4.0-1.x86_64.rpm
[root at bl460g1n14 ~]# chkconfig drbd off
[root at bl460g1n14 ~]# scp -p bl460g1n13:/etc/drbd.conf /etc/drbd.conf
[root at bl460g1n14 ~]# service drbd start
Starting DRBD resources: [
create res: r0
prepare disk: r0
adjust disk: r0
adjust net: r0
]
...
[root at bl460g1n14 ~]# cat /proc/drbd
version: 8.4.0 (api:1/proto:86-100)
GIT-hash: 28753f559ab51b549d16bcf487fe625d5919c49c build by
root at bl460g1n14, 2011-07-25 13:46:09
0: cs:Connected ro:Secondary/Primary ds:Diskless/UpToDate C r-----
ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
[root at bl460g1n14 ~]# drbdadm attach all
No usable activity log found. Do you need to create-md?
[root at bl460g1n14 ~]# drbdadm create-md all
md_offset 10006097920
al_offset 10006065152
bm_offset 10005757952
Found ext3 filesystem
9771248 kB data area apparently used
9771248 kB left usable by current configuration
Even though it looks like this would place the new meta data into
unused space, you still need to confirm, as this is only a guess.
Do you want to proceed?
[need to type 'yes' to confirm] yes
You want me to create a v08 style flexible-size internal meta data block.
There appears to be a v08 flexible-size internal meta data block
already in place on /dev/cciss/c0d1p1 at byte offset 10006097920
Do you really want to overwrite the existing v08 meta-data?
[need to type 'yes' to confirm] yes
Writing meta data...
initializing activity log
NOT initializing bitmap
New drbd meta data block successfully created.
[root at bl460g1n14 ~]# cat /proc/drbd
version: 8.4.0 (api:1/proto:86-100)
GIT-hash: 28753f559ab51b549d16bcf487fe625d5919c49c build by
root at bl460g1n14, 2011-07-25 13:46:09
0: cs:Connected ro:Secondary/Primary ds:Diskless/UpToDate C r-----
ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
[root at bl460g1n14 ~]# drbdadm attach all
[root at bl460g1n14 ~]# cat /proc/drbd
version: 8.4.0 (api:1/proto:86-100)
GIT-hash: 28753f559ab51b549d16bcf487fe625d5919c49c build by
root at bl460g1n14, 2011-07-25 13:46:09
0: cs:Connected ro:Secondary/Primary ds:Diskless/UpToDate C r-----
ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
[root at bl460g1n14 ~]# tail -n 20 /var/log/messages
Jul 25 15:18:03 bl460g1n14 kernel: d-con r0: Handshake successful:
Agreed network protocol version 96
Jul 25 15:18:03 bl460g1n14 kernel: d-con r0: Peer authenticated using
20 bytes HMAC
Jul 25 15:18:03 bl460g1n14 kernel: d-con r0: conn( WFConnection ->
WFReportParams )
Jul 25 15:18:03 bl460g1n14 kernel: d-con r0: Starting asender thread
(from drbd_r_r0 [5140])
Jul 25 15:18:03 bl460g1n14 kernel: block drbd0: peer( Unknown ->
Primary ) conn( WFReportParams -> Connected ) pdsk( DUnknown ->
UpToDate )
Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: disk( Diskless -> Attaching )
Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: Method to ensure write
ordering: barrier
Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: bitmap READ of 75
pages took 6 jiffies
Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: recounting of set bits
took additional 1 jiffies
Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: 0 KB (0 bits) marked
out-of-sync by on disk bit-map.
Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: disk( Attaching -> Negotiating )
Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: attached to UUIDs
0000000000000004:0000000000000000:0000000000000000:0000000000000000
Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: Barriers not supported
on meta data device - disabling
Jul 25 15:19:51 bl460g1n14 kernel: block drbd0:
drbd_md_sync_page_io(,19543160s,WRITE) failed!
Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: meta data update failed!
Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: disk( Negotiating -> Failed )
Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: Local IO failed in
drbd_md_sync. Detaching...
Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: disk( Failed -> Diskless )
Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: receiver updated UUIDs
to effective data uuid: A25958A4D6C19E51
Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: unexpected cstate
(Connected) in receive_bitmap
Regards,
Junko IKEDA
NTT DATA INTELLILINK CORPORATION