Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.
Hi,
I got it.
drbdadm wipe-md + create-md are needed.
0) start DRBD on 2 node, as Primary/Secnodary
on Secondary;
1) stop DRBD
# drbdadm down all
# service drbd stop
2) remove old DRBD
# rpm -e drbd-km-2.6.18_238.el5-8.3.11-1 drbd-pacemaker-8.3.11-1
drbd-utils-8.3.11-1
3) install new DRBD
# rpm -ihv drbd-utils-8.4.0-1.x86_64.rpm
drbd-km-2.6.18_238.el5-8.4.0-1.x86_64.rpm
drbd-pacemaker-8.4.0-1.x86_64.rpm
# chkconfig drbd off
4) create drbd.conf
# cp -p /etc/drbd.conf.rpmsave /etc/drbd.conf
5) refresh meta-data
# drbdadm wipe-md all
# drbdadm create-md all
6) start DRBD
# service drbd start
# cat /proc/drbd
version: 8.4.0 (api:1/proto:86-100)
GIT-hash: 28753f559ab51b549d16bcf487fe625d5919c49c build by
root at bl460g1n13, 2011-07-25 13:46:08
0: cs:SyncTarget ro:Secondary/Primary ds:Inconsistent/UpToDate C r-----
ns:0 nr:0 dw:0 dr:263296 al:0 bm:15 lo:22 pe:46 ua:0 ap:0 ep:1
wo:b oos:9513840
[>....................] sync'ed: 2.7% (9288/9540)M
finish: 0:03:41 speed: 42,900 (42,900) want: 40,960 K/sec
# cat /proc/drbd
version: 8.4.0 (api:1/proto:86-100)
GIT-hash: 28753f559ab51b549d16bcf487fe625d5919c49c build by
root at bl460g1n13, 2011-07-25 13:46:08
0: cs:Connected ro:Secondary/Primary ds:UpToDate/UpToDate C r-----
ns:0 nr:0 dw:0 dr:9771248 al:0 bm:597 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
Thanks,
Junko
2011/7/25 Junko IKEDA <tsukishima.ha at gmail.com>:
> Hi,
>
> I'm trying to upgrade DRBD from 8.3.11 to 8.4.0.
> This is my work sequence;
>
> hostname
> bl460g1n13 -> Primary
> bl460g1n14 -> Secondary
>
> I keep bl460g1n13 as Primary and stop DRBD on bl460g1n14 and try to upgrade it.
> I could start upgraded DRBD successfully,
> but it disk status was "Diskless".
> Should I edit drbd.conf on upgraded node?
>
>
> [root at bl460g1n13 ~]# cat /proc/drbd
> version: 8.3.11 (api:88/proto:86-96)
> GIT-hash: 0de839cee13a4160eed6037c4bddd066645e23c5 build by
> root at bl460g1n13, 2011-07-25 13:44:23
> 0: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r-----
> ns:132 nr:0 dw:4 dr:9771393 al:1 bm:597 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
>
> [root at bl460g1n13 ~]# df
> Filesystem 1K-blocks Used Available Use% Mounted on
> /dev/cciss/c0d0p6 20315812 784892 18482280 5% /
> /dev/cciss/c0d0p3 20315844 262636 19004568 2% /var
> /dev/cciss/c0d0p2 20315844 3315216 15951988 18% /usr
> /dev/cciss/c0d0p7 20315812 176248 19090924 1% /opt
> /dev/cciss/c0d0p5 20315812 258820 19008352 2% /home
> /dev/cciss/c0d0p1 124427 12553 105450 11% /boot
> tmpfs 8218960 0 8218960 0% /dev/shm
> /dev/drbd0 9617876 152688 8976628 2% /drbd0
>
> [root at bl460g1n14 ~]# cat /proc/drbd
> version: 8.3.11 (api:88/proto:86-96)
> GIT-hash: 0de839cee13a4160eed6037c4bddd066645e23c5 build by
> root at bl460g1n14, 2011-07-25 13:44:15
> 0: cs:Connected ro:Secondary/Primary ds:UpToDate/UpToDate C r-----
> ns:0 nr:132 dw:132 dr:9771248 al:0 bm:597 lo:0 pe:0 ua:0 ap:0 ep:1
> wo:d oos:0
>
> [root at bl460g1n14 ~]# drbdadm down all
> [root at bl460g1n14 ~]# service drbd stop
>
> [root at bl460g1n14 ~]# rpm -qa | grep drbd
> drbd-km-2.6.18_238.el5-8.3.11-1
> drbd-pacemaker-8.3.11-1
> drbd-utils-8.3.11-1
>
> [root at bl460g1n14 ~]# rpm -e drbd-km-2.6.18_238.el5-8.3.11-1
> drbd-pacemaker-8.3.11-1 drbd-utils-8.3.11-1
> warning: /etc/drbd.conf saved as /etc/drbd.conf.rpmsave
>
> [root at bl460g1n14 ~]# rpm -ihv /home/rpm/8400/drbd-utils-8.4.0-1.x86_64.rpm
> [root at bl460g1n14 ~]# rpm -ihv
> /home/rpm/8400/drbd-km-2.6.18_238.el5-8.4.0-1.x86_64.rpm
> [root at bl460g1n14 ~]# rpm -ihv /home/rpm/8400/drbd-pacemaker-8.4.0-1.x86_64.rpm
> [root at bl460g1n14 ~]# chkconfig drbd off
> [root at bl460g1n14 ~]# scp -p bl460g1n13:/etc/drbd.conf /etc/drbd.conf
>
> [root at bl460g1n14 ~]# service drbd start
> Starting DRBD resources: [
> create res: r0
> prepare disk: r0
> adjust disk: r0
> adjust net: r0
> ]
> ...
>
> [root at bl460g1n14 ~]# cat /proc/drbd
> version: 8.4.0 (api:1/proto:86-100)
> GIT-hash: 28753f559ab51b549d16bcf487fe625d5919c49c build by
> root at bl460g1n14, 2011-07-25 13:46:09
> 0: cs:Connected ro:Secondary/Primary ds:Diskless/UpToDate C r-----
> ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
>
> [root at bl460g1n14 ~]# drbdadm attach all
> No usable activity log found. Do you need to create-md?
> [root at bl460g1n14 ~]# drbdadm create-md all
> md_offset 10006097920
> al_offset 10006065152
> bm_offset 10005757952
>
> Found ext3 filesystem
> 9771248 kB data area apparently used
> 9771248 kB left usable by current configuration
>
> Even though it looks like this would place the new meta data into
> unused space, you still need to confirm, as this is only a guess.
>
> Do you want to proceed?
> [need to type 'yes' to confirm] yes
>
> You want me to create a v08 style flexible-size internal meta data block.
> There appears to be a v08 flexible-size internal meta data block
> already in place on /dev/cciss/c0d1p1 at byte offset 10006097920
> Do you really want to overwrite the existing v08 meta-data?
> [need to type 'yes' to confirm] yes
>
> Writing meta data...
> initializing activity log
> NOT initializing bitmap
> New drbd meta data block successfully created.
>
> [root at bl460g1n14 ~]# cat /proc/drbd
> version: 8.4.0 (api:1/proto:86-100)
> GIT-hash: 28753f559ab51b549d16bcf487fe625d5919c49c build by
> root at bl460g1n14, 2011-07-25 13:46:09
> 0: cs:Connected ro:Secondary/Primary ds:Diskless/UpToDate C r-----
> ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
>
> [root at bl460g1n14 ~]# drbdadm attach all
> [root at bl460g1n14 ~]# cat /proc/drbd
> version: 8.4.0 (api:1/proto:86-100)
> GIT-hash: 28753f559ab51b549d16bcf487fe625d5919c49c build by
> root at bl460g1n14, 2011-07-25 13:46:09
> 0: cs:Connected ro:Secondary/Primary ds:Diskless/UpToDate C r-----
> ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
>
> [root at bl460g1n14 ~]# tail -n 20 /var/log/messages
> Jul 25 15:18:03 bl460g1n14 kernel: d-con r0: Handshake successful:
> Agreed network protocol version 96
> Jul 25 15:18:03 bl460g1n14 kernel: d-con r0: Peer authenticated using
> 20 bytes HMAC
> Jul 25 15:18:03 bl460g1n14 kernel: d-con r0: conn( WFConnection ->
> WFReportParams )
> Jul 25 15:18:03 bl460g1n14 kernel: d-con r0: Starting asender thread
> (from drbd_r_r0 [5140])
> Jul 25 15:18:03 bl460g1n14 kernel: block drbd0: peer( Unknown ->
> Primary ) conn( WFReportParams -> Connected ) pdsk( DUnknown ->
> UpToDate )
> Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: disk( Diskless -> Attaching )
> Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: Method to ensure write
> ordering: barrier
> Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: bitmap READ of 75
> pages took 6 jiffies
> Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: recounting of set bits
> took additional 1 jiffies
> Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: 0 KB (0 bits) marked
> out-of-sync by on disk bit-map.
> Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: disk( Attaching -> Negotiating )
> Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: attached to UUIDs
> 0000000000000004:0000000000000000:0000000000000000:0000000000000000
> Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: Barriers not supported
> on meta data device - disabling
> Jul 25 15:19:51 bl460g1n14 kernel: block drbd0:
> drbd_md_sync_page_io(,19543160s,WRITE) failed!
> Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: meta data update failed!
> Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: disk( Negotiating -> Failed )
> Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: Local IO failed in
> drbd_md_sync. Detaching...
> Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: disk( Failed -> Diskless )
> Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: receiver updated UUIDs
> to effective data uuid: A25958A4D6C19E51
> Jul 25 15:19:51 bl460g1n14 kernel: block drbd0: unexpected cstate
> (Connected) in receive_bitmap
>
>
> Regards,
> Junko IKEDA
>
> NTT DATA INTELLILINK CORPORATION
>