<br><font size=2><tt>> Brian R. Hellman brian@linbit.com wrote:<br>
><br>
></tt></font>
<br><font size=2><tt>> It's not officially posted yet, but here is a
link to a HOWTO that I<br>
> wrote, this should help :)<br>
</tt></font>
<br><font size=2><tt>> http://www.howtoforge.com/node/4265</tt></font>
<br>
<br><font size=2><tt>Thanks Brian that did the trick !</tt></font>
<br>
<br><font size=2><tt>Do you know if this will make it's way into the Users
Guide ?</tt></font>
<br>
<br><font size=2><tt>I had guessed I needed a "--overwrite-data-of-peer"
for the stacked</tt></font>
<br><font size=2><tt>resource but did not know the syntax. Shouldn't this
be in the</tt></font>
<br><font size=2><tt>drbdadm man page ?</tt></font>
<br>
<br><font size=2><tt>Also with the above post you use "adjust"
rather then "up". In</tt></font>
<br><font size=2><tt>this context would both do the same thing ?</tt></font>
<br>
<br><font size=2><tt>Thanks<br>
</tt></font>
<br>
<br><font size=2><tt>> <br>
> David.Livingstone@cn.ca wrote:<br>
> ><br>
> ><br>
> > Following on my Three node setup questions I have attempted
to<br>
> > setup a three node cluster. See the drbd.conf at the end
of this<br>
> > message and the following background.<br>
> ><br>
> > I get to the point of executing "drbdadm --stacked
primary drbd-U"<br>
> > and I get the following error. Any help would be appreciated.<br>
> ><br>
> > [root@hatest1 etc]# drbdadm --stacked primary drbd-U<br>
> > /dev/drbd1: State change failed: (-2) Refusing to be Primary
without at<br>
> > least one UpToDate disk<br>
> > Command 'drbdsetup /dev/drbd1 primary' terminated with exit code
17<br>
> ><br>
> ><br>
> > HW and SW Background :<br>
> ><br>
> > All three machines :<br>
> > - HW : - Proliant DL380G4<br>
> > - SW : - Latest RHEL5 and kernel-2.6.18-128.1.1.el5<br>
> > - drbd : drbd-8.3.0-3, drbd-km-2.6.18_128.1.1.el5-8.3.0-3<br>
> ><br>
> ><br>
> > Here is what the game plan was :<br>
> ><br>
> > 1. Bring up the underlying resource "drbd" :<br>
> > On hatest1/2:<br>
> > - drbdadm create-md drbd<br>
> > - modprobe drbd<br>
> > - drbdadm up drbd<br>
> > On hatest1:<br>
> > - drbdadm -- --overwrite-data-of-peer primary drbd<br>
> > 2. Manually on the "primary" bring up the 165.115.204.197(hatest)<br>
> > address specified for the stacked resource - it is this<br>
> > address which talks to the nlstor1 backup.<br>
> ><br>
> > On hatest1:<br>
> > ifconfig eth1:0 165.115.204.197 up<br>
> ><br>
> > 3. Start the stacked drbd-U resource :<br>
> ><br>
> > As with unstacked resources, you must create DRBD meta data on
the<br>
> > stacked resources. This is done using the following command:<br>
> ><br>
> > On hatest1:<br>
> > drbdadm --stacked create-md drbd-U<br>
> ><br>
> > Then, you may enable the stacked resource:<br>
> ><br>
> > On hatest1:<br>
> > drbdadm --stacked up drbd-U<br>
> > drbdadm --stacked primary drbd-U<br>
> ><br>
> > After this, you may bring up the resource on the backup node,
enabling<br>
> > three-node replication:<br>
> ><br>
> > On nlstor1:<br>
> > drbdadm create-md drbd-U<br>
> > drbdadm up drbd-U<br>
> ><br>
> > Here is the command history from the machines as they were executed
:<br>
> ><br>
> > [root@hatest1 etc]# drbdadm create-md drbd<br>
> > md_offset 1572859904<br>
> > al_offset 1572827136<br>
> > bm_offset 1572777984<br>
> ><br>
> > Found some data<br>
> > ==> This might destroy existing data! <==<br>
> ><br>
> > Do you want to proceed?<br>
> > [need to type 'yes' to confirm] yes<br>
> ><br>
> > Writing meta data...<br>
> > initialising activity log<br>
> > NOT initialized bitmap<br>
> > New drbd meta data block sucessfully created.<br>
> > [root@hatest1 etc]#<br>
> ><br>
> > [root@hatest2 etc]# drbdadm create-md drbd<br>
> > md_offset 1572859904<br>
> > al_offset 1572827136<br>
> > bm_offset 1572777984<br>
> ><br>
> > Found some data<br>
> > ==> This might destroy existing data! <==<br>
> ><br>
> > Do you want to proceed?<br>
> > [need to type 'yes' to confirm] yes<br>
> ><br>
> > Writing meta data...<br>
> > initialising activity log<br>
> > NOT initialized bitmap<br>
> > New drbd meta data block sucessfully created.<br>
> > [root@hatest2 etc]#<br>
> ><br>
> > [root@hatest1 etc]# modprobe drbd<br>
> > [root@hatest1 etc]# lsmod|grep drbd<br>
> > drbd
220696 0<br>
> > [root@hatest1 etc]# service drbd status<br>
> > drbd driver loaded OK; device status:<br>
> > version: 8.3.0 (api:88/proto:86-89)<br>
> > GIT-hash: 9ba8b93e24d842f0dd3fb1f9b90e8348ddb95829 build by<br>
> > root@hatest1, 2009-02-13 09:00:29<br>
> > m:res cs ro ds p mounted fstype<br>
> > [root@hatest1 etc]# drbdadm up drbd<br>
> > [root@hatest1 etc]#<br>
> ><br>
> > [root@hatest2 etc]# modprobe drbd<br>
> > [root@hatest2 etc]# service drbd status<br>
> > drbd driver loaded OK; device status:<br>
> > version: 8.3.0 (api:88/proto:86-89)<br>
> > GIT-hash: 9ba8b93e24d842f0dd3fb1f9b90e8348ddb95829 build by<br>
> > root@hatest2, 2009-02-13 09:59:05<br>
> > m:res cs ro ds p mounted fstype<br>
> > [root@hatest2 etc]# drbdadm up drbd<br>
> > [root@hatest2 etc]#<br>
> ><br>
> > [root@hatest1 etc]# cat /proc/drbd<br>
> > version: 8.3.0 (api:88/proto:86-89)<br>
> > GIT-hash: 9ba8b93e24d842f0dd3fb1f9b90e8348ddb95829 build by<br>
> > root@hatest1, 2009-02-13 09:00:29<br>
> > 0: cs:Connected ro:Secondary/Secondary ds:Inconsistent/Inconsistent
C r---<br>
> > ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:1535916<br>
> > [root@hatest1 etc]#<br>
> > [root@hatest2 etc]# cat /proc/drbd<br>
> > version: 8.3.0 (api:88/proto:86-89)<br>
> > GIT-hash: 9ba8b93e24d842f0dd3fb1f9b90e8348ddb95829 build by<br>
> > root@hatest2, 2009-02-13 09:59:05<br>
> > 0: cs:Connected ro:Secondary/Secondary ds:Inconsistent/Inconsistent
C r---<br>
> > ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:1535916<br>
> > [root@hatest2 etc]#<br>
> ><br>
> > [root@hatest1 etc]# drbdadm -- --overwrite-data-of-peer primary
drbd<br>
> > [root@hatest1 etc]#<br>
> ><br>
> > [root@hatest1 etc]# cat /proc/drbd<br>
> > version: 8.3.0 (api:88/proto:86-89)<br>
> > GIT-hash: 9ba8b93e24d842f0dd3fb1f9b90e8348ddb95829 build by<br>
> > root@hatest1, 2009-02-13 09:00:29<br>
> > 0: cs:SyncSource ro:Primary/Secondary ds:UpToDate/Inconsistent
C r---<br>
> > ns:1239832 nr:0 dw:0 dr:1241792 al:0 bm:74 lo:161 pe:175 ua:223
ap:0<br>
> > ep:1 wo:b oos:301676<br>
> > [===============>....] sync'ed: 80.6% (301676/1535916)K<br>
> > finish: 0:00:06 speed: 48,812 (49,368) K/sec<br>
> > [root@hatest1 etc]# cat /proc/drbd<br>
> > version: 8.3.0 (api:88/proto:86-89)<br>
> > GIT-hash: 9ba8b93e24d842f0dd3fb1f9b90e8348ddb95829 build by<br>
> > root@hatest1, 2009-02-13 09:00:29<br>
> > 0: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r---<br>
> > ns:1535916 nr:0 dw:0 dr:1535916 al:0 bm:94 lo:0 pe:0 ua:0 ap:0
ep:1 wo:b<br>
> > oos:0<br>
> > [root@hatest1 etc]#<br>
> ><br>
> > root@hatest2 etc]# cat /proc/drbd<br>
> > version: 8.3.0 (api:88/proto:86-89)<br>
> > GIT-hash: 9ba8b93e24d842f0dd3fb1f9b90e8348ddb95829 build by<br>
> > root@hatest2, 2009-02-13 09:59:05<br>
> > 0: cs:Connected ro:Secondary/Primary ds:UpToDate/UpToDate C r---<br>
> > ns:0 nr:1535916 dw:1535916 dr:0 al:0 bm:94 lo:0 pe:0 ua:0 ap:0
ep:1 wo:b<br>
> > oos:0<br>
> > [root@hatest2 etc]#<br>
> ><br>
> > [root@hatest1 etc]# drbdadm --stacked create-md drbd-U<br>
> > md_offset 1572773888<br>
> > al_offset 1572741120<br>
> > bm_offset 1572691968<br>
> ><br>
> > Found some data<br>
> > ==> This might destroy existing data! <==<br>
> ><br>
> > Do you want to proceed?<br>
> > [need to type 'yes' to confirm] yes<br>
> ><br>
> > Writing meta data...<br>
> > initialising activity log<br>
> > NOT initialized bitmap<br>
> > New drbd meta data block sucessfully created.<br>
> > [root@hatest1 etc]#<br>
> ><br>
> > [root@hatest1 etc]# drbdadm --stacked up drbd-U<br>
> > [root@hatest1 etc]#<br>
> ><br>
> > [root@hatest1 etc]# drbdadm --stacked primary drbd-U<br>
> > /dev/drbd1: State change failed: (-2) Refusing to be Primary
without at<br>
> > least one UpToDate disk<br>
> > Command 'drbdsetup /dev/drbd1 primary' terminated with exit code
17<br>
> > [root@hatest1 etc]#<br>
> ><br>
> > [root@hatest1 etc]# cat /proc/drbd<br>
> > version: 8.3.0 (api:88/proto:86-89)<br>
> > GIT-hash: 9ba8b93e24d842f0dd3fb1f9b90e8348ddb95829 build by<br>
> > root@hatest1, 2009-02-13 09:00:29<br>
> > 0: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r---<br>
> > ns:1536005 nr:0 dw:89 dr:1536107 al:1 bm:94 lo:0 pe:0 ua:0 ap:0
ep:1<br>
> > wo:b oos:0<br>
> > 1: cs:WFConnection ro:Secondary/Unknown ds:Inconsistent/DUnknown
A r---<br>
> > ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:1535832<br>
> > [root@hatest1 etc]#<br>
> ><br>
> > root@nlstor1 etc]# drbdadm create-md drbd-U<br>
> > md_offset 2147479552<br>
> > al_offset 2147446784<br>
> > bm_offset 2147381248<br>
> ><br>
> > Found some data<br>
> > ==> This might destroy existing data! <==<br>
> ><br>
> > Do you want to proceed?<br>
> > [need to type 'yes' to confirm] yes<br>
> ><br>
> > Writing meta data...<br>
> > initialising activity log<br>
> > NOT initialized bitmap<br>
> > New drbd meta data block sucessfully created.<br>
> > [root@nlstor1 etc]#<br>
> ><br>
> > [root@nlstor1 etc]# drbdadm up drbd-U<br>
> > [root@nlstor1 etc]#<br>
> > [root@hatest1 etc]# cat /proc/drbd<br>
> > version: 8.3.0 (api:88/proto:86-89)<br>
> > GIT-hash: 9ba8b93e24d842f0dd3fb1f9b90e8348ddb95829 build by<br>
> > root@hatest1, 2009-02-13 09:00:29<br>
> > 0: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r---<br>
> > ns:1536006 nr:0 dw:90 dr:1536158 al:1 bm:94 lo:0 pe:0 ua:0 ap:0
ep:1<br>
> > wo:b oos:0<br>
> > 1: cs:Connected ro:Secondary/Secondary ds:Inconsistent/Inconsistent
A r---<br>
> > ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:1535832<br>
> > [root@hatest1 etc]#<br>
> > [root@nlstor1 etc]# cat /proc/drbd<br>
> > version: 8.3.0 (api:88/proto:86-89)<br>
> > GIT-hash: 9ba8b93e24d842f0dd3fb1f9b90e8348ddb95829 build by<br>
> > root@nlstor1, 2009-02-19 11:56:15<br>
> ><br>
> > 1: cs:Connected ro:Secondary/Secondary ds:Inconsistent/Inconsistent
A r---<br>
> > ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:1535832<br>
> > [root@nlstor1 etc]#<br>
> ><br>
> > [root@hatest1 etc]# drbdadm --stacked primary drbd-U<br>
> > /dev/drbd1: State change failed: (-2) Refusing to be Primary
without at<br>
> > least one UpToDate disk<br>
> > Command 'drbdsetup /dev/drbd1 primary' terminated with exit code
17<br>
> > [root@hatest1 etc]#<br>
> ><br>
> ><br>
> > Here is the drbd.conf :<br>
> ><br>
> ><br>
> ><br>
> > global {<br>
> > usage-count no;<br>
> > }<br>
> ><br>
> > common {<br>
> > disk {<br>
> > on-io-error detach; # What to do when the lower level device
errors.<br>
> > }<br>
> ><br>
> > net {<br>
> > max-buffers 2048; #datablock buffers used before writing to disk.<br>
> > ko-count 4; # Peer is dead if this count is exceeded.<br>
> > #on-disconnect reconnect; # Peer disconnected, try to reconnect.<br>
> > }<br>
> ><br>
> > startup {<br>
> > wfc-timeout 0; # drbd init script will wait infinitely on resources.<br>
> > degr-wfc-timeout 120; # 2 minutes.<br>
> > }<br>
> > } # End of common<br>
> ><br>
> > resource drbd {<br>
> > protocol C;<br>
> > syncer {<br>
> > rate 100M; # Synchronization rate, in megebytes. Good for 100Mb
network.<br>
> > al-extents 257; # Must be prime, number of active sets.<br>
> > }<br>
> > on hatest1 {<br>
> > device /dev/drbd0; # The name of our drbd device.<br>
> > disk /dev/hatest_vg/vol01; # Partition we wish drbd
to use.<br>
> > address 192.168.36.130:7788; # node0 IP address and port number.<br>
> > meta-disk internal; # Stores meta-data in lower portion of disk.<br>
> > }<br>
> > on hatest2 {<br>
> > device /dev/drbd0; # Our drbd device, must match node0.<br>
> > disk /dev/hatest_vg/vol01; # Partition we wish drbd
to use.<br>
> > address 192.168.36.129:7788; # node0 IP address and port number.<br>
> > meta-disk internal; # Stores meta-data in lower portion of disk.<br>
> > }<br>
> > } # End of resource drbd<br>
> ><br>
> > resource drbd-U {<br>
> > protocol A;<br>
> ><br>
> > syncer {<br>
> > rate 30M;<br>
> > al-extents 257;<br>
> > }<br>
> ><br>
> > stacked-on-top-of drbd {<br>
> > device /dev/drbd1;<br>
> > address 165.115.204.197:7788;<br>
> > }<br>
> ><br>
> > on nlstor1 {<br>
> > device /dev/drbd1; # The name of our drbd device.<br>
> > disk /dev/VolGroup00/LogVol02; # Partition we wish
drbd to use.<br>
> > address 165.115.163.52:7788; # node0 IP address and port number.<br>
> > meta-disk internal; # Stores meta-data in lower portion of disk<br>
> > }<br>
> > } # End of resource drbd-U<br>
> ><br>
> ><br>
> ><br>
> ><br>
> > ------------------------------------------------------------------------<br>
> ><br>
> > _______________________________________________<br>
> > drbd-user mailing list<br>
> > drbd-user@lists.linbit.com<br>
> > http://lists.linbit.com/mailman/listinfo/drbd-user<br>
</tt></font>
<br><font size=2><tt>> <br>
> ------------------------------<br>
</tt></font>
<br><font size=2><tt>> _______________________________________________<br>
> drbd-user mailing list<br>
> drbd-user@lists.linbit.com<br>
> http://lists.linbit.com/mailman/listinfo/drbd-user<br>
</tt></font>
<br><font size=2><tt>> <br>
> End of drbd-user Digest, Vol 55, Issue 32<br>
> *****************************************</tt></font>