<font size=2 face="sans-serif">Hi all,<br>
<br>
Just a bit nervous on this setup as I have ~4TB of live data on my primary
and I'm about to bring the seconday online (after a couple of weeks from
putting the primary online) and want to make 100% I don't sink the ship.</font>
<br>
<br><font size=2 face="sans-serif">Basically I have setup a ubuntu server
and did the following with drbd.</font>
<br><font size=2 face="sans-serif">(very basic out of the box setup)</font>
<br>
<br><font size=2 face="sans-serif">root@storage00:~# apt-get install drbd8-utils
drbd8-source</font>
<br><font size=2 face="sans-serif">root@storage00:~# vim /etc/drbd.conf</font>
<br><font size=2 face="sans-serif">root@storage00:/etc# cat drbd.conf</font>
<br><font size=2 face="sans-serif">global {</font>
<br><font size=2 face="sans-serif"> usage-count
no;</font>
<br><font size=2 face="sans-serif">}</font>
<br>
<br><font size=2 face="sans-serif">common {</font>
<br><font size=2 face="sans-serif"> syncer {
rate 110M; }</font>
<br><font size=2 face="sans-serif">}</font>
<br><font size=2 face="sans-serif">resource meta {</font>
<br><font size=2 face="sans-serif"> protocol
C;</font>
<br><font size=2 face="sans-serif"> handlers
{</font>
<br><font size=2 face="sans-serif"> pri-on-incon-degr
"echo O > /proc/sysrq-trigger ; halt -f";</font>
<br><font size=2 face="sans-serif"> pri-lost-after-sb
"echo O > /proc/sysrq-trigger ; halt -f";</font>
<br><font size=2 face="sans-serif"> local-io-error
"echo O > /proc/sysrq-trigger ; halt -f";</font>
<br><font size=2 face="sans-serif"> }</font>
<br>
<br><font size=2 face="sans-serif"> startup
{</font>
<br><font size=2 face="sans-serif"> #
wfc-timeout 0;</font>
<br><font size=2 face="sans-serif"> degr-wfc-timeout
120; # 2 minutes.</font>
<br><font size=2 face="sans-serif"> }</font>
<br><font size=2 face="sans-serif"> disk {</font>
<br><font size=2 face="sans-serif"> on-io-error
detach;</font>
<br><font size=2 face="sans-serif"> }</font>
<br>
<br><font size=2 face="sans-serif"> net {</font>
<br><font size=2 face="sans-serif"> after-sb-0pri
disconnect;</font>
<br><font size=2 face="sans-serif"> after-sb-1pri
disconnect;</font>
<br><font size=2 face="sans-serif"> after-sb-2pri
disconnect;</font>
<br><font size=2 face="sans-serif"> rr-conflict
disconnect;</font>
<br><font size=2 face="sans-serif"> }</font>
<br>
<br><font size=2 face="sans-serif"> syncer {</font>
<br><font size=2 face="sans-serif"> #
rate 110M;</font>
<br><font size=2 face="sans-serif"> #
after "r2";</font>
<br><font size=2 face="sans-serif"> al-extents
257;</font>
<br><font size=2 face="sans-serif"> }</font>
<br>
<br><font size=2 face="sans-serif"> on storage00
{</font>
<br><font size=2 face="sans-serif"> device
/dev/drbd0;</font>
<br><font size=2 face="sans-serif"> disk
/dev/sda3;</font>
<br><font size=2 face="sans-serif"> address
192.168.1.10:7788;</font>
<br><font size=2 face="sans-serif"> meta-disk
internal;</font>
<br><font size=2 face="sans-serif"> }</font>
<br>
<br><font size=2 face="sans-serif"> on storage01
{</font>
<br><font size=2 face="sans-serif"> device
/dev/drbd0;</font>
<br><font size=2 face="sans-serif"> disk
/dev/sda3;</font>
<br><font size=2 face="sans-serif"> address
192.168.1.11:7788;</font>
<br><font size=2 face="sans-serif"> meta-disk
internal;</font>
<br><font size=2 face="sans-serif"> }</font>
<br><font size=2 face="sans-serif">}</font>
<br>
<br><font size=2 face="sans-serif">resource data {</font>
<br><font size=2 face="sans-serif"> protocol
C;</font>
<br><font size=2 face="sans-serif"> startup
{</font>
<br><font size=2 face="sans-serif"> wfc-timeout
0; ## Infinite!</font>
<br><font size=2 face="sans-serif"> degr-wfc-timeout
120; ## 2 minutes.</font>
<br><font size=2 face="sans-serif"> }</font>
<br>
<br><font size=2 face="sans-serif"> disk {</font>
<br><font size=2 face="sans-serif"> on-io-error
detach;</font>
<br><font size=2 face="sans-serif"> }</font>
<br>
<br><font size=2 face="sans-serif"> net {</font>
<br><font size=2 face="sans-serif"> #
timeout 60;</font>
<br><font size=2 face="sans-serif"> #
connect-int 10;</font>
<br><font size=2 face="sans-serif"> #
ping-int 10;</font>
<br><font size=2 face="sans-serif"> #
max-buffers 2048;</font>
<br><font size=2 face="sans-serif"> #
max-epoch-size 2048;</font>
<br><font size=2 face="sans-serif"> }</font>
<br>
<br><font size=2 face="sans-serif"> syncer {</font>
<br><font size=2 face="sans-serif"> after
"meta";</font>
<br><font size=2 face="sans-serif"> }</font>
<br>
<br><font size=2 face="sans-serif"> on storage00
{</font>
<br><font size=2 face="sans-serif"> device
/dev/drbd1;</font>
<br><font size=2 face="sans-serif"> disk
/dev/sdb1;</font>
<br><font size=2 face="sans-serif"> address
192.168.1.10:7789;</font>
<br><font size=2 face="sans-serif"> meta-disk
internal;</font>
<br><font size=2 face="sans-serif"> }</font>
<br><font size=2 face="sans-serif"> on storage01
{</font>
<br><font size=2 face="sans-serif"> device
/dev/drbd1;</font>
<br><font size=2 face="sans-serif"> disk
/dev/sdb1;</font>
<br><font size=2 face="sans-serif"> address
192.168.1.11:7789;</font>
<br><font size=2 face="sans-serif"> meta-disk
internal;</font>
<br><font size=2 face="sans-serif"> }</font>
<br><font size=2 face="sans-serif">}</font>
<br>
<br><font size=2 face="sans-serif">root@storage00:~# drbdadm create-md
meta</font>
<br><font size=2 face="sans-serif">root@storage00:~# drbdadm create-md
data</font>
<br><font size=2 face="sans-serif">root@storage00:~# /etc/init.d/drbd start</font>
<br><font size=2 face="sans-serif">root@storage00:~# drbdsetup /dev/drbd0
primary -o</font>
<br><font size=2 face="sans-serif">root@storage00:~# drbdsetup /dev/drbd1
primary -o</font>
<br><font size=2 face="sans-serif">root@storage00:/etc# cat /proc/drbd</font>
<br><font size=2 face="sans-serif">version: 8.3.7 (api:88/proto:86-91)</font>
<br><font size=2 face="sans-serif">GIT-hash: ea9e28dbff98e331a62bcbcc63a6135808fe2917
build by root@storage00, 2010-07-21 18:41:33</font>
<br><font size=2 face="sans-serif"> 0: cs:WFConnection ro:Primary/Unknown
ds:UpToDate/DUnknown C r----</font>
<br><font size=2 face="sans-serif"> ns:0 nr:0 dw:5464 dr:1341
al:18 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:1727396</font>
<br><font size=2 face="sans-serif"> 1: cs:WFConnection ro:Primary/Unknown
ds:UpToDate/DUnknown C r----</font>
<br><font size=2 face="sans-serif"> ns:0 nr:0 dw:678284585
dr:143229358 al:17981154 bm:17981027 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:5833965664</font>
<br>
<br><font size=2 face="sans-serif">So this box has been live for a couple
of weeks now, it's running ietd iscsi, lvm etc, and has around 4TB of data
on drbd1.</font>
<br><font size=2 face="sans-serif">Both machines are connected via a gigabit
switch. They can ping each other on 192.168.1.x interface. (there are 6
nics in the box, 4 for iscsi, 1 for management, 1 dedicated to DRBD).<br>
<br>
Now I want to connect the secondary up (it's identical spec as the primary,
including OS, install etc).</font>
<br><font size=2 face="sans-serif">Here is where I'm at on the secondary:</font>
<br><font size=2 face="sans-serif">root@storage00:~# apt-get install lvm2</font>
<br><font size=2 face="sans-serif">root@storage01:~# apt-get install drbd8-utils
drbd8-source</font>
<br><font size=2 face="sans-serif">root@storage01:~# scp root@storage00:/etc/drbd.conf
/etc/</font>
<br>
<br><font size=2 face="sans-serif">Now I need to reboot here, (due to the
LVM module), now my gut is saying it should all be ok, but of course drbd
is going to fire up on reboot, what is my process from here?</font>
<br><font size=2 face="sans-serif">Will it be ok for the reboot, see as
this will be the first time drbd starts on the secondary and connects to
the primary?</font>
<br><font size=2 face="sans-serif">What needs to be issued for the sync
to start, I have already issued </font>
<br><font size=2 face="sans-serif">root@storage00:~# drbdsetup /dev/drbd0
primary -o</font>
<br><font size=2 face="sans-serif">root@storage00:~# drbdsetup /dev/drbd1
primary -o</font>
<br><font size=2 face="sans-serif">on the primary, will the secondary node
know this and just start syncing?</font>
<br><font size=2 face="sans-serif">Will I have to issue</font>
<br><font size=2 face="sans-serif">drbdadm -- --overwrite-data-of-peer
primary drbd0</font>
<br><font size=2 face="sans-serif">drbdadm -- --overwrite-data-of-peer
primary drbd1</font>
<br><font size=2 face="sans-serif">on the primary node?</font>
<br><font size=2 face="sans-serif"><br>
Regards,<br>
Adam</font>