<br><font size=2><tt>It seems like the "out-of-sync" log messages
are output because the data<br>
in those sectors was changing during the verification.<br>
</tt></font>
<br><font size=2><tt>Here's how I came up with that...<br>
</tt></font>
<br><font size=2><tt>For a /var/log/messages statement like this (notice
the time stamp):<br>
May 20 14:30:19 wimpas2 kernel: drbd0: Out of sync: start=137739248,<br>
size=8 (sectors)<br>
</tt></font>
<br><font size=2><tt>We can run a "dd" command to peek at what
data it's talking about on<br>
both servers:<br>
(on wimpas1): sudo dd if=/dev/mapper/VolGroup01-LogVol00 iflag=direct<br>
bs=512 skip=137739248 count=8 of=/tmp/wimpas1-drbd-oos<br>
</tt></font>
<br><font size=2><tt>(on wimpas2): sudo dd if=/dev/mapper/VolGroup01-LogVol00
iflag=direct<br>
bs=512 skip=137739248 count=8 of=/tmp/wimpas2-drbd-oos<br>
</tt></font>
<br><font size=2><tt>Comparing the two output files using "diff"
showed they were the same,<br>
so that indicates replication worked properly.<br>
</tt></font>
<br><font size=2><tt>Looking inside the files showed they were polling
logs with timestamps<br>
from the same time that the /var/log/messages statement was output:<br>
</tt></font>
<br><font size=2><tt>eg) (snipped for brevity, notice the time stamps 20th
day, 14:30:16 -<br>
14:30:22)<br>
time:20143016 REC fd:21 ff1216060100ef57000000000000f78f<br>
time:20143016 TRA fd:21 12ff14000100e0a6 size:8 dur:0 OK<br>
10ff803301001d190000030006001805416828285ac3075014070a37644646460000001919040505050505005701356014010200000000000a00015eba
size:61 dur:0 OK<br>
time:20143017 REC fd:21 ff0f160601002763000000000000f78f<br>
time:20143017 TRA fd:21 0fff1400010097c9 size:8 dur:0 OK<br>
12ff80330100154f0001030006001805416828285ac3075014070a37644646460000001919040505050505005300975014010200000000000a00048d21
size:61 dur:0 OK<br>
time:20143017 REC fd:21 ff1016060100f9df000000000000f78f<br>
time:20143017 TRA fd:21 10ff14000100e8f0 size:8 dur:0 OK<br>
0fff8033010062200000030006001805416828285ac3075014070a37644646460000001919040505050505005700974014010200000000000a000173b8
size:61 dur:0 OK<br>
time:20143019 REC fd:21 ff1216060100ef57000000000000f78f<br>
time:20143019 TRA fd:21 12ff14000100e0a6 size:8 dur:0 OK<br>
10ff803301001d190000030006001805416828285ac3075014070a37644646460000001919040505050505005701356014010200000000000a00015eba
size:61 dur:0 OK<br>
time:20143019 REC fd:21 ff0f160601002763000000000000f78f<br>
time:20143019 TRA fd:21 0fff1400010097c9 size:8 dur:0 OK<br>
12ff80330100154f0001030006001805416828285ac3075014070a37644646460000001919040505050505005300975014010200000000000a00048d21
size:61 dur:0 OK<br>
time:20143020 REC fd:21 ff1016060100f9df000000000000f78f<br>
time:20143020 TRA fd:21 10ff14000100e8f0 size:8 dur:0 OK<br>
0fff8033010062200000030006001805416828285ac3075014070a37644646460000001919040505050505005700974014010200000000000a000173b8
size:61 dur:0 OK<br>
time:20143021 REC fd:21 ff1216060100ef57000000000000f78f<br>
time:20143021 TRA fd:21 12ff14000100e0a6 size:8 dur:0 OK<br>
10ff803301001d190000030006001805416828285ac3075014070a37644646460000001919040505050505005701356014010200000000000a00015eba
size:61 dur:0 OK<br>
time:20143022 REC fd:21 ff0f160601002763000000000000f78f<br>
time:20143022 TRA fd:21 0fff1400010097c9 size:8 dur:0 OK<br>
</tt></font>
<br>
<br><font size=2><tt>So, the theory right now is that the "out-of-sync"
messages were because<br>
the data in those sectors was changing during the verification and the<br>
"0 KB (0 bits) marked out-of-sync" means DRBD realized that.
<br>
</tt></font>
<br>
<br>
<br><font size=2><tt>David Livingstone/LIVING03/CNR/CA wrote on 2009/05/20
16:44:26:<br>
<br>
> I have a two-node cluster(wimpas1/2) running drbd 8.3.1 which<br>
> I just enabled for online verification(verify-alg crc32c).<br>
> When I ran it for the first time today I received a number of<br>
> "Out-of-sync" messages which I subsequently corrected by<br>
> disconnecting and connecting the resource. After some<br>
> successful failover tests(running latest heartbeat/pacemaker)<br>
> I then ran "drbdadm verify r0" again and to my surprise
found<br>
> more "Out-of-sync" messages.</tt></font>
<br><font size=2><tt>> <br>
> The drbd link is good with no reported errors.<br>
> Ideas ? While the verify is running changes are<br>
> being made to the disk - do I really have errors ?<br>
> From the logs below does the "0 KB (0 bits) marked out-of-sync"<br>
> really mean I do not have any errors ?</tt></font>
<br><font size=2><tt>> <br>
> Thanks<br>
</tt></font>
<br><font size=2><tt>> <br>
> Background :<br>
> - 2 x Proliant DL380G5 with SAS drives and</tt></font>
<br><font size=2><tt>> Raid 6 /dev/mapper/VolGroup01-LogVol00 ext3 drbd
partition.<br>
> - Drbd 8.3.1 built from source.<br>
> - Latest RH 5.3 with kernel 2.6.18-128.1.6.el5PAE.<br>
> - drbd link is over 10Gb nic : HP NC510C(NetXen) using</tt></font>
<br><font size=2><tt>> nx_nic-3.4.337-1 and nx_lsa-3.4.337-1. The offload<br>
> feature(nx_lsa) is not used.</tt></font>
<br><font size=2><tt>> <br>
> Given below :<br>
> 1. First test of verify.<br>
> 2. Second test of verify.<br>
> 3. drbd.conf</tt></font>
<br><font size=2><tt>> <br>
> 1. First test of verify :<br>
</tt></font>
<br><font size=2><tt>> - test verify :<br>
> - [root@wimpas2 etc]# drbd-overview</tt></font>
<br><font size=2><tt>> 0:r0 Connected Primary/Secondary UpToDate/UpToDate
C r---- /drbd <br>
> ext3 270G 106G 151G 42%<br>
> - Run the verify on resource r0 :</tt></font>
<br><font size=2><tt>> - [root@wimpas2 etc]# drbdadm verify r0<br>
> - idle goes from 88% to 79%<br>
> - drbd-overview shows verify is ongoing however it does not show the</tt></font>
<br><font size=2><tt>> progress of the verify :<br>
> - [root@wimpas2 etc]# drbd-overview</tt></font>
<br><font size=2><tt>> 0:r0 VerifyS Primary/Secondary UpToDate/UpToDate
C r---- /drbd ext3<br>
> 270G 106G 151G 42%<br>
> - To show the progress we need to "cat /proc/drbd" :</tt></font>
<br><font size=2><tt>> [root@wimpas2 etc]# cat /proc/drbd<br>
> version: 8.3.1 (api:88/proto:86-89)<br>
> GIT-hash: fd40f4a8f9104941537d1afc8521e584a6d3003c build by <br>
> root@wimpas2, 2009-04-16 11:32:59</tt></font>
<br><font size=2><tt>> 0: cs:VerifyS ro:Primary/Secondary ds:UpToDate/UpToDate
C r----<br>
> ns:1602753144 nr:408740 dw:1603218784 dr:204343509 al:14977667 bm:<br>
> 1160 lo:139 pe:126 ua:638 ap:25 ep:1 wo:d oos:0</tt></font>
<br><font size=2><tt>> 42% 30793593/71661420<br>
> [root@wimpas2 etc]# cat /proc/drbd<br>
> version: 8.3.1 (api:88/proto:86-89)<br>
> GIT-hash: fd40f4a8f9104941537d1afc8521e584a6d3003c build by <br>
> root@wimpas2, 2009-04-16 11:32:59</tt></font>
<br><font size=2><tt>> 0: cs:VerifyS ro:Primary/Secondary ds:UpToDate/UpToDate
C r----<br>
> ns:1605444232 nr:408740 dw:1605909876 dr:263949733 al:15006416 bm:<br>
> 1160 lo:215 pe:499 ua:213 ap:2 ep:1 wo:d oos:0</tt></font>
<br><font size=2><tt>> 63% 45596210/71661420<br>
> [root@wimpas2 etc]# cat /proc/drbd<br>
> version: 8.3.1 (api:88/proto:86-89)<br>
> GIT-hash: fd40f4a8f9104941537d1afc8521e584a6d3003c build by <br>
> root@wimpas2, 2009-04-16 11:32:59</tt></font>
<br><font size=2><tt>> 0: cs:VerifyS ro:Primary/Secondary ds:UpToDate/UpToDate
C r----<br>
> ns:1609901224 nr:408740 dw:1610366868 dr:364980653 al:15058780 bm:<br>
> 1160 lo:151 pe:64 ua:146 ap:5 ep:1 wo:d oos:0</tt></font>
<br><font size=2><tt>> 98% 70637034/71661420<br>
> [root@wimpas2 etc]# cat /proc/drbd<br>
> version: 8.3.1 (api:88/proto:86-89)<br>
> GIT-hash: fd40f4a8f9104941537d1afc8521e584a6d3003c build by <br>
> root@wimpas2, 2009-04-16 11:32:59</tt></font>
<br><font size=2><tt>> 0: cs:VerifyS ro:Primary/Secondary ds:UpToDate/UpToDate
C r----<br>
> ns:1610031364 nr:408740 dw:1610497008 dr:368031373 al:15060068 bm:<br>
> 1160 lo:160 pe:112 ua:153 ap:7 ep:1 wo:d oos:0</tt></font>
<br><font size=2><tt>> 99% 71392390/71661420<br>
> [root@wimpas2 etc]# cat /proc/drbd<br>
> version: 8.3.1 (api:88/proto:86-89)<br>
> GIT-hash: fd40f4a8f9104941537d1afc8521e584a6d3003c build by <br>
> root@wimpas2, 2009-04-16 11:32:59</tt></font>
<br><font size=2><tt>> 0: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate
C r----<br>
> ns:1610156492 nr:408740 dw:1610622136 dr:369146845 al:15061320 bm:<br>
> 1160 lo:4 pe:0 ua:0 ap:4 ep:1 wo:d oos:0</tt></font>
<br><font size=2><tt>> [root@wimpas2 etc]# drbd-overview<br>
> 0:r0 Connected Primary/Secondary UpToDate/UpToDate C r---- /drbd
<br>
> ext3 270G 108G 148G 43%</tt></font>
<br><font size=2><tt>> [root@wimpas2 etc]#<br>
</tt></font>
<br><font size=2><tt>> - from messages log :<br>
</tt></font>
<br><font size=2><tt>> May 20 08:36:20 wimpas1 kernel: drbd0: conn(
Connected -> VerifyT )<br>
> May 20 08:51:42 wimpas1 kernel: drbd0: Out of sync: start=53862808,
<br>
> size=8 (sectors)<br>
> May 20 08:51:47 wimpas1 kernel: drbd0: Out of sync: start=54175416,
<br>
> size=8 (sectors)<br>
> May 20 08:51:50 wimpas1 kernel: drbd0: Out of sync: start=54300672,
<br>
> size=8 (sectors)<br>
> May 20 08:52:05 wimpas1 kernel: drbd0: Out of sync: start=55233848,
<br>
> size=8 (sectors)<br>
> May 20 09:16:22 wimpas1 kernel: drbd0: Out of sync: start=140359968,<br>
> size=8 (sectors)<br>
> May 20 11:22:41 wimpas1 kernel: drbd0: Online verify done (total
<br>
> 9981 sec; paused 0 sec; 28716 K/sec)<br>
> May 20 11:22:41 wimpas1 kernel: drbd0: conn( VerifyT -> Connected
)<br>
> May 20 11:22:41 wimpas1 kernel: drbd0: Writing the whole bitmap, due<br>
> to failed kmalloc<br>
> May 20 11:22:41 wimpas1 kernel: drbd0: 0 KB (0 bits) marked out-of-<br>
> sync by on disk bit-map.<br>
</tt></font>
<br><font size=2><tt>> - now on wimpas2 do a :<br>
> - drbdadm disconnect r0<br>
> - drbdadm connect r0<br>
> This should correct out-of-sync blocks :</tt></font>
<br><font size=2><tt>> <br>
> - on wimpas2 :<br>
</tt></font>
<br><font size=2><tt>> [root@wimpas2 etc]# drbdadm disconnect r0<br>
> [root@wimpas2 etc]# drbdadm connect r0<br>
</tt></font>
<br><font size=2><tt>> - From messages log on wimpas1 :<br>
</tt></font>
<br><font size=2><tt>> May 20 11:25:49 wimpas1 kernel: drbd0: peer(
Primary -> Unknown ) <br>
> conn( Connected -> TearDown ) pdsk( UpToDate -> DUnknown )<br>
> May 20 11:25:49 wimpas1 kernel: drbd0: asender terminated<br>
> May 20 11:25:49 wimpas1 kernel: drbd0: Terminating asender thread<br>
> May 20 11:25:49 wimpas1 kernel: drbd0: Connection closed<br>
> May 20 11:25:49 wimpas1 kernel: drbd0: conn( TearDown -> Unconnected
)<br>
> May 20 11:25:49 wimpas1 kernel: drbd0: receiver terminated<br>
> May 20 11:25:49 wimpas1 kernel: drbd0: Restarting receiver thread<br>
> May 20 11:25:49 wimpas1 kernel: drbd0: receiver (re)started<br>
> May 20 11:25:49 wimpas1 kernel: drbd0: conn( Unconnected -> WFConnection
)<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: Handshake successful: Agreed
<br>
> network protocol version 89<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: conn( WFConnection -> WFReportParams
)<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: Starting asender thread (from<br>
> drbd0_receiver [4132])<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: data-integrity-alg: <not-used><br>
> May 20 11:25:56 wimpas1 kernel: drbd0: drbd_sync_handshake:<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: self A33677DBB2985460:<br>
> 0000000000000000:6D2B4B9CDDBDEFD6:37F8B9BC0B605BA7 bits:0 flags:0<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: peer 243B1079C9753DEB:<br>
> A33677DBB2985461:6D2B4B9CDDBDEFD6:37F8B9BC0B605BA7 bits:1319 flags:0<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: uuid_compare()=-1 by rule 5<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: peer( Unknown -> Primary
) <br>
> conn( WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate
)<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: conn( WFBitMapT -> WFSyncUUID
)<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: helper command: /sbin/drbdadm<br>
> before-resync-target minor-0<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: helper command: /sbin/drbdadm<br>
> before-resync-target minor-0 exit code 0 (0x0)<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: conn( WFSyncUUID -> <br>
> SyncTarget ) disk( UpToDate -> Inconsistent )<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: Began resync as SyncTarget
<br>
> (will sync 5276 KB [1319 bits set]).<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: Resync done (total 1 sec; <br>
> paused 0 sec; 5276 K/sec)<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: conn( SyncTarget -> Connected<br>
> ) disk( Inconsistent -> UpToDate )<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: helper command: /sbin/drbdadm<br>
> after-resync-target minor-0<br>
> May 20 11:25:56 wimpas1 kernel: drbd0: helper command: /sbin/drbdadm<br>
> after-resync-target minor-0 exit code 0 (0x0)<br>
</tt></font>
<br><font size=2><tt>> - From messages log on wimpas2 :<br>
</tt></font>
<br><font size=2><tt>> May 20 11:25:56 wimpas2 kernel: drbd0: conn(
StandAlone -> Unconnected )<br>
> May 20 11:25:56 wimpas2 kernel: drbd0: Starting receiver thread <br>
> (from drbd0_worker [4143])<br>
> May 20 11:25:56 wimpas2 kernel: drbd0: receiver (re)started<br>
> May 20 11:25:56 wimpas2 kernel: drbd0: conn( Unconnected -> WFConnection
)<br>
> May 20 11:25:56 wimpas2 kernel: drbd0: Handshake successful: Agreed
<br>
> network protocol version 89<br>
> May 20 11:25:56 wimpas2 kernel: drbd0: conn( WFConnection -> WFReportParams
)<br>
> May 20 11:25:56 wimpas2 kernel: drbd0: Starting asender thread (from<br>
> drbd0_receiver [384])<br>
> May 20 11:25:56 wimpas2 kernel: drbd0: data-integrity-alg: <not-used><br>
> May 20 11:25:56 wimpas2 kernel: drbd0: drbd_sync_handshake:<br>
> May 20 11:25:56 wimpas2 kernel: drbd0: self 243B1079C9753DEB:<br>
> A33677DBB2985461:6D2B4B9CDDBDEFD6:37F8B9BC0B605BA7 bits:1319 flags:0<br>
> May 20 11:25:56 wimpas2 kernel: drbd0: peer A33677DBB2985460:<br>
> 0000000000000000:6D2B4B9CDDBDEFD6:37F8B9BC0B605BA7 bits:0 flags:0<br>
> May 20 11:25:56 wimpas2 kernel: drbd0: uuid_compare()=1 by rule 7<br>
> May 20 11:25:56 wimpas2 kernel: drbd0: peer( Unknown -> Secondary
) <br>
> conn( WFReportParams -> WFBitMapS ) pdsk( DUnknown -> UpToDate
)<br>
> May 20 11:25:56 wimpas2 kernel: drbd0: conn( WFBitMapS -> SyncSource<br>
> ) pdsk( UpToDate -> Inconsistent )<br>
> May 20 11:25:56 wimpas2 kernel: drbd0: Began resync as SyncSource
<br>
> (will sync 5276 KB [1319 bits set]).<br>
> May 20 11:25:56 wimpas2 kernel: drbd0: Resync done (total 1 sec; <br>
> paused 0 sec; 5276 K/sec)<br>
> May 20 11:25:56 wimpas2 kernel: drbd0: conn( SyncSource -> Connected<br>
> ) pdsk( Inconsistent -> UpToDate )<br>
</tt></font>
<br><font size=2><tt>> <br>
> 2. Second test of verify.<br>
</tt></font>
<br><font size=2><tt>> - [root@wimpas2]# drbdadm verify r0<br>
</tt></font>
<br><font size=2><tt>> - on wimpas we are still getting Out of sync
:<br>
> [root@wimpas2 ~]# cat /proc/drbd<br>
> version: 8.3.1 (api:88/proto:86-89)<br>
> GIT-hash: fd40f4a8f9104941537d1afc8521e584a6d3003c build by <br>
> root@wimpas2, 2009-04-16 11:32:59</tt></font>
<br><font size=2><tt>> 0: cs:VerifyS ro:Primary/Secondary ds:UpToDate/UpToDate
C r---b<br>
> ns:8823180 nr:520920 dw:9344100 dr:213062745 al:100758 bm:591 lo:136<br>
> pe:102 ua:136 ap:0 ep:1 wo:d oos:0</tt></font>
<br><font size=2><tt>> 74% 53161685/71661420<br>
> [root@wimpas2 ~]# cat /proc/drbd<br>
> version: 8.3.1 (api:88/proto:86-89)<br>
> GIT-hash: fd40f4a8f9104941537d1afc8521e584a6d3003c build by <br>
> root@wimpas2, 2009-04-16 11:32:59</tt></font>
<br><font size=2><tt>> 0: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate
C r----<br>
> ns:11781808 nr:520920 dw:12302728 dr:287072981 al:135343 bm:591 lo:0<br>
> pe:0 ua:0 ap:0 ep:1 wo:d oos:0</tt></font>
<br><font size=2><tt>> <br>
> - from messages log :<br>
</tt></font>
<br><font size=2><tt>> May 20 13:50:53 wimpas1 kernel: drbd0: conn(
Connected -> VerifyT )<br>
> May 20 14:30:19 wimpas1 kernel: drbd0: Out of sync: start=137739248,<br>
> size=8 (sectors)<br>
> May 20 14:35:37 wimpas1 kernel: drbd0: Out of sync: start=156313064,<br>
> size=8 (sectors)<br>
> May 20 14:39:00 wimpas1 kernel: drbd0: Out of sync: start=168175112,<br>
> size=8 (sectors)<br>
> May 20 14:39:32 wimpas1 kernel: drbd0: Out of sync: start=170062360,<br>
> size=8 (sectors)<br>
> May 20 14:45:31 wimpas1 kernel: drbd0: Out of sync: start=190982904,<br>
> size=8 (sectors)<br>
> May 20 14:45:45 wimpas1 kernel: drbd0: Out of sync: start=191782000,<br>
> size=8 (sectors)<br>
> May 20 14:45:50 wimpas1 kernel: drbd0: Out of sync: start=192029480,<br>
> size=8 (sectors)<br>
> May 20 14:47:07 wimpas1 kernel: drbd0: Out of sync: start=196547400,<br>
> size=8 (sectors)<br>
> May 20 14:56:18 wimpas1 kernel: drbd0: Out of sync: start=228776888,<br>
> size=8 (sectors)<br>
> May 20 14:56:22 wimpas1 kernel: drbd0: Out of sync: start=229022968,<br>
> size=8 (sectors)<br>
> May 20 14:56:22 wimpas1 kernel: drbd0: Out of sync: start=229047480,<br>
> size=8 (sectors)<br>
> May 20 14:56:24 wimpas1 kernel: drbd0: Out of sync: start=229145752,<br>
> size=8 (sectors)<br>
> May 20 14:56:25 wimpas1 kernel: drbd0: Out of sync: start=229198968,<br>
> size=8 (sectors)<br>
> May 20 14:56:26 wimpas1 kernel: drbd0: Out of sync: start=229248104,<br>
> size=8 (sectors)<br>
> May 20 14:56:27 wimpas1 kernel: drbd0: Out of sync: start=229289008,<br>
> size=8 (sectors)<br>
> May 20 16:37:54 wimpas1 kernel: drbd0: Online verify done (total
<br>
> 10021 sec; paused 0 sec; 28604 K/sec)<br>
> May 20 16:37:54 wimpas1 kernel: drbd0: conn( VerifyT -> Connected
)<br>
> May 20 16:37:54 wimpas1 kernel: drbd0: Writing the whole bitmap, due<br>
> to failed kmalloc<br>
> May 20 16:37:54 wimpas1 kernel: drbd0: 0 KB (0 bits) marked out-of-<br>
> sync by on disk bit-map.<br>
</tt></font>
<br><font size=2><tt>> <br>
> 3. drbd.conf<br>
</tt></font>
<br><font size=2><tt>> global {<br>
> minor-count 1;<br>
> }<br>
</tt></font>
<br><font size=2><tt>> resource r0 {<br>
> protocol C;<br>
</tt></font>
<br><font size=2><tt>> on wimpas1 {<br>
> device /dev/drbd0; # The name of our drbd device.<br>
> disk /dev/mapper/VolGroup01-LogVol00; # Partition we
wish drbd to use.<br>
> address 192.168.36.129:7788; # node0 IP address and port number.<br>
> meta-disk internal; # Stores meta-data in lower portion of hda5.<br>
> }<br>
</tt></font>
<br><font size=2><tt>> on wimpas2 {<br>
> device /dev/drbd0; # Our drbd device, must match node0.<br>
> disk /dev/mapper/VolGroup01-LogVol00; # Partition we
wish drbd to use.<br>
> address 192.168.36.130:7788; # node0 IP address and port number.<br>
> meta-disk internal; # Stores meta-data in lower portion of hda5.<br>
> }<br>
</tt></font>
<br><font size=2><tt>> disk {<br>
> on-io-error detach; # What to do when the lower level device errors.<br>
> }<br>
</tt></font>
<br><font size=2><tt>> net {<br>
> max-buffers 2048; #datablock buffers used before writing to disk.<br>
> ko-count 4; # Peer is dead if this count is exceeded.<br>
> #on-disconnect reconnect; # Peer disconnected, try to reconnect.<br>
> }<br>
</tt></font>
<br><font size=2><tt>> syncer {<br>
> rate 29M;<br>
> #rate 143M; # Used for first sync<br>
> #group 1; # Used for grouping resources, parallel sync.<br>
> al-extents 257; # Must be prime, number of active sets.<br>
> verify-alg crc32c;<br>
> }<br>
</tt></font>
<br><font size=2><tt>> startup {<br>
> wfc-timeout 120; # drbd init script will wait 2 minutes - 0 is indefinite.<br>
> degr-wfc-timeout 120; # 2 minutes.<br>
> }<br>
> } # End of resource</tt></font>