<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On 17 September 2015 at 21:25, Eric Blevins <span dir="ltr"><<a href="mailto:ericlb100@gmail.com" target="_blank">ericlb100@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">The nodes marked diskless are just that, diskless.<br>
Wherever its diskless no data is being written.<br>
<br>
DRBD will read/write from the other up2date node when the local node is diskless<br>
Such as resource 1 is reading/writing all data from node2.<br>
<br></blockquote><div><br></div><div>ok, that's what i thought was happening, nice to have it confirmed.</div><div>that means if necessary (ie. last resort) i can completely remove node 1 and rebuild it from scratch.<br></div><div><br></div><div>what confused me is the diskless resources on node 1 can't be writing data, and the resources on node 2 are fully up to date, so why is it node 2 that shows data like oos:1825092</div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
You need to figure out why those resources are diskless and fix it.<br>
<br>
What do your DRBD configs look like?<br></blockquote><div><br></div><div><br></div><div><div><br></div><div><br></div><div>global {</div><div><span class="" style="white-space:pre"> </span>usage-count no;</div><div>}</div><div><br></div><div><br></div><div>resource iscsi.config {</div><div><span class="" style="white-space:pre"> </span>protocol C;</div><div><br></div><div><span class="" style="white-space:pre"> </span>handlers {</div><div><span class="" style="white-space:pre"> </span>pri-on-incon-degr "echo o > /proc/sysrq-trigger ; halt -f";</div><div><span class="" style="white-space:pre"> </span>pri-lost-after-sb "echo o > /proc/sysrq-trigger ; halt -f";</div><div><span class="" style="white-space:pre"> </span>local-io-error "echo o > /proc/sysrq-trigger ; halt -f";</div><div><span class="" style="white-space:pre"> </span>outdate-peer "/usr/lib/heartbeat/drbd-peer-outdater -t 5";</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>startup {</div><div>#<span class="" style="white-space:pre"> </span>become-primary-on nas1;</div><div><span class="" style="white-space:pre"> </span>wfc-timeout 120;</div><div><span class="" style="white-space:pre"> </span>degr-wfc-timeout 120;</div><div><span class="" style="white-space:pre"> </span>}</div><div><span class="" style="white-space:pre"> </span></div><div><span class="" style="white-space:pre"> </span>disk {</div><div><span class="" style="white-space:pre"> </span>on-io-error detach;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>net {</div><div><span class="" style="white-space:pre"> </span>cram-hmac-alg sha1;</div><div><span class="" style="white-space:pre"> </span>shared-secret "password";</div><div><span class="" style="white-space:pre"> </span>after-sb-0pri discard-zero-changes;</div><div><span class="" style="white-space:pre"> </span>after-sb-1pri discard-secondary;</div><div><span class="" style="white-space:pre"> </span>after-sb-2pri disconnect;<span class="" style="white-space:pre"> </span></div><div><span class="" style="white-space:pre"> </span>rr-conflict disconnect;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>syncer {</div><div><span class="" style="white-space:pre"> </span>rate 30M;</div><div><span class="" style="white-space:pre"> </span>verify-alg sha1;</div><div><span class="" style="white-space:pre"> </span>al-extents 257;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>on nas1 {</div><div><span class="" style="white-space:pre"> </span>device /dev/drbd0;</div><div><span class="" style="white-space:pre"> </span>disk /dev/sdb1;</div><div><span class="" style="white-space:pre"> </span>address <a href="http://192.168.61.1:7788">192.168.61.1:7788</a>;</div><div><span class="" style="white-space:pre"> </span>meta-disk /dev/sda2[0];</div><div><span class="" style="white-space:pre"> </span>}</div><div><span class="" style="white-space:pre"> </span></div><div><span class="" style="white-space:pre"> </span>on nas2 {</div><div><span class="" style="white-space:pre"> </span>device /dev/drbd0;</div><div><span class="" style="white-space:pre"> </span>disk /dev/sdb1;</div><div><span class="" style="white-space:pre"> </span>address <a href="http://192.168.61.2:7788">192.168.61.2:7788</a>;</div><div><span class="" style="white-space:pre"> </span>meta-disk /dev/sda2[0];</div><div><span class="" style="white-space:pre"> </span>}</div><div>}</div><div><br></div><div><br></div><div>resource iscsi.target.0 {</div><div><span class="" style="white-space:pre"> </span>protocol C;</div><div><br></div><div><span class="" style="white-space:pre"> </span>handlers {</div><div><span class="" style="white-space:pre"> </span>pri-on-incon-degr "echo o > /proc/sysrq-trigger ; halt -f";</div><div><span class="" style="white-space:pre"> </span>pri-lost-after-sb "echo o > /proc/sysrq-trigger ; halt -f";</div><div><span class="" style="white-space:pre"> </span>local-io-error "echo o > /proc/sysrq-trigger ; halt -f";</div><div><span class="" style="white-space:pre"> </span>outdate-peer "/usr/lib/heartbeat/drbd-peer-outdater -t 5";</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>startup {</div><div>#<span class="" style="white-space:pre"> </span>become-primary-on nas1;</div><div><span class="" style="white-space:pre"> </span>wfc-timeout 120;</div><div><span class="" style="white-space:pre"> </span>degr-wfc-timeout 120;</div><div><span class="" style="white-space:pre"> </span>}</div><div><span class="" style="white-space:pre"> </span></div><div><span class="" style="white-space:pre"> </span>disk {</div><div><span class="" style="white-space:pre"> </span>on-io-error detach;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>net {</div><div><span class="" style="white-space:pre"> </span>cram-hmac-alg sha1;</div><div><span class="" style="white-space:pre"> </span>shared-secret "password";</div><div><span class="" style="white-space:pre"> </span>after-sb-0pri discard-zero-changes;</div><div><span class="" style="white-space:pre"> </span>after-sb-1pri discard-secondary;</div><div><span class="" style="white-space:pre"> </span>after-sb-2pri disconnect;<span class="" style="white-space:pre"> </span></div><div><span class="" style="white-space:pre"> </span>rr-conflict disconnect;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>syncer {</div><div><span class="" style="white-space:pre"> </span>rate 30M;</div><div><span class="" style="white-space:pre"> </span>verify-alg sha1;</div><div><span class="" style="white-space:pre"> </span>al-extents 257;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>on nas1 {</div><div><span class="" style="white-space:pre"> </span>device /dev/drbd1;</div><div><span class="" style="white-space:pre"> </span>disk /dev/sdb2;</div><div><span class="" style="white-space:pre"> </span>address <a href="http://192.168.61.1:7789">192.168.61.1:7789</a>;</div><div><span class="" style="white-space:pre"> </span>meta-disk /dev/sda2[1];</div><div><span class="" style="white-space:pre"> </span>}</div><div><span class="" style="white-space:pre"> </span></div><div><span class="" style="white-space:pre"> </span>on nas2 {</div><div><span class="" style="white-space:pre"> </span>device /dev/drbd1;</div><div><span class="" style="white-space:pre"> </span>disk /dev/sdb2;</div><div><span class="" style="white-space:pre"> </span>address <a href="http://192.168.61.2:7789">192.168.61.2:7789</a>;</div><div><span class="" style="white-space:pre"> </span>meta-disk /dev/sda2[1];</div><div><span class="" style="white-space:pre"> </span>}</div><div>}</div><div><br></div><div>resource iscsi.ocfs2 {</div><div><span class="" style="white-space:pre"> </span>protocol C;</div><div><span class="" style="white-space:pre"> </span></div><div><span class="" style="white-space:pre"> </span>handlers {</div><div><span class="" style="white-space:pre"> </span>pri-on-incon-degr "echo o > /proc/sysrq-trigger ; halt -f";</div><div><span class="" style="white-space:pre"> </span>pri-lost-after-sb "echo o > /proc/sysrq-trigger ; halt -f";</div><div><span class="" style="white-space:pre"> </span>local-io-error "echo o > /proc/sysrq-trigger ; halt -f";</div><div><span class="" style="white-space:pre"> </span>outdate-peer "/usr/lib/heartbeat/drbd-peer-outdater -t 5";</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>startup {</div><div><span class="" style="white-space:pre"> </span>become-primary-on nas1;</div><div><span class="" style="white-space:pre"> </span>wfc-timeout 120;</div><div><span class="" style="white-space:pre"> </span>degr-wfc-timeout 120;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>disk {</div><div><span class="" style="white-space:pre"> </span>on-io-error detach;</div><div>#<span class="" style="white-space:pre"> </span>fencing resource-and-stonith;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>syncer {</div><div><span class="" style="white-space:pre"> </span>rate 30M;</div><div><span class="" style="white-space:pre"> </span>verify-alg sha1;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>net {</div><div>#<span class="" style="white-space:pre"> </span>allow-two-primaries;</div><div><span class="" style="white-space:pre"> </span>cram-hmac-alg sha1;</div><div><span class="" style="white-space:pre"> </span>shared-secret "password";</div><div><span class="" style="white-space:pre"> </span>after-sb-0pri discard-zero-changes;</div><div><span class="" style="white-space:pre"> </span>after-sb-1pri discard-secondary;</div><div><span class="" style="white-space:pre"> </span>after-sb-2pri disconnect;</div><div><span class="" style="white-space:pre"> </span>rr-conflict disconnect;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>on nas1 {</div><div><span class="" style="white-space:pre"> </span>device /dev/drbd2;</div><div><span class="" style="white-space:pre"> </span>disk /dev/sdc1;</div><div><span class="" style="white-space:pre"> </span>address <a href="http://192.168.61.1:7790">192.168.61.1:7790</a>;</div><div><span class="" style="white-space:pre"> </span>meta-disk /dev/sda2[2];</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>on nas2 {</div><div><span class="" style="white-space:pre"> </span>device /dev/drbd2;</div><div><span class="" style="white-space:pre"> </span>disk /dev/sdc1;</div><div><span class="" style="white-space:pre"> </span>address <a href="http://192.168.61.2:7790">192.168.61.2:7790</a>;</div><div><span class="" style="white-space:pre"> </span>meta-disk /dev/sda2[2];</div><div><span class="" style="white-space:pre"> </span>}</div><div>}</div><div><br></div><div>resource iscsi.db-bak {</div><div><span class="" style="white-space:pre"> </span>protocol C;</div><div><br></div><div><span class="" style="white-space:pre"> </span>handlers {</div><div><span class="" style="white-space:pre"> </span>pri-on-incon-degr "echo o > /proc/sysrq-trigger ; halt -f";</div><div><span class="" style="white-space:pre"> </span>pri-lost-after-sb "echo o > /proc/sysrq-trigger ; halt -f";</div><div><span class="" style="white-space:pre"> </span>local-io-error "echo o > /proc/sysrq-trigger ; halt -f";</div><div><span class="" style="white-space:pre"> </span>outdate-peer "/usr/lib/heartbeat/drbd-peer-outdater -t 5";</div><div><span class="" style="white-space:pre"> </span>}</div><div><span class="" style="white-space:pre"> </span></div><div><span class="" style="white-space:pre"> </span>startup {</div><div><span class="" style="white-space:pre"> </span>become-primary-on nas1;</div><div><span class="" style="white-space:pre"> </span>wfc-timeout 120;</div><div><span class="" style="white-space:pre"> </span>degr-wfc-timeout 120;</div><div><span class="" style="white-space:pre"> </span>}</div><div> </div><div><span class="" style="white-space:pre"> </span>disk {</div><div><span class="" style="white-space:pre"> </span>on-io-error detach;</div><div>#<span class="" style="white-space:pre"> </span>fencing resource-and-stonith;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>syncer { </div><div><span class="" style="white-space:pre"> </span>rate 30M;</div><div><span class="" style="white-space:pre"> </span>verify-alg sha1;</div><div><span class="" style="white-space:pre"> </span>al-extents 257;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>net {</div><div><span class="" style="white-space:pre"> </span>cram-hmac-alg sha1;</div><div><span class="" style="white-space:pre"> </span>shared-secret "password";</div><div><span class="" style="white-space:pre"> </span>after-sb-0pri discard-zero-changes;</div><div><span class="" style="white-space:pre"> </span>after-sb-1pri discard-secondary;</div><div><span class="" style="white-space:pre"> </span>after-sb-2pri disconnect;</div><div><span class="" style="white-space:pre"> </span>rr-conflict disconnect;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>on nas1 {</div><div><span class="" style="white-space:pre"> </span>device /dev/drbd3;</div><div><span class="" style="white-space:pre"> </span>disk /dev/sdc2;</div><div><span class="" style="white-space:pre"> </span>address <a href="http://192.168.61.1:7791">192.168.61.1:7791</a>;</div><div><span class="" style="white-space:pre"> </span>meta-disk /dev/sda2[3];</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>on nas2 {</div><div><span class="" style="white-space:pre"> </span>device /dev/drbd3;</div><div><span class="" style="white-space:pre"> </span>disk /dev/sdc2;</div><div><span class="" style="white-space:pre"> </span>address <a href="http://192.168.61.2:7791">192.168.61.2:7791</a>;</div><div><span class="" style="white-space:pre"> </span>meta-disk /dev/sda2[3];</div><div><span class="" style="white-space:pre"> </span>}</div><div>}</div><div><br></div><div><br></div><div>resource iscsi.mail {</div><div><span class="" style="white-space:pre"> </span>protocol C;</div><div><br></div><div><span class="" style="white-space:pre"> </span>handlers {</div><div><span class="" style="white-space:pre"> </span>pri-on-incon-degr "echo o > /proc/sysrq-trigger ; halt -f";</div><div><span class="" style="white-space:pre"> </span>pri-lost-after-sb "echo o > /proc/sysrq-trigger ; halt -f";</div><div><span class="" style="white-space:pre"> </span>local-io-error "echo o > /proc/sysrq-trigger ; halt -f";</div><div><span class="" style="white-space:pre"> </span>outdate-peer "/usr/lib/heartbeat/drbd-peer-outdater -t 5";</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>startup {</div><div><span class="" style="white-space:pre"> </span>become-primary-on nas1;</div><div><span class="" style="white-space:pre"> </span>wfc-timeout 120;</div><div><span class="" style="white-space:pre"> </span>degr-wfc-timeout 120;</div><div>}</div><div><span class="" style="white-space:pre"> </span></div><div><span class="" style="white-space:pre"> </span>disk {</div><div><span class="" style="white-space:pre"> </span>on-io-error detach;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>net {</div><div><span class="" style="white-space:pre"> </span>cram-hmac-alg sha1;</div><div><span class="" style="white-space:pre"> </span>shared-secret "password";</div><div><span class="" style="white-space:pre"> </span>after-sb-0pri discard-zero-changes;</div><div><span class="" style="white-space:pre"> </span>after-sb-1pri discard-secondary;</div><div><span class="" style="white-space:pre"> </span>after-sb-2pri disconnect;<span class="" style="white-space:pre"> </span></div><div><span class="" style="white-space:pre"> </span>rr-conflict disconnect;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>syncer {</div><div><span class="" style="white-space:pre"> </span>rate 30M;</div><div><span class="" style="white-space:pre"> </span>verify-alg sha1;</div><div><span class="" style="white-space:pre"> </span>al-extents 257;</div><div><span class="" style="white-space:pre"> </span>}</div><div><br></div><div><span class="" style="white-space:pre"> </span>on nas1 {</div><div><span class="" style="white-space:pre"> </span>device /dev/drbd4;</div><div><span class="" style="white-space:pre"> </span>disk /dev/sdb3;</div><div><span class="" style="white-space:pre"> </span>address <a href="http://192.168.61.1:7792">192.168.61.1:7792</a>;</div><div><span class="" style="white-space:pre"> </span>meta-disk /dev/sda2[4];</div><div><span class="" style="white-space:pre"> </span>}</div><div><span class="" style="white-space:pre"> </span></div><div><span class="" style="white-space:pre"> </span>on nas2 {</div><div><span class="" style="white-space:pre"> </span>device /dev/drbd4;</div><div><span class="" style="white-space:pre"> </span>disk /dev/sdb3;</div><div><span class="" style="white-space:pre"> </span>address <a href="http://192.168.61.2:7792">192.168.61.2:7792</a>;</div><div><span class="" style="white-space:pre"> </span>meta-disk /dev/sda2[4];</div><div><span class="" style="white-space:pre"> </span>}</div><div>}</div><div><br></div></div><div><br></div><div><br></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<br>
On Thu, Sep 17, 2015 at 9:18 AM, Lee Musgrave <<a href="mailto:lee@sclinternet.co.uk">lee@sclinternet.co.uk</a>> wrote:<br>
> Hi,<br>
><br>
> i'm a little confused by this, and i don't want to do anything with these<br>
> systems until i've got some clarity.<br>
><br>
> i'm using drbd 8.3.13 on ubuntu 12.04.3, ( i know i should upgrade, but<br>
> that isn't an option right now).<br>
><br>
> the metadata partition is on /dev/sda2, the os is installed on /dev/sda1<br>
><br>
><br>
> on node1 cat /proc/drbd shows:<br>
><br>
><br>
> 0: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r-----<br>
> ns:40 nr:0 dw:12 dr:1104 al:2 bm:3 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<br>
> 1: cs:Connected ro:Primary/Secondary ds:Diskless/UpToDate C r-----<br>
> ns:2015462262 nr:516042356 dw:1353605609 dr:1812380379 al:67433064 bm:3<br>
> lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<br>
> 2: cs:Connected ro:Primary/Secondary ds:Diskless/UpToDate C r-----<br>
> ns:536493384 nr:80 dw:502334308 dr:1646088 al:28554 bm:0 lo:0 pe:0 ua:0<br>
> ap:0 ep:1 wo:f oos:0<br>
> 3: cs:Connected ro:Primary/Secondary ds:Diskless/UpToDate C r-----<br>
> ns:201451152 nr:0 dw:131716884 dr:84892 al:211 bm:0 lo:0 pe:0 ua:0 ap:0<br>
> ep:1 wo:f oos:0<br>
> 4: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r-----<br>
> ns:3202744 nr:0 dw:3202744 dr:349700 al:57 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1<br>
> wo:f oos:0<br>
><br>
><br>
> on node2 :<br>
><br>
> 0: cs:Connected ro:Secondary/Primary ds:UpToDate/UpToDate C r-----<br>
> ns:0 nr:40 dw:40 dr:0 al:0 bm:3 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<br>
> 1: cs:Connected ro:Secondary/Primary ds:UpToDate/Diskless C r-----<br>
> ns:516043328 nr:2015478830 dw:2015478830 dr:516043328 al:33272078 bm:3<br>
> lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:289286616<br>
> 2: cs:Connected ro:Secondary/Primary ds:UpToDate/Diskless C r-----<br>
> ns:80 nr:536493908 dw:536493908 dr:80 al:536 bm:0 lo:0 pe:0 ua:0 ap:0<br>
> ep:1 wo:f oos:1825092<br>
> 3: cs:Connected ro:Secondary/Primary ds:UpToDate/Diskless C r-----<br>
> ns:0 nr:201451968 dw:201451968 dr:0 al:298 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1<br>
> wo:f oos:91228<br>
> 4: cs:Connected ro:Secondary/Primary ds:UpToDate/UpToDate C r-----<br>
> ns:0 nr:3202744 dw:3202744 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f<br>
> oos:0<br>
><br>
><br>
> 0 is on /dev/sdb1, 1 is on /dev/sdb2, 2 is on /dev/sdc1, 3 is on /dev/sdc2,<br>
> 4 is on /dev/sdb3<br>
><br>
> /dev/sdb and /dev/sdc are 2 separate raid 10 arrays, each of 4 disks.<br>
><br>
><br>
> i don't believe there is any problem with the raid arrays, or their<br>
> composite disks. on node 1, the filesystem is currently mounted readonly, so<br>
> i believe the problem is the os disk, which also has the metadata partition<br>
> on it.<br>
><br>
> does this seem the most likely to you?<br>
><br>
> what's confusing me, is it's the node 2 partitions showing as out-of-sync,<br>
> how? surely it's the diskless partitions that are oos? is it keeping<br>
> everything in memory? are changes actually getting written to the disks on<br>
> node2?<br>
><br>
> as i said, i believe the problem to be access to the metadata, since all 5<br>
> drbd partitions share the same metadata partition, what would be the<br>
> recommended recovery method, i don't even want to try remounting / as rw<br>
> until i've got a bit more information, right now things are still working,<br>
> although in a degraded state, and it's not live, but i want to treat it as<br>
> live so i know i can recover from the same situation when it is in<br>
> production, so downtime or data loss needs to be avoided if at all possible.<br>
><br>
><br>
> thanks<br>
> lee.<br>
><br>
> _______________________________________________<br>
> drbd-user mailing list<br>
> <a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a><br>
> <a href="http://lists.linbit.com/mailman/listinfo/drbd-user" rel="noreferrer" target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
><br>
_______________________________________________<br>
drbd-user mailing list<br>
<a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a><br>
<a href="http://lists.linbit.com/mailman/listinfo/drbd-user" rel="noreferrer" target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
</blockquote></div><br></div></div>