<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">My Apologies. The actual config looks like this:<div><br class="webkit-block-placeholder"></div><div><blockquote type="cite"><span class="Apple-style-span" style="font-size: 10px; ">global {<br> usage-count no;<br>}<br><br>common {<br><br> syncer {rate 20M;}<br><br> handlers {<br> local-io-error "echo o > /proc/sysrq-trigger ; halt -f";<br> outdate-peer "/sbin/drbd-peer-outdater";<br> }<br><br> startup {<br> wfc-timeout 120; # s<br> degr-wfc-timeout 120; # 2 minutes.<br> }<br><br> disk {<br> on-io-error detach;<br> }<br><br> net {<br> sndbuf-size 512k;<br> max-buffers 2048;<br> unplug-watermark 128;<br> cram-hmac-alg "xxx";<br> shared-secret "xxx";<br> after-sb-0pri disconnect;<br> after-sb-1pri disconnect;<br> after-sb-2pri disconnect;<br> rr-conflict disconnect;<br> }<br><br>}<br><br>resource drbd_sdb1 {<br> protocol C;<br><br> syncer {<br> al-extents 1031;<br> }<br><br> on nfs2.imprev.net {<br> device /dev/drbd0;<br> disk /dev/sdb1;<br> address 216.145.23.104:7788;<br> flexible-meta-disk /dev/sdb2;<br> }<br><br> on nfs1.imprev.net {<br> device /dev/drbd0;<br> disk /dev/sdb1;<br> address 216.145.23.103:7788;<br> flexible-meta-disk /dev/sdb3;<br> }<br>}<br><br>resource drbd_sdb3 {<br> protocol C;<br><br> syncer {<br> al-extents 1031;<br> }<br><br> on nfs2.imprev.net {<br> device /dev/drbd1;<br> disk /dev/sdb3;<br> address 216.145.23.104:7789;<br> flexible-meta-disk /dev/sdb4;<br><br> on nfs1.imprev.net {<br> device /dev/drbd1;<br> disk /dev/sdb2;<br> address 216.145.23.103:7789;<br> flexible-meta-disk /dev/sdb4;<br> }<br>}<br><br>resource drbd_sdb5 {<br> protocol C;<br><br> syncer {<br> al-extents 1031;<br> }<br><br> on nfs2.imprev.net {<br> device /dev/drbd2;<br> disk /dev/sdb5;<br> address 216.145.23.104:7790;<br> flexible-meta-disk /dev/sdb6;<br> }<br><br> on nfs1.imprev.net {<br> device /dev/drbd2;<br> disk /dev/sdb6;<br> address 216.145.23.103:7790;<br> flexible-meta-disk /dev/sdb5;<br> }<br>}</span></blockquote></div><div><br><div><div>On Mar 5, 2008, at 7:12 PM, Ross S. W. Walker wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"> <div> <!-- Converted from text/plain format --><p><font size="2">> NOTE: the SDB devices on nfs2 are numbered differently.<br> <br> Yet in your config they match up.<br> <br> May be a case of putting 2.0TB into a 1.5TB bag.<br> <br> -Ross<br> <br> <br> ----- Original Message -----<br> From: <a href="mailto:drbd-user-bounces@lists.linbit.com">drbd-user-bounces@lists.linbit.com</a> <<a href="mailto:drbd-user-bounces@lists.linbit.com">drbd-user-bounces@lists.linbit.com</a>><br> To: <a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a> <<a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a>><br> Sent: Wed Mar 05 20:52:31 2008<br> Subject: [DRBD-user] DRBD LVM2 Trouble<br> <br> Hey Guys,<br> <br> I have a pretty bad situation on my hands.<br> <br> We had a node configured running DRBD 8.0.6. The goal was to keep this <br> running in standalone mode until we provisioned a matching machine. We <br> purchased the matching machine and finally had it fully configured <br> today. I kicked off the initial sync, and had hoped that we would have <br> both machines in sync within a day or two.<br> <br> This was unfortunately not the case. When I kicked off the sync all <br> seemed well however our application quickly began throwing error's as <br> the primary node became read only. I quickly shut off drbd on the <br> secondary node and attempted to return the original configuration to <br> the primary server. Sadly no amount of back peddling has helped us. We <br> are currently dead in the water.<br> <br> DRBD was configured on the primary node with LVM. We have/had 3 <br> resources configured the first 2 being 2TB in size and the 3rd being <br> 1.4-5TB in size. Since stopping the initial sync I have not been able <br> to mount LVM Volume Group that sits above the three resources. NOTE: <br> the SDB devices on nfs2 are numbered differently.<br> <br> /var/log/messages was giving the following messages:<br> <br> Mar 5 14:38:35 nfs2 kernel: drbd2: rw=0, want=3434534208, <br> limit=3421310910<br> Mar 5 14:38:35 nfs2 kernel: attempt to access beyond end of device<br> Mar 5 14:38:35 nfs2 kernel: drbd2: rw=0, want=3434534216, <br> limit=3421310910<br> Mar 5 14:38:35 nfs2 kernel: attempt to access beyond end of device<br> Mar 5 14:38:35 nfs2 kernel: drbd2: rw=0, want=3434534224, <br> limit=3421310910<br> Mar 5 14:38:35 nfs2 kernel: attempt to access beyond end of device<br> <br> <br> Here is my conf:<br> <br> global {<br> usage-count no;<br> }<br> <br> common {<br> <br> syncer {rate 20M;}<br> <br> handlers {<br> local-io-error "echo o > /proc/sysrq-trigger ; halt -f";<br> outdate-peer "/sbin/drbd-peer-outdater";<br> }<br> <br> startup {<br> wfc-timeout 120; # s<br> degr-wfc-timeout 120; # 2 minutes.<br> }<br> <br> disk {<br> on-io-error detach;<br> }<br> <br> net {<br> sndbuf-size 512k;<br> max-buffers 2048;<br> unplug-watermark 128;<br> cram-hmac-alg "xxx";<br> shared-secret "xxx";<br> after-sb-0pri disconnect;<br> after-sb-1pri disconnect;<br> after-sb-2pri disconnect;<br> rr-conflict disconnect;<br> }<br> <br> }<br> <br> resource drbd_sdb1 {<br> protocol C;<br> <br> syncer {<br> al-extents 1031;<br> }<br> <br> on nfs2.imprev.net {<br> device /dev/drbd0;<br> disk /dev/sdb1;<br> address 216.145.23.104:7788;<br> flexible-meta-disk /dev/sdb2;<br> }<br> <br> on nfs1.imprev.net {<br> device /dev/drbd0;<br> disk /dev/sdb1;<br> address 216.145.23.103:7788;<br> flexible-meta-disk /dev/sdb2;<br> }<br> }<br> <br> resource drbd_sdb3 {<br> protocol C;<br> <br> syncer {<br> al-extents 1031;<br> }<br> <br> on nfs2.imprev.net {<br> device /dev/drbd1;<br> disk /dev/sdb3;<br> address 216.145.23.104:7789;<br> flexible-meta-disk /dev/sdb4;<br> <br> on nfs1.imprev.net {<br> device /dev/drbd1;<br> disk /dev/sdb3;<br> address 216.145.23.103:7789;<br> flexible-meta-disk /dev/sdb4;<br> }<br> }<br> <br> resource drbd_sdb5 {<br> protocol C;<br> <br> syncer {<br> al-extents 1031;<br> }<br> <br> on nfs2.imprev.net {<br> device /dev/drbd2;<br> disk /dev/sdb5;<br> address 216.145.23.104:7790;<br> flexible-meta-disk /dev/sdb6;<br> }<br> <br> on nfs1.imprev.net {<br> device /dev/drbd2;<br> disk /dev/sdb5;<br> address 216.145.23.103:7790;<br> flexible-meta-disk /dev/sdb6;<br> }<br> }<br> <br> <br> <br> <br> _______________________________________________<br> drbd-user mailing list<br> <a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a><br> <a href="http://lists.linbit.com/mailman/listinfo/drbd-user">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br> </font> </p><div><br class="webkit-block-placeholder"></div> <hr width="100%"> This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail, you are hereby notified that any dissemination, distribution or copying of this e-mail, and any attachments thereto, is strictly prohibited. If you have received this e-mail in error, please immediately notify the sender and permanently delete the original and any copy or printout thereof. </div> </blockquote></div><br></div></body></html>