A little more info:<div><br></div><div>If I set the the node with the good disk to primary, then write 100MB to the drbd volume, the drbd node with the bad disk calls my handler successfully, detaches and does not hang. It seems to only hang when I change the node with the bad disk's role to Primary.</div>
<div><br><br><div class="gmail_quote">On Thu, Apr 12, 2012 at 9:40 AM, Chris Dickson <span dir="ltr"><<a href="mailto:chrisd1100@gmail.com">chrisd1100@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>Thanks Lars, dmesg indeed reported the exit code of 0:</div><div><br></div><div>[ 332.733554] block drbd575: role( Secondary -> Primary )</div><div>[ 332.772827] block drbd575: disk( UpToDate -> Failed )</div>
<div>[ 332.772840] block drbd575: Local IO failed in __req_mod. Detaching...</div><div>[ 332.772925] block drbd575: helper command: /sbin/drbdadm local-io-error minor-575</div><div>[ 332.790163] block drbd575: helper command: /sbin/drbdadm local-io-error minor-575 exit code 0 (0x0)</div>
<div>[ 332.790189] block drbd575: disk( Failed -> Diskless )</div><div>[ 332.803862] block drbd575: receiver updated UUIDs to effective data uuid: 2B81D15C3E0ADD80</div><div><br></div><div>The peer node is also locked up, all operations report:</div>
<div><br></div><div>r575: State change failed: (-10) State change was refused by peer node</div><div><br></div><div>One question on 8.3.latest, one of the reasons I wanted to use 8.4 was the support for more minor numbers. It's not that I necessarily need more than 256 on one machine, but the way my numbering system works it makes it nice to be able to assign minor numbers greater than 255. Is there a quick hack somewhere in the source that I can increase this limit or is this a more complex change made for 8.4?</div>
<div><br></div><div>Also the prefer-remote read balancing method is something that I was interested in, but not super necessary.</div><div><br></div><div>Thanks,</div><div><br></div><div>Chris</div><div class="HOEnZb"><div class="h5">
<br><div class="gmail_quote">
On Thu, Apr 12, 2012 at 9:24 AM, Lars Ellenberg <span dir="ltr"><<a href="mailto:lars.ellenberg@linbit.com" target="_blank">lars.ellenberg@linbit.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>On Thu, Apr 12, 2012 at 09:14:38AM -0400, Chris Dickson wrote:<br>
> Thanks for the quick reply,<br>
><br>
> My test handler currently isn't doing anything interesting, I just had it<br>
> echo 'hello world' to a file which is located on a different drive than the<br>
> LVM volume. The echo seems to have completed successfully as the file is<br>
> written.<br>
><br>
> The end goal for the handler is to simply insert a row into a remote DB,<br>
> other than that the default behavior on io-error of detaching is exactly<br>
> what I would like to have happen.<br>
><br>
> I just tried filtering out drbd in lvm.conf and that doesn't seem to be the<br>
> issue. After another try I did a quick ps auxf this showed up:<br>
><br>
> root 340 0.0 0.0 21392 1284 ? Ss 12:59 0:00 udevd<br>
> --daemon<br>
> root 415 0.0 0.0 21384 896 ? S 12:59 0:00 \_ udevd<br>
> --daemon<br>
> root 1775 0.0 0.0 8448 724 ? D 13:04 0:00 | \_<br>
> /sbin/blkid -o udev -p /dev/drbd575<br>
><br>
> So it seems like udev is initiating the blkid call, could it be doing this<br>
> before drbd has finished executing the handler?<br>
<br>
</div>If the handler finished,<br>
(drbd prints "... helper command .... exit code ..." to the kernel log).<br>
there is no reason for anything to hang.<br>
<br>
DRBD is supposed to retry failed local requests on the peer, and if that<br>
is not possible (no connection, or no good remote disk either), either<br>
freeze IO (if so configured) or report IO errors back up the stack.<br>
<br>
"Supposed to just work".<br>
<br>
Maybe rather downgrade to 8.3.latest, I know we fixed some issues<br>
in the retry logic on the way to 8.4.not-yet-but-"soon"-to-be-released.2<br>
<div><div><br>
--<br>
: Lars Ellenberg<br>
: LINBIT | Your Way to High Availability<br>
: DRBD/HA support and consulting <a href="http://www.linbit.com" target="_blank">http://www.linbit.com</a><br>
_______________________________________________<br>
drbd-user mailing list<br>
<a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a><br>
<a href="http://lists.linbit.com/mailman/listinfo/drbd-user" target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
</div></div></blockquote></div><br>
</div></div></blockquote></div><br></div>