<div class="gmail_quote">On Mon, Jun 25, 2012 at 2:10 PM, Lars Ellenberg <span dir="ltr"><<a href="mailto:lars.ellenberg@linbit.com" target="_blank">lars.ellenberg@linbit.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div class="im">On Fri, Jun 22, 2012 at 02:38:07PM -0500, J.R. Lillard wrote:<br>
> Witnessed another bandwidth spike that slowed my stacked layer down.<br>
><br>
> 10: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate A r-----<br>
> ns:192538032 nr:0 dw:599650316 dr:1701817080 al:4481613 bm:43214 lo:1<br>
> pe:2050 ua:0 ap:2049 ep:1 wo:f oos:0<br>
<br>
</div>You want to increase your max-buffers.<br></blockquote><div><br></div><div>I set max-buffers and max-epoch-size to 8000 but I'm still having issues. r1-U filled up almost 75% of it's 200M proxy buffer. During that time the pe for r1-U kept climbing and all the disk writes were put on hold until it could start catching up. I can tell this because my virtual machines all freeze up and write latency reported from ESXi skyrockets as well. I'm still wondering if I'm not understanding some fundamental part of DRBD or Proxy. I am expecting my third node to never affect the performance of my primary nodes unless the Proxy buffers filled up completely. Is that not the case?<br>
</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
And have a look at the other hints on drbd performance tuning.<br></blockquote><div><br></div><div>I did but nothing else seems to apply.</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Cheers,<br>
<br>
Lars<br>
<div><div class="h5"><br>
<br>
> resync: used:0/61 hits:3274 misses:165 starving:0 dirty:0<br>
> changed:165<br>
> act_log: used:135/3833 hits:788561 misses:25007 starving:0 dirty:28<br>
> changed:24979<br>
><br>
> On Fri, Jun 22, 2012 at 8:24 AM, J.R. Lillard <<a href="mailto:jlillard@ghfllc.com">jlillard@ghfllc.com</a>> wrote:<br>
><br>
> > My starving count was pretty high. I maxed out my al-extents and will see<br>
> > if that helps. Thanks.<br>
> ><br>
> ><br>
> > On Fri, Jun 22, 2012 at 4:22 AM, Andreas Kurz <<a href="mailto:andreas@hastexo.com">andreas@hastexo.com</a>> wrote:<br>
> ><br>
> >> On 06/20/2012 11:51 PM, J.R. Lillard wrote:<br>
> >> > I have a lower-level setup on Protocol C and a stacked layer of Protocol<br>
> >> > A going through Proxy over a WAN. There are times when my disk activity<br>
> >> > spikes causing the Proxy buffers to fill up a bit. While this is<br>
> >> > happening the Pending count on my stacked resources goes up and causes<br>
> >> > my access to those resources to slow down. Is this normal? I thought<br>
> >> > with Protocol A as soon as my local write was finished things would<br>
> >> > continue.<br>
> >><br>
> >> You checked that you are not running out of activity log extents for the<br>
> >> stacked resource?<br>
> >><br>
> >> Do an: echo 1 >/sys/module/drbd/parameters/proc_details<br>
> >><br>
> >> ... and have a look at "starving" counter in /proc/drbd ... should<br>
> >> ideally be 0 and definitely not increasing regularly. If it does,<br>
> >> increase the al-extents value for the stacked resource (max is 3833 in<br>
> >> drbd 8.3 ... IIRC)<br>
> >><br>
> >> Regards,<br>
> >> Andreas<br>
> >><br>
> >> --<br>
> >> Need help with DRBD?<br>
> >> <a href="http://www.hastexo.com/now" target="_blank">http://www.hastexo.com/now</a><br>
> >><br>
> >> ><br>
> >> > --<br>
> >> > J.R. Lillard<br>
> >> > System / Network Admin<br>
> >> > Web Programmer<br>
> >> > Golden Heritage Foods<br>
> >> > 120 Santa Fe St.<br>
> >> > Hillsboro, KS 67063<br>
> >> ><br>
> >> ><br>
> >> ><br>
> >> > _______________________________________________<br>
> >> > drbd-user mailing list<br>
> >> > <a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a><br>
> >> > <a href="http://lists.linbit.com/mailman/listinfo/drbd-user" target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
> >> ><br>
> >><br>
> >><br>
> >><br>
> >><br>
> >><br>
> >><br>
> >><br>
> >> _______________________________________________<br>
> >> drbd-user mailing list<br>
> >> <a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a><br>
> >> <a href="http://lists.linbit.com/mailman/listinfo/drbd-user" target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
> >><br>
> >><br>
> ><br>
> ><br>
> > --<br>
> > J.R. Lillard<br>
> > System / Network Admin<br>
> > Web Programmer<br>
> > Golden Heritage Foods<br>
> > 120 Santa Fe St.<br>
> > Hillsboro, KS 67063<br>
> ><br>
> ><br>
><br>
><br>
> --<br>
> J.R. Lillard<br>
> System / Network Admin<br>
> Web Programmer<br>
> Golden Heritage Foods<br>
> 120 Santa Fe St.<br>
> Hillsboro, KS 67063<br>
<br>
> _______________________________________________<br>
> drbd-user mailing list<br>
> <a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a><br>
> <a href="http://lists.linbit.com/mailman/listinfo/drbd-user" target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
<br>
<br>
--<br>
</div></div>: Lars Ellenberg<br>
: LINBIT | Your Way to High Availability<br>
: DRBD/HA support and consulting <a href="http://www.linbit.com" target="_blank">http://www.linbit.com</a><br>
<br>
DRBD® and LINBIT® are registered trademarks of LINBIT, Austria.<br>
__<br>
please don't Cc me, but send to list -- I'm subscribed<br>
<div class="HOEnZb"><div class="h5">_______________________________________________<br>
drbd-user mailing list<br>
<a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a><br>
<a href="http://lists.linbit.com/mailman/listinfo/drbd-user" target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br>J.R. Lillard<div>System / Network Admin</div><div>Web Programmer</div><div>Golden Heritage Foods</div><div>120 Santa Fe St.</div><div>Hillsboro, KS 67063</div>
<br>