<font face="trebuchet ms,sans-serif">Hi, <br clear="all"></font><div><font face="'trebuchet ms', sans-serif"><br></font></div><div><font face="'trebuchet ms', sans-serif">Wild guess here: Would you be using INNODB engine for your >50gb tables, with --innodb-file-per-tables option set to 'true' in /etc/my.cnf, and some high value for your buffers ? There are some creepy bugs in MySQL that has no link with DRBD that would create such lockdown.</font></div>
<div><font face="'trebuchet ms', sans-serif"><br></font></div><div><font face="'trebuchet ms', sans-serif">As a tangent question: are you able to copy a file to the file system while you drop that table in MySQL ? </font></div>
<div><font face="'trebuchet ms', sans-serif"><br></font></div><div><font face="'trebuchet ms', sans-serif">P.</font></div><div><font face="'trebuchet ms', sans-serif"> </font></div><div><font face="'trebuchet ms', sans-serif">--<br>
Pascal Charest, <br>Cutting-edge technology consultant @ Les Laboratoires Phoenix<br><a href="http://www.labsphoenix.com" target="_blank">http://www.labsphoenix.com</a> </font><br>
<br><br><div class="gmail_quote">On Wed, Jul 27, 2011 at 12:07 AM, Balreddy Medipally <span dir="ltr"><<a href="mailto:balreddy.m@imimobile.com">balreddy.m@imimobile.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
Hi Matt,<br>
<br>
I couldn't found anything like "sda: Uncorrectable error" in<br>
dmesg and I am sure that there is no faulty HDD in our servers.<br>
Actually we are using DRBD for MySQL high availability, so when dropping<br>
some big table like 50GB or bigger than that applications are not able<br>
to access MySQL DB time particular time.<br>
<br>
Below is my drbd.conf file.<br>
<br>
# please have a a look at the example configuration file in<br>
# /usr/share/doc/drbd/drbd.conf<br>
#<br>
resource drbd0 {<br>
protocol C;<br>
startup {<br>
become-primary-on both;<br>
}<br>
net {<br>
timeout 60;<br>
max-epoch-size 8000;<br>
max-buffers 8000;<br>
unplug-watermark 128;<br>
connect-int 10;<br>
ping-int 10;<br>
sndbuf-size 1024k;<br>
ko-count 180;<br>
ping-timeout 5;<br>
allow-two-primaries;<br>
cram-hmac-alg sha256;<br>
shared-secret DRBDpassw0rd;<br>
after-sb-0pri discard-least-changes;<br>
after-sb-1pri violently-as0p;<br>
after-sb-2pri violently-as0p;<br>
rr-conflict violently;<br>
}<br>
syncer {<br>
rate 200M;<br>
al-extents 3389;<br>
}<br>
disk {<br>
no-disk-barrier;<br>
no-disk-flushes;<br>
no-md-flushes;<br>
on-io-error detach;<br>
}<br>
<br>
on DB-01 {<br>
device /dev/drbd0;<br>
disk /dev/cciss/c0d0p2;<br>
address ipv4 <a href="http://192.168.169.3:7768" target="_blank">192.168.169.3:7768</a>;<br>
meta-disk internal;<br>
}<br>
on DB-02 {<br>
device /dev/drbd0;<br>
disk /dev/cciss/c0d0p9;<br>
address ipv4 <a href="http://192.168.169.4:7768" target="_blank">192.168.169.4:7768</a>;<br>
meta-disk internal;<br>
}<br>
}<br>
<br>
<br>
Thanks,<br>
Balreddy.<br>
<br>
<br>
-----Original Message-----<br>
From: <a href="mailto:drbd-user-bounces@lists.linbit.com">drbd-user-bounces@lists.linbit.com</a><br>
[mailto:<a href="mailto:drbd-user-bounces@lists.linbit.com">drbd-user-bounces@lists.linbit.com</a>] On Behalf Of Matt Graham<br>
Sent: Tuesday, July 26, 2011 10:01 PM<br>
To: <a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a><br>
Subject: Re: [DRBD-user] Deleting directories/files from drbd drive<br>
<div class="im">getting hung for some time.<br>
<br>
</div><div><div></div><div class="h5">From: "Balreddy Medipally" <<a href="mailto:balreddy.m@imimobile.com">balreddy.m@imimobile.com</a>><br>
> We are using Protocol C in our drbd.conf file. [When we are]<br>
> deleting directories/files from drbd drive, [it's hanging up] for<br>
> some time. In this period of time it is not allowing us to do any<br>
> operations on [the] drbd drive.<br>
<br>
The first thing to do is to check the output from dmesg on both nodes<br>
and make<br>
sure you don't see anything like "sda: Uncorrectable error writing<br>
sector<br>
12345678". If you see this, it means one of your disks is dying<br>
horribly.<br>
This can cause delays while writing, since the kernel and disk will try<br>
to<br>
write to that sector several times.<br>
<br>
> Please let us know if there is any tuning to be done in drbd level.<br>
<br>
It's impossible to tell, since we can't see your drbd.conf. Put that<br>
file on<br>
your webspace somewhere, and follow up with a link.<br>
<br>
--<br>
Matt G / Dances With Crows<br>
The Crow202 Blog: <a href="http://crow202.org/wordpress/" target="_blank">http://crow202.org/wordpress/</a><br>
There is no Darkness in Eternity/But only Light too dim for us to see<br>
<br>
_______________________________________________<br>
drbd-user mailing list<br>
<a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a><br>
<a href="http://lists.linbit.com/mailman/listinfo/drbd-user" target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
_______________________________________________<br>
drbd-user mailing list<br>
<a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a><br>
<a href="http://lists.linbit.com/mailman/listinfo/drbd-user" target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
</div></div></blockquote></div><br></div>