<br><font size=2 face="sans-serif">Hi Lars,</font>
<br>
<br><font size=2 face="sans-serif">I'm using the Suse Kernel </font><font size=2 face="Courier New">2.4.21-99-smp4G</font><font size=2 face="sans-serif">, not sure if that makes an difference or if I'm missing the point,</font>
<br><font size=2 face="sans-serif">I will give what you suggest a try anyway and see if it helps..</font>
<br>
<br>
<br><font size=2 face="sans-serif">Thanks<br>
<br>
<br>
Regards<br>
<br>
Kevin Izzet<br>
<br>
Database / Unix Administrator<br>
Tel: (Code)+44(0)1475 655606<br>
Fax: (Code)+44(0)1475 637755<br>
Email: Kevin.Izzet@nsc.com</font>
<br>
<br>
<br>
<table width=100%>
<tr valign=top>
<td>
<td><font size=1 face="sans-serif"><b>"Lars Ellenberg" <Lars.Ellenberg@linbit.com></b></font>
<br><font size=1 face="sans-serif">Sent by: drbd-user-bounces@lists.linbit.com</font>
<p><font size=1 face="sans-serif">31/08/2004 12:33</font>
<br>
<td><font size=1 face="Arial"> </font>
<br><font size=1 face="sans-serif"> To: drbd-user@lists.linbit.com</font>
<br><font size=1 face="sans-serif"> cc: </font>
<br><font size=1 face="sans-serif"> Subject: Re: [DRBD-user] File data corrupt when I switch Nodes</font></table>
<br>
<br>
<br><font size=2 face="Courier New">/ 2004-08-31 09:34:04 +0100<br>
\ Kevin Izzet:<br>
> Hi All,<br>
> <br>
> Firstly can I thank Philipp, Lars and everyone else who has contributed to <br>
> DRBD, we have been running a production cluster for over a year now<br>
> supporting :-<br>
> Unix/Linux Home accounts<br>
> Unix/Linux Application serving<br>
> Apache<br>
> Samba<br>
> <br>
> My issue is I am in the process of building a second cluster with the <br>
> following spec<br>
> <br>
> HP DL380 G3's<br>
> 2 Gb RAM<br>
> Gigabyte Ethernet for Replication<br>
> Serial for Heartbeat<br>
> Suse 9.0 prof ed, stripped down for server use only....<br>
> Kernel Suse 2.4.21-99-smp4G.<br>
> 1 x 72GB 15k rpm drive for root<br>
> 2 x 72GB 15k rpm drive stripped to 135.6GB for drbd replication.<br>
> Heartbeat 1.2.2<br>
> The server will be running Samba3 and Postgresql 7.4.3 (and 8.0beta for <br>
> testing)<br>
> <br>
> I originally installed drbd 0.6.12 which worked perfectly and has been<br>
> running for a couple of weeks without any issues, but after the<br>
> release of 0.7.3 I decided to bite the bullet and give it a go.<br>
> <br>
> The compile and install went fine, built as module not patched into<br>
> Kernel, I re partitioned the 135GB drive from one to two slices the<br>
> second slice for the metadata, made the partition 500mb to be on the<br>
> safe side. <br>
><br>
> Originally used Reiserfs for the file system but switched too EXT3 to<br>
> see if this would fix my issue !!!<br>
><br>
> Created a new drbd.conf file (see below) and started up the primary<br>
> side all fine, rebuilt the samba Postgresql file structures and<br>
> restarted the Hearbeat services - All ran great.<br>
><br>
> Next I configured the secondary side and started up drbd, it began to<br>
> sync as expected and completed successfully after 2.5 hours I then<br>
> started up heartbeat on the secondary side and forced a switch from<br>
> the primary to the secondary - All appeared to be going ok until I<br>
> noticed that Postgresql didn't restart on the now new primary.<br>
><br>
> I checked the logfiles and the startup was complaining that the<br>
> postgresql.conf file was invalid, on checking the file I found that it<br>
> appeared to be corrupt, headrer was complete gibberish but the rest of<br>
> the file contained normal text, I switched the services back over and<br>
> the to my surprise Postgresql started fine , checked the conf file and<br>
> it was just a normal text file !!!!!!<br>
> <br>
> I have tried rebuilding the drbd devices three times now and also have <br>
> forced a full resync<br>
> of the data twice but I still get the same issue.<br>
> <br>
> If I can't get 0.7.3 working in the next month I'm going to have to revert <br>
> back to using 0.6.12<br>
> so that I can get this cluster into production....<br>
> <br>
> Any help would be much appreciated - and thanks in advance.........<br>
<br>
your ! key is broken... :)<br>
<br>
together with other reports which I think are related,<br>
it looks like drbd does not like the Redhat kernel.<br>
maybe it is only an 2.4 kernel issue,<br>
maybe it is a generic Redhat issue,<br>
probably weird timing is involved,<br>
most likely sendpage is involved in some way or the other.<br>
it could be "only" some smp or highmem issue.<br>
<br>
maybe it is even a hidden serious generic bug, but I doubt that.<br>
since we did many test iterations with random IO load.<br>
many disconnect/reconnect/sync and/or failover cycles.<br>
At linbit with kernel.org/debian 2.6. kernels,<br>
and in the SuSE labs with SuSEs 2.6 kernels.<br>
And then compared the md5sums of the lower level devices.<br>
And it compared just fine<br>
(at least since we left -pre status).<br>
<br>
please disable tcp_sendpage altogether, and verify if this helped.<br>
i.e., get a fresh svn checkout,<br>
and define DRBD_DISALE_SENDPAGE in drbd_config.h ...</font>
<br><font size=2 face="Courier New"><br>
Lars Ellenberg<br>
_______________________________________________<br>
drbd-user mailing list<br>
drbd-user@lists.linbit.com<br>
http://lists.linbit.com/mailman/listinfo/drbd-user<br>
<br>
</font>
<br>
<br><font size=2 face="sans-serif"><br>
<br>
<br>
*************************************************************************************<br>
This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is prohibited. If you are not the intended or authorised recipient please contact the sender by reply email and delete all copies of this message</font>