[DRBD-user] Slow syncall after kernel+drbd upgrade

Christian Hammers ch at westend.com
Wed Jan 21 13:10:05 CET 2004

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


Hello

On Wed, Jan 21, 2004 at 01:02:00PM +0100, Lars Ellenberg wrote:
> / 2004-01-21 06:58:15 +0100
> \ Christian Hammers:
> > Hello
> > 
> > On Tue, Jan 20, 2004 at 12:51:28PM +0100, Lars Ellenberg wrote:
> > > > I used to have 2.4.23 and drbd 0.6.4 running on two servers sharing
> > > > 2x 5GB over a 100MBit crosslink.
> > > > 
> > > > Now I upgraded to 2.4.24 and drbd 0.6.10 and two Intel e1000.o gigabit
> > > > cards and my syncall time drops from about 15mins to more than 1h!
> > > >
> > > > After the syncinc was done, I tested the link with "rsync -v -a
> > > > --progress ..." and got at least 15MB/s = 120MBit/s which is not much 
> > > > for a 1000MBit/s link but at least more than 2MBit/s that drbd got!
> > > > 
> > > > Below you find the "cat /proc/drbd" and the "drbdsetup /dev/nb0 show" 
> > > > outputs. The sync-max values differ a bit as I played around before
> > > > giving up...
> > 
> > ...
> > > >  sync-min = 200 KB/sec
> > > you should increase sync-min !!
> > > >  sync-max = 5000 KB/sec
> > > of course you want to increase sync-max again...
> > > >  sync-nice = 10
> > > you should probably sync-nice = -10 or so
> > 
> > And so I did. I also changed the devices MTU size to 5000 and verified
> > with iptraf that this large packet size is actually used. It is.
> > I could rsync a 100MB file over the very same crossover cable with
> > 15MB/s and the servers are quite idle according to vmstat :-(
> > 
> > But the syncAll still is no bit faster!
> 
> if nothing else is in the syslog, 
> then now please try my last suggestion:
> sndbuf-size = 65534 or even less...

Hm, as I have to reboot the machines anyway due to a problem 
with a NIC (which is not involved in DRBD), I will probably rather
downgrade to 0.6.4 and see what happens there.
 
> > 0: cs:SyncingAll st:Secondary/Primary ns:0 nr:1435652 dw:1435652 dr:0 pe:0 ua:15
> >         [=====>..............] sync'ed: 26.8% (3668/5004)M
> >         finish: 0:47:57h speed: 1,319 (1,313) K/sec
> > 1: cs:SyncingAll st:Secondary/Primary ns:0 nr:1367248 dw:1367248 dr:0 pe:0 ua:15
> >         [=====>..............] sync'ed: 26.7% (3672/5004)M
> >         finish: 0:47:40h speed: 1,336 (1,310) K/sec
> 
> hm. they still sync at the same time.
> You are absolutely sure they don't kill performance with seektime
> on the same spindle?

Yes, maybe, but as said they did it in about 20mins (for both) with the 
old 100mbit/s NICs and 2.4.23 + drbd-0.6.4.
It's started by the Debian scripts and I did not want to fiddle around with
them, too :)

bye,

-christian-

-- 
Christian Hammers             WESTEND GmbH  |  Internet-Business-Provider
Technik                       CISCO Systems Partner - Authorized Reseller
                              Lütticher Straße 10      Tel 0241/701333-11
ch at westend.com                D-52064 Aachen              Fax 0241/911879




More information about the drbd-user mailing list