Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.
The sysctl settings here gave a small boost, but they still aren't even
approaching what gigabit is capable of.
iperf does indeed give me 100% of the link, 990Mb/sec (the tcp settings
given here boosted it from about 940).
If I cat /proc/drbd quite a bit, I occasionally get interesting results
like the following, perhaps 1 out of 20 times. Note the drastically
reduced speed reading:
[root at mail-2 ~]# cat /proc/drbd
version: 8.0.5 (api:86/proto:86)
SVN Revision: 3011 build by ben at m-2w9juvlmyfmj7.mcdean-europe.com,
2007-08-13 15:12:01
0: cs:SyncTarget st:Secondary/Primary ds:Inconsistent/UpToDate C r---
ns:0 nr:3844992 dw:3836800 dr:0 al:0 bm:231 lo:258 pe:6550 ua:256
ap:0
[=>..................] sync'ed: 5.5% (65498/69245)M
finish: 15:31:32 speed: 928 (17,600) K/sec
resync: used:14/31 hits:246358 misses:248 starving:0 dirty:0
changed:248
act_log: used:0/907 hits:0 misses:0 starving:0 dirty:0 changed:0
But usually, it's more like this:
[root at mail-2 ~]# cat /proc/drbd
version: 8.0.5 (api:86/proto:86)
SVN Revision: 3011 build by ben at m-2w9juvlmyfmj7.mcdean-europe.com,
2007-08-13 15:12:01
0: cs:SyncTarget st:Secondary/Primary ds:Inconsistent/UpToDate C r---
ns:0 nr:5081600 dw:5073408 dr:0 al:0 bm:308 lo:258 pe:4891 ua:256
ap:0
[=>..................] sync'ed: 7.2% (64291/69245)M
finish: 1:14:08 speed: 14,740 (15,752) K/sec
resync: used:11/31 hits:321915 misses:320 starving:0 dirty:0
changed:320
act_log: used:0/907 hits:0 misses:0 starving:0 dirty:0 changed:0
I'm not accusing drbd of limiting me, but everything else works as
expected and my ethernet interfaces don't have any errors. Any
thoughts?
Ben
> -----Original Message-----
> From: drbd-user-bounces at lists.linbit.com [mailto:drbd-user-
> bounces at lists.linbit.com] On Behalf Of Leroy van Logchem
> Sent: Tuesday, August 14, 2007 3:16 PM
> To: drbd-user at lists.linbit.com
> Subject: Re: [DRBD-user] FW: Slow sync speed over gigabit
>
>
> > DRBD Partitions: Using a 70gb partition created by Logical Volume
> Manager
> > OS: RHEL5
> > DRBD: 8.0.5, made with 'make rpm' against RHEL kernel-source package
and
> installed with rpm.
> > finish: 1:20:30 speed: 12,568 (11,900) K/sec
> >
>
> # TCP adjustments for >1Gb/s
> net.ipv4.tcp_no_metrics_save = 1
> net.ipv4.tcp_rmem = 4096 87380 16777216
> net.ipv4.tcp_wmem = 4096 87380 16777216
> net.ipv4.tcp_reordering = 100
> net.core.netdev_max_backlog = 10000
> net.core.rmem_max = 16777216
> net.core.wmem_max = 16777216
>
> Can you achieve full bandwidth using iperf?
>
> DRBD doesnt limit you, we recently got the resync up to 160MB/s
> (sustained)
> using three interfaces of our quad gigabit nic.
>
>
> --
> Leroy
> _______________________________________________
> drbd-user mailing list
> drbd-user at lists.linbit.com
> http://lists.linbit.com/mailman/listinfo/drbd-user