[DRBD-user] slow drbd over tripple gigabit bonding balance-rr

Mark Watts m.watts at eris.qinetiq.com
Thu Jul 30 15:18:20 CEST 2009

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


On Thu, 2009-07-30 at 03:57 -0400, Zoltan Patay wrote:
> using "dd if=/dev/zero of=/dev/drbd26 bs=10M count=100" I get:
> 
> drbd connected
> 1048576000 bytes (1.0 GB) copied, 13.6526 seconds, 76.8 MB/s
> 1048576000 bytes (1.0 GB) copied, 13.4238 seconds, 78.1 MB/s
> 1048576000 bytes (1.0 GB) copied, 13.2448 seconds, 79.2 MB/s
> 
> drbd disconnected
> 1048576000 bytes (1.0 GB) copied, 4.04754 seconds, 259 MB/s
> 1048576000 bytes (1.0 GB) copied, 4.06758 seconds, 258 MB/s
> 1048576000 bytes (1.0 GB) copied, 4.06758 seconds, 258 MB/s
> 
> The three (intel) gigabit PCIe cards are bonded with balance-rr, and
> iperf gives me:
> 
> iperf 0.0-10.0 sec  2.52 GBytes  2.16 Gbits/sec (276.48MB/s)
> 
> So clearly there is enough speed for both on the network and in the
> backend to support higher speeds. The boxes are with cross-over
> back-to-back no-switch.
> 
> version: 8.3.0 (api:88/proto:86-89)
> GIT-hash: 9ba8b93e24d842f0dd3fb1f9b90e8348ddb95829 build by
> phil at fat-tyre, 2008-12-18 15:26:13
> 
> global { usage-count yes; }
>        common { syncer { rate 650M; } }

Try actually setting this to a sensible value for 3 x 1Gbit links.
eg: 300M

> resource OpenVZ_C1C2_B_LVM5 {
>   protocol C;
>   startup {degr-wfc-timeout 120;}
>   disk {on-io-error
> detach;no-disk-flushes;no-md-flushes;no-disk-drain;no-disk-barrier;}
>   net {
>     cram-hmac-alg sha1;
>     shared-secret "OpenVZ_C1C2_B";
>     allow-two-primaries;
>     after-sb-0pri discard-zero-changes;
>     after-sb-1pri discard-secondary;
>     after-sb-2pri disconnect;
>     rr-conflict disconnect;
>     timeout 300;
>     connect-int 10;
>     ping-int 10;
>     max-buffers 2048;
>     max-epoch-size 2048;
>   }
>   syncer {rate 650M;al-extents 257;verify-alg crc32c;}

And here too.


Mark.
-- 
Mark Watts BSc RHCE MBCS
Senior Systems Engineer, Managed Services Manpower
www.QinetiQ.com
QinetiQ - Delivering customer-focused solutions
GPG Key: http://www.linux-corner.info/mwatts.gpg
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: This is a digitally signed message part
URL: <http://lists.linbit.com/pipermail/drbd-user/attachments/20090730/81998fcc/attachment.pgp>


More information about the drbd-user mailing list