Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.
I've tried to tune the parameters of the config file and i achieve
somewhat different results:
The best read speeds i've seen is with the default config, I got close
to 60000K/sec vs bare metal ~100000K/sec
The best write speeds i've seen is with the following config:
common {
protocol C;
syncer {
rate 160M;
al-extents 1801;
}
}
net {
allow-two-primaries;
sndbuf-size 2M;
max-buffers 16000;
max-epoch-size 16000;
unplug-watermark 16000;
where i've gotten ~ 65000K/sec as opposed to ~ 75000K/sec bare metal.
Anyone have any suggestions to what parameter settings I should try in
order to achieve a better read performance from the drbd resource?
-----------------------------------------------
standard config
common {
protocol C;
syncer {
rate 160M;
}
}
resource r0 {
device /dev/drbd0;
disk /dev/sda9;
meta-disk internal;
net {
allow-two-primaries;
}
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 38345 91 52995 23 24462 3 35202 56 58854 1
886.8 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
+++++ +++
xentest1,1G,38345,91,52995,23,24462,3,35202,56,58854,1,886.8,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
------------------------------------------------
common {
protocol C;
syncer {
rate 160M;
al-extents 1801;
}
}
resource r0 {
device /dev/drbd0;
disk /dev/sda9;
meta-disk internal;
net {
allow-two-primaries;
}
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 40499 93 56239 23 25999 2 35032 55 60131 0
920.4 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
+++++ +++
xentest1,1G,40499,93,56239,23,25999,2,35032,55,60131,0,920.4,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
-----------------------------------------------
common {
protocol C;
syncer {
rate 160M;
al-extents 1801;
}
}
net {
allow-two-primaries;
sndbuf-size 2M;
max-buffers 16000;
max-epoch-size 16000;
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 33647 84 65589 30 24925 2 31053 49 51594 0
908.2 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 29592 75 +++++ +++ +++++ +++ +++++ +++ +++++ +++
+++++ +++
xentest1,1G,33647,84,65589,30,24925,2,31053,49,51594,0,908.2,0,16,29592,75,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
------------------------------------
common {
protocol C;
syncer {
rate 160M;
}
}
net {
allow-two-primaries;
sndbuf-size 2M;
max-buffers 16000;
max-epoch-size 16000;
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 35307 86 54150 23 24424 3 32479 51 52720 1
753.0 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
+++++ +++
xentest1,1G,35307,86,54150,23,24424,3,32479,51,52720,1,753.0,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 33869 85 50962 22 24152 3 32312 52 52220 0
837.5 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 22662 55 +++++ +++ +++++ +++ +++++ +++ +++++ +++
+++++ +++
xentest1,1G,33869,85,50962,22,24152,3,32312,52,52220,0,837.5,0,16,22662,55,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
-----------------------------------
common {
protocol C;
syncer {
rate 160M;
al-extents 1801;
}
}
net {
allow-two-primaries;
sndbuf-size 2M;
max-buffers 16000;
max-epoch-size 16000;
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 33810 83 53047 24 24251 2 31575 50 52619 1
845.3 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
+++++ +++
xentest1,1G,33810,83,53047,24,24251,2,31575,50,52619,1,845.3,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
---------------------------------
common {
protocol C;
syncer {
rate 160M;
al-extents 1801;
}
}
net {
allow-two-primaries;
sndbuf-size 2M;
max-buffers 16000;
max-epoch-size 16000;
unplug-watermark 16000;
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 36425 87 63573 27 24213 2 31282 49 52756 0
872.6 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
+++++ +++
xentest1,1G,36425,87,63573,27,24213,2,31282,49,52756,0,872.6,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 37143 91 65046 29 24263 2 31199 50 52817 0
922.0 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
+++++ +++
xentest1,1G,37143,91,65046,29,24263,2,31199,50,52817,0,922.0,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 34985 85 63603 30 25084 3 31006 50 54001 1
890.9 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 +++++ +++ +++++ +++ +++++ +++ 21868 56 +++++ +++
+++++ +++
xentest1,1G,34985,85,63603,30,25084,3,31006,50,54001,1,890.9,0,16,+++++,+++,+++++,+++,+++++,+++,21868,56,+++++,+++,+++++,+++
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 37639 90 62343 28 23990 2 31229 49 52939 0
852.7 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
+++++ +++
xentest1,1G,37639,90,62343,28,23990,2,31229,49,52939,0,852.7,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
-----------------------------------
common {
protocol C;
syncer {
rate 160M;
al-extents 1801;
}
}
net {
allow-two-primaries;
sndbuf-size 1M;
max-buffers 16000;
max-epoch-size 16000;
unplug-watermark 16000;
}
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 38793 91 56741 27 25736 2 31950 51 52394 1
864.0 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
+++++ +++
xentest1,1G,38793,91,56741,27,25736,2,31950,51,52394,1,864.0,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 37269 90 61286 27 23822 2 31322 51 51914 0
845.2 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
+++++ +++
xentest1,1G,37269,90,61286,27,23822,2,31322,51,51914,0,845.2,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 38681 91 61843 29 24759 2 31928 51 53702 0
835.1 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
+++++ +++
xentest1,1G,38681,91,61843,29,24759,2,31928,51,53702,0,835.1,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
-----------------------------------
common {
protocol C;
syncer {
rate 160M;
al-extents 1801;
}
}
net {
allow-two-primaries;
sndbuf-size 2M;
max-buffers 8000;
max-epoch-size 8000;
unplug-watermark 8000;
}
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 37198 90 61707 27 24275 2 31743 51 53528 1
859.1 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
+++++ +++
xentest1,1G,37198,90,61707,27,24275,2,31743,51,53528,1,859.1,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
-----------------------------------
common {
protocol C;
syncer {
rate 160M;
al-extents 1801;
}
}
net {
allow-two-primaries;
sndbuf-size 2M;
max-buffers 8000;
max-epoch-size 8000;
unplug-watermark 800;
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 35168 85 61123 27 25622 2 31512 50 52113 0
854.8 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
+++++ +++
xentest1,1G,35168,85,61123,27,25622,2,31512,50,52113,0,854.8,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
/sec %CP
xentest1 1G 37392 89 59762 28 25577 2 31167 50 51639 0
856.9 0
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
+++++ +++
xentest1,1G,37392,89,59762,28,25577,2,31167,50,51639,0,856.9,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
-------------------------------
Ingard Mevåg wrote:
> Hello all.
>
> I've just recently had the time to test DRBD myself. Now I am wondering
> if my initial test result are somewhat normal for professional equipment.
>
> Im running on 2 identical dell PE2850:
> controller LSI Logic 53C1030 Ultra 320 SCSI
> disk 6x hdd in raid10
> cpu 2x dualcore 2.8ghz xeon
> ram 512mb (which is what is made available to this os through
> grub config - xen servers)
>
> on the initial sync, and on addition resyncs i get the following:
>
> drbd0: Began resync as SyncSource (will sync 1951768 KB [487942 bits set]).
> drbd0: Resync done (total 34 sec; paused 0 sec; 57404 K/sec)
>
>
> -----
>
> with bonnie++ tests i get: (where the drbd resource is mounted on
> /tmp/test/ )
>
> xentest1:/tmp/test# bonnie++ -u 0 -d /tmp/test/
> Using uid:0, gid:0.
> Writing with putc()...done
> Writing intelligently...done
> Rewriting...done
> Reading with getc()...done
> Reading intelligently...done
> start 'em...done...done...done...
> Create files in sequential order...done.
> Stat files in sequential order...done.
> Delete files in sequential order...done.
> Create files in random order...done.
> Stat files in random order...done.
> Delete files in random order...done.
> Version 1.03 ------Sequential Output------ --Sequential Input-
> --Random-
> -Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
> --Seeks--
> Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
> /sec %CP
> xentest1 1G 34982 87 53201 22 24991 2 36037 58 58588 1
> 889.7 0
> ------Sequential Create------ --------Random
> Create--------
> -Create-- --Read--- -Delete-- -Create-- --Read---
> -Delete--
> files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
> /sec %CP
> 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
> +++++ +++
> xentest1,1G,34982,87,53201,22,24991,2,36037,58,58588,1,889.7,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
>
>
>
>
> xentest1:/tmp# bonnie++ -u 0 -d /tmp/
> Using uid:0, gid:0.
> Writing with putc()...done
> Writing intelligently...done
> Rewriting...done
> Reading with getc()...done
> Reading intelligently...done
> start 'em...done...done...done...
> Create files in sequential order...done.
> Stat files in sequential order...done.
> Delete files in sequential order...done.
> Create files in random order...done.
> Stat files in random order...done.
> Delete files in random order...done.
> Version 1.03 ------Sequential Output------ --Sequential Input-
> --Random-
> -Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
> --Seeks--
> Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP
> /sec %CP
> xentest1 1G 41593 95 75087 30 31368 3 42218 75 102404 1
> 978.6 0
> ------Sequential Create------ --------Random
> Create--------
> -Create-- --Read--- -Delete-- -Create-- --Read---
> -Delete--
> files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
> /sec %CP
> 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
> +++++ +++
> xentest1,1G,41593,95,75087,30,31368,3,42218,75,102404,1,978.6,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
>
>
>
> Are these normal results for equipment equal to this?
>
> regards
> ingard
> _______________________________________________
> drbd-user mailing list
> drbd-user at lists.linbit.com
> http://lists.linbit.com/mailman/listinfo/drbd-user