<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    Did you test your network connection to make sure that it can
    transfer at a greater speed than that? Maybe it is the bottleneck -
    jumbo frames on?<br>
    <br>
    On 25/04/12 15:40, Chris Dickson wrote:
    <blockquote
cite="mid:CANSMP-5VwiAOQhfg_0VhQ7dxuFgfQb5F8JkdSghtLfiqJqkGGA@mail.gmail.com"
      type="cite">
      <div class="gmail_extra">Also use oflag=direct in both tests and
        perform them a few times, sometimes high speeds are the result
        of caching.<br>
        <br>
        <div class="gmail_quote">On Wed, Apr 25, 2012 at 10:35 AM, Chris
          Dickson <span dir="ltr">&lt;<a moz-do-not-send="true"
              href="mailto:chrisd1100@gmail.com" target="_blank">chrisd1100@gmail.com</a>&gt;</span>
          wrote:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0
            .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div class="gmail_extra">Try turning off disk-barrier and
              disk-flushes and see if that makes a difference.
              <div>
                <div class="h5">
                  <br>
                  <br>
                  <div class="gmail_quote">2012/4/25 feng zheng <span
                      dir="ltr">&lt;<a moz-do-not-send="true"
                        href="mailto:zf5984599@gmail.com"
                        target="_blank">zf5984599@gmail.com</a>&gt;</span><br>
                    <blockquote class="gmail_quote" style="margin:0 0 0
                      .8ex;border-left:1px #ccc solid;padding-left:1ex">
                      <div>
                        <div>hi, dear all:<br>
                          <br>
                          When I use drbd, I found the write performance
                          very slow, against<br>
                          testing without drbd module.<br>
                          <br>
                          1. the environment:<br>
                          -) CentOS 5.6<br>
                          -) 2.6.18 kernel<br>
                          -) drbd 8.4.1<br>
                          -) drbd.conf&#65306;<br>
                          resource r0<br>
                          {<br>
                          &nbsp; &nbsp;protocol B;<br>
                          <br>
                          &nbsp; &nbsp;net<br>
                          &nbsp; &nbsp;{<br>
                          max-buffers &nbsp;8000;<br>
                          max-epoch-size 8000;<br>
                          sndbuf-size 512K;<br>
                          &nbsp; &nbsp;}<br>
                          <br>
                          &nbsp; &nbsp;disk<br>
                          &nbsp; &nbsp;{<br>
                          &nbsp;al-extents 3389;<br>
                          &nbsp; &nbsp;}<br>
                          <br>
                          <br>
                          &nbsp; &nbsp;on OSS211<br>
                          &nbsp; &nbsp;{<br>
                          &nbsp; &nbsp; &nbsp; &nbsp;device /dev/drbd0;<br>
                          &nbsp; &nbsp; &nbsp; &nbsp;disk /dev/sdb1;<br>
                          &nbsp; &nbsp; &nbsp; &nbsp;address <a moz-do-not-send="true"
                            href="http://192.168.100.231:7788"
                            target="_blank"><font color="red"><b>MailScanner
                                warning: numerical links are often
                                malicious:</b></font>
                            192.168.100.231:7788</a>;<br>
                          &nbsp; &nbsp; &nbsp; &nbsp;meta-disk internal;<br>
                          &nbsp; &nbsp;}<br>
                          <br>
                          &nbsp; &nbsp;on OSS213<br>
                          &nbsp; &nbsp;{<br>
                          &nbsp; &nbsp; &nbsp; &nbsp;device /dev/drbd0;<br>
                          &nbsp; &nbsp; &nbsp; &nbsp;disk /dev/sde1;<br>
                          &nbsp; &nbsp; &nbsp; &nbsp;address <a moz-do-not-send="true"
                            href="http://192.168.100.213:7788"
                            target="_blank"><font color="red"><b>MailScanner
                                warning: numerical links are often
                                malicious:</b></font>
                            192.168.100.213:7788</a>;<br>
                          &nbsp; &nbsp; &nbsp; &nbsp;meta-disk internal;<br>
                          &nbsp; &nbsp;}<br>
                          <br>
                          }<br>
                          <br>
                          <br>
                          2. Test scenario:<br>
                          *) without drbd module,<br>
                          dd to write 1G stream into one disk, which
                          formatted to ext3:<br>
                          [para]# !echo<br>
                          echo 3 &gt; /proc/sys/vm/drop_caches<br>
                          [para]# !dd<br>
                          dd if=/dev/zero of=test1 bs=1M count=1000
                          conv=fdatasync<br>
                          1000+0 records in<br>
                          1000+0 records out<br>
                          1048576000 bytes (1.0 GB) copied, 10.9905
                          seconds, 95.4 MB/s<br>
                          <br>
                          *) with drbd module,<br>
                          dd 1G stream to the disk, which is ext3 too:<br>
                          [para]# cat /proc/drbd<br>
                          version: 8.4.1 (api:1/proto:86-100)<br>
                          GIT-hash:
                          91b4c048c1a0e06777b5f65d312b38d47abaea80 build
                          by<br>
                          root@OSS213, 2012-04-16 21:38:36<br>
                          &nbsp;0: cs:Connected ro:Primary/Secondary
                          ds:UpToDate/UpToDate B r-----<br>
                          &nbsp; &nbsp;ns:1260036 nr:0 dw:1260036 dr:297 al:330
                          bm:0 lo:0 pe:0 ua:0 ap:0<br>
                          ep:1 wo:b oos:0<br>
                          [para]#<br>
                          [para]# dd if=/dev/zero of=test1 bs=1M
                          count=1000 conv=fdatasync<br>
                          1000+0 records in<br>
                          1000+0 records out<br>
                          1048576000 bytes (1.0 GB) copied, 26.7392
                          seconds, 39.2 MB/s<br>
                          [para]# cat /proc/drbd<br>
                          version: 8.4.1 (api:1/proto:86-100)<br>
                          GIT-hash:
                          91b4c048c1a0e06777b5f65d312b38d47abaea80 build
                          by<br>
                          root@OSS213, 2012-04-16 21:38:36<br>
                          &nbsp;0: cs:Connected ro:Primary/Secondary
                          ds:UpToDate/UpToDate B r-----<br>
                          <br>
                          All the upper test writing disk are same. From
                          the upper result, if i<br>
                          use DRBD to test, the performance<br>
                          is 39 MB/s; while if i do not use, the
                          performance is about 95M/s.<br>
                          <br>
                          3. My question is:<br>
                          -) this write performance decays so large is
                          normal or not?<br>
                          I had read the following from the DRBD
                          website:<br>
                          "15.1. Hardware considerations:<br>
                          .... &nbsp;A single, reasonably recent, SCSI or SAS
                          disk will<br>
                          typically allow streaming writes of roughly
                          40MB/s to the single disk."<br>
                          But this is very slow.<br>
                          <br>
                          -&#65289;if this is not normal, how can i turn this?
                          is the config file<br>
                          something not correct?<br>
                          <br>
                          thanks a lot<br>
                          BRs,<br>
                          feng<br>
                        </div>
                      </div>
                      _______________________________________________<br>
                      drbd-user mailing list<br>
                      <a moz-do-not-send="true"
                        href="mailto:drbd-user@lists.linbit.com"
                        target="_blank">drbd-user@lists.linbit.com</a><br>
                      <a moz-do-not-send="true"
                        href="http://lists.linbit.com/mailman/listinfo/drbd-user"
                        target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
                    </blockquote>
                  </div>
                  <br>
                </div>
              </div>
            </div>
          </blockquote>
        </div>
        <br>
      </div>
    </blockquote>
    <br>
  </body>
</html>