<div dir="ltr">almost solved.<div>After reboot, file <b style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">/var/lib/<span class="">drbd</span>.d/drbdmanage_global_common.conf i</b><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">s overwritten and empty.</span></div><div><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">So settings are not working after rebot.</span></div><div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">Anybody know how to make it permanent ?</span></font></div><div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><b><br></b></span></font></div><div><font color="#2c2c2c" face="Open Sans, Helvetica, Arial, sans-serif"><span style="background-color:rgb(250,250,250)"><div style="font-weight:bold">Writing settings in another file like this doesnt work !</div><div style="font-weight:bold"><br></div><div style="font-weight:bold"><br></div><div><div>root@node2:/etc/drbd.d# cat global_common.conf</div><div># DRBD is the result of over a decade of development by LINBIT.</div><div># In case you need professional services for DRBD or have</div><div># feature requests visit <a href="http://www.linbit.com">http://www.linbit.com</a></div><div><br></div><div>global {</div><div>        usage-count no;</div><div>        # minor-count dialog-refresh disable-ip-verification</div><div>        # cmd-timeout-short 5; cmd-timeout-medium 121; cmd-timeout-long 600;</div><div>}</div><div><br></div><div>common {</div><div>        handlers {</div><div>                # These are EXAMPLE handlers only.</div><div>                # They may have severe implications,</div><div>                # like hard resetting the node under certain circumstances.</div><div>                # Be careful when chosing your poison.</div><div><br></div><div>                # pri-on-incon-degr &quot;/usr/lib/drbd/notify-pri-on-incon-degr.sh; /usr/lib/drbd/notify-emergency-reboot.sh; echo b &gt; /proc/sysrq-trigger ; reboot -f&quot;;</div><div>                # pri-lost-after-sb &quot;/usr/lib/drbd/notify-pri-lost-after-sb.sh; /usr/lib/drbd/notify-emergency-reboot.sh; echo b &gt; /proc/sysrq-trigger ; reboot -f&quot;;</div><div>                # local-io-error &quot;/usr/lib/drbd/notify-io-error.sh; /usr/lib/drbd/notify-emergency-shutdown.sh; echo o &gt; /proc/sysrq-trigger ; halt -f&quot;;</div><div>                # fence-peer &quot;/usr/lib/drbd/crm-fence-peer.sh&quot;;</div><div>                # split-brain &quot;/usr/lib/drbd/notify-split-brain.sh root&quot;;</div><div>                # out-of-sync &quot;/usr/lib/drbd/notify-out-of-sync.sh root&quot;;</div><div>                # before-resync-target &quot;/usr/lib/drbd/snapshot-resync-target-lvm.sh -p 15 -- -c 16k&quot;;</div><div>                # after-resync-target /usr/lib/drbd/unsnapshot-resync-target-lvm.sh;</div><div>        }</div><div><br></div><div>        startup {</div><div>                # wfc-timeout degr-wfc-timeout outdated-wfc-timeout wait-after-sb</div><div>        }</div><div><br></div><div>        options {</div><div>                # cpu-mask on-no-data-accessible</div><div>        }</div><div><br></div><div>        disk {</div><div>      on-io-error             detach;</div><div>        no-disk-flushes ;</div><div>        no-disk-barrier;</div><div>        c-plan-ahead 10;</div><div>        c-fill-target 24M;</div><div>        c-min-rate 10M;</div><div>        c-max-rate 100M;</div><div>                # size on-io-error fencing disk-barrier disk-flushes</div><div>                # disk-drain md-flushes resync-rate resync-after al-extents</div><div>                # c-plan-ahead c-delay-target c-fill-target c-max-rate</div><div>                # c-min-rate disk-timeout</div><div>        }</div><div><br></div><div>        net {</div><div>                protocol C;</div><div>        # max-epoch-size          20000;</div><div>        max-buffers             36k;</div><div>        sndbuf-size            1024k ;</div><div>        rcvbuf-size            2048k;</div><div><br></div><div>                # allow-two-primaries yes;</div><div>                # protocol timeout max-epoch-size max-buffers unplug-watermark</div><div>                # connect-int ping-int sndbuf-size rcvbuf-size ko-count</div><div>                # allow-two-primaries cram-hmac-alg shared-secret after-sb-0pri</div><div>                # after-sb-1pri after-sb-2pri always-asbp rr-conflict</div><div>                # ping-timeout data-integrity-alg tcp-cork on-congestion</div><div>                # congestion-fill congestion-extents csums-alg verify-alg</div><div>                # use-rle</div><div>        }</div><div>}</div><div style="font-weight:bold"><br></div></div><div style="font-weight:bold;font-size:14.6667px;line-height:20.5333px"><br></div></span></font></div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature" data-smartmail="gmail_signature"><font style="color:rgb(153,153,153)" color="#666666" face="tahoma, sans-serif" size="1">-- <br><a href="http://sky-link.net" target="_blank">sky-link.net</a> Tytus Rogalewski<br>eMail: <a href="mailto:tytanick@gmail.com" target="_blank">tytanick@gmail.com</a><br>strona: <a href="http://sky-link.net" target="_blank">http://sky-link.net</a><br></font><font style="color:rgb(153,153,153)" size="1">kom. 790 202 300</font><br><font style="color:rgb(153,153,153)" color="#666666" face="tahoma, sans-serif" size="1">gg: 210533<br>skype: tytanick</font><font style="color:rgb(153,153,153)" size="1"><br>NIP: 9570976234<br>REGON: 221197388<br></font><br></div></div>
<br><div class="gmail_quote">2016-06-21 11:01 GMT+02:00 Tytus Rogalewski <span dir="ltr">&lt;<a href="mailto:tytanick@gmail.com" target="_blank">tytanick@gmail.com</a>&gt;</span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="HOEnZb"><div class="h5"><div dir="ltr"><span style="font-size:12.8px">Lol i made it :)</span><div style="font-size:12.8px"><br></div><div style="font-size:12.8px"><br></div><div style="font-size:12.8px"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">Ok so i thought that it was buggy drbd9 but after 3 days of lost time i finally made it </span><img src="https://forum.proxmox.com/styles/default/xenforo/clear.png" alt=":)" title="Smile    :)" style="border:0px;vertical-align:text-bottom;margin:0px 1px;max-width:100%;width:18px;min-height:18px;color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background:url(&quot;https://ci4.googleusercontent.com/proxy/vrLCIN1cOYEuoPDPdqq6DU03g-ezr43tcfVCINBO6nQch6HyOxSRtWjO5Z11xxUHDBhyAJkE5VKNNygCoaCUVJ0MgXu96a3GvQ8go0mJ=s0-d-e1-ft#http://styles/default/xenforo/xenforo-smilies-sprite.png&quot;) 0px 0px no-repeat rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">Before that fix i had 20mbit/s syncing but after that i have 800mbit/s on 1GBit </span><img src="https://forum.proxmox.com/styles/default/xenforo/clear.png" alt=":)" title="Smile    :)" style="border:0px;vertical-align:text-bottom;margin:0px 1px;max-width:100%;width:18px;min-height:18px;color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background:url(&quot;https://ci4.googleusercontent.com/proxy/vrLCIN1cOYEuoPDPdqq6DU03g-ezr43tcfVCINBO6nQch6HyOxSRtWjO5Z11xxUHDBhyAJkE5VKNNygCoaCUVJ0MgXu96a3GvQ8go0mJ=s0-d-e1-ft#http://styles/default/xenforo/xenforo-smilies-sprite.png&quot;) 0px 0px no-repeat rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><div style="margin:1em 140px 1em 0px;padding:0px;border:1px solid rgb(221,229,234);overflow:auto;color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(248,251,253)"><div style="margin:0px;padding:8px;font-size:13px;color:rgb(52,77,93);border-bottom-width:1px;border-bottom-style:solid;border-bottom-color:rgb(221,229,234);background-color:rgb(255,255,255)">Code:</div><pre style="white-space:pre-wrap;margin-top:0px;margin-bottom:0px;padding:0px 8px;font-family:Consolas,&quot;Courier New&quot;,Courier,monospace;line-height:26px;word-wrap:normal;font-size:10pt;overflow:auto;min-height:30px;max-height:500px;direction:ltr;background-image:-webkit-repeating-linear-gradient(top,rgba(0,0,0,0.0117647) 0px,rgba(0,0,0,0.0117647) 26px,rgba(0,0,0,0.0431373) 26px,rgba(0,0,0,0.0431373) 52px);background-repeat:repeat-x">NET | bond0    80% | pcki   13298 | pcko  133286 | si 3879 Kbps | so  807 Mbps | coll       0 | mlti      12 | erri       0 | erro       0 | drpi       0 | drpo       0 |
NET | eth1     80% | pcki   13298 | pcko  133286 | si 3879 Kbps | so  807 Mbps | coll       0 | mlti      12 | erri       0 | erro       0 | drpi       0 | drpo       0 |
NET | tap0      0% | pcki       4 | pcko       4 | si    0 Kbps | so   12 Kbps | coll       0 | mlti       0 | erri       0 | erro       0 | drpi       0 | drpo       0 |
NET | eth2</pre></div><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">it was all about stupid config file ..... and accually you need to edit proper config ....</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">First of all if you have working drbd9 cluster first stop all VMs and then all resources on both <span>drbd</span> nodes:</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><div style="margin:1em 140px 1em 0px;padding:0px;border:1px solid rgb(221,229,234);overflow:auto;color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(248,251,253)"><div style="margin:0px;padding:8px;font-size:13px;color:rgb(52,77,93);border-bottom-width:1px;border-bottom-style:solid;border-bottom-color:rgb(221,229,234);background-color:rgb(255,255,255)">Code:</div><pre style="white-space:pre-wrap;margin-top:0px;margin-bottom:0px;padding:0px 8px;font-family:Consolas,&quot;Courier New&quot;,Courier,monospace;line-height:26px;word-wrap:normal;font-size:10pt;overflow:auto;min-height:30px;max-height:500px;direction:ltr;background-image:-webkit-repeating-linear-gradient(top,rgba(0,0,0,0.0117647) 0px,rgba(0,0,0,0.0117647) 26px,rgba(0,0,0,0.0431373) 26px,rgba(0,0,0,0.0431373) 52px);background-repeat:repeat-x">drbdadm disconnect all</pre></div><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">Then you need to edit config (and this is what i was looking for so long)</span><b style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"> /var/lib/<span>drbd</span>.d/drbdmanage_global_common.conf</b><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"> because editing /etc/<span>drbd</span>.d/global_common.conf doesnt work at all </span><img src="https://forum.proxmox.com/styles/default/xenforo/clear.png" alt=":)" title="Smile    :)" style="border:0px;vertical-align:text-bottom;margin:0px 1px;max-width:100%;width:18px;min-height:18px;color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background:url(&quot;https://ci4.googleusercontent.com/proxy/vrLCIN1cOYEuoPDPdqq6DU03g-ezr43tcfVCINBO6nQch6HyOxSRtWjO5Z11xxUHDBhyAJkE5VKNNygCoaCUVJ0MgXu96a3GvQ8go0mJ=s0-d-e1-ft#http://styles/default/xenforo/xenforo-smilies-sprite.png&quot;) 0px 0px no-repeat rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">Enter those settings to </span><b style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">/var/lib/<span>drbd</span>.d/drbdmanage_global_common.conf <span style="color:rgb(255,0,0)">ON BOTH NODES</span><br><div style="margin:1em 140px 1em 0px;padding:0px;border:1px solid rgb(221,229,234);overflow:auto;background-color:rgb(248,251,253)"><div style="margin:0px;padding:8px;font-size:13px;color:rgb(52,77,93);border-bottom-width:1px;border-bottom-style:solid;border-bottom-color:rgb(221,229,234);background-color:rgb(255,255,255)">Code:</div><pre style="white-space:pre-wrap;margin-top:0px;margin-bottom:0px;padding:0px 8px;font-family:Consolas,&quot;Courier New&quot;,Courier,monospace;line-height:26px;word-wrap:normal;font-size:10pt;overflow:auto;min-height:30px;max-height:500px;direction:ltr;background-image:-webkit-repeating-linear-gradient(top,rgba(0,0,0,0.0117647) 0px,rgba(0,0,0,0.0117647) 26px,rgba(0,0,0,0.0431373) 26px,rgba(0,0,0,0.0431373) 52px);background-repeat:repeat-x"># it must be content of /var/lib/<span>drbd</span>.d/drbdmanage_global_common.conf !!!!
common {
disk {
        on-io-error             detach;
        no-disk-flushes ;
        no-disk-barrier;
        c-plan-ahead 10;
        c-fill-target 24M;
        c-min-rate 10M;
        c-max-rate 100M;
}.
net {
        # max-epoch-size          20000;
        max-buffers             36k;
        sndbuf-size            1024k ;
        rcvbuf-size            2048k;
}
}
</pre></div></b><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">Then simply restart <span>drbd</span> by:</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><b style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><div style="margin:1em 140px 1em 0px;padding:0px;border:1px solid rgb(221,229,234);overflow:auto;background-color:rgb(248,251,253)"><div style="margin:0px;padding:8px;font-size:13px;color:rgb(52,77,93);border-bottom-width:1px;border-bottom-style:solid;border-bottom-color:rgb(221,229,234);background-color:rgb(255,255,255)">Code:</div><pre style="white-space:pre-wrap;margin-top:0px;margin-bottom:0px;padding:0px 8px;font-family:Consolas,&quot;Courier New&quot;,Courier,monospace;line-height:26px;word-wrap:normal;font-size:10pt;overflow:auto;min-height:30px;max-height:500px;direction:ltr;background-image:-webkit-repeating-linear-gradient(top,rgba(0,0,0,0.0117647) 0px,rgba(0,0,0,0.0117647) 26px,rgba(0,0,0,0.0431373) 26px,rgba(0,0,0,0.0431373) 52px);background-repeat:repeat-x">/etc/init.d/<span>drbd</span> restart</pre></div></b><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">And thats it. Syncing should be at 800mbits </span><img src="https://forum.proxmox.com/styles/default/xenforo/clear.png" alt=":)" title="Smile    :)" style="border:0px;vertical-align:text-bottom;margin:0px 1px;max-width:100%;width:18px;min-height:18px;color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background:url(&quot;https://ci4.googleusercontent.com/proxy/vrLCIN1cOYEuoPDPdqq6DU03g-ezr43tcfVCINBO6nQch6HyOxSRtWjO5Z11xxUHDBhyAJkE5VKNNygCoaCUVJ0MgXu96a3GvQ8go0mJ=s0-d-e1-ft#http://styles/default/xenforo/xenforo-smilies-sprite.png&quot;) 0px 0px no-repeat rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">In you have 10GBit just change c-max-rate to 1000M</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">Play with those settings</span></div></div></div></div><div class="gmail_extra"><br clear="all"><span class=""><div><div data-smartmail="gmail_signature"><font style="color:rgb(153,153,153)" color="#666666" face="tahoma, sans-serif" size="1">-- <br><a href="http://sky-link.net" target="_blank">sky-link.net</a> Tytus Rogalewski<br>eMail: <a href="mailto:tytanick@gmail.com" target="_blank">tytanick@gmail.com</a><br>strona: <a href="http://sky-link.net" target="_blank">http://sky-link.net</a><br></font><font style="color:rgb(153,153,153)" size="1">kom. 790 202 300</font><br><font style="color:rgb(153,153,153)" color="#666666" face="tahoma, sans-serif" size="1">gg: 210533<br>skype: tytanick</font><font style="color:rgb(153,153,153)" size="1"><br>NIP: 9570976234<br>REGON: 221197388<br></font><br></div></div>
<br></span><div><div class="h5"><div class="gmail_quote">2016-06-21 11:00 GMT+02:00 Tytus Rogalewski <span dir="ltr">&lt;<a href="mailto:tytanick@gmail.com" target="_blank">tytanick@gmail.com</a>&gt;</span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Lol i made it :)<div><br></div><div><br></div><div><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">Ok so i thought that it was buggy drbd9 but after 3 days of lost time i finally made it </span><img src="https://forum.proxmox.com/styles/default/xenforo/clear.png" alt=":)" title="Smile    :)" style="border:0px;vertical-align:text-bottom;margin:0px 1px;max-width:100%;width:18px;min-height:18px;color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background:url(&quot;https://ci4.googleusercontent.com/proxy/vrLCIN1cOYEuoPDPdqq6DU03g-ezr43tcfVCINBO6nQch6HyOxSRtWjO5Z11xxUHDBhyAJkE5VKNNygCoaCUVJ0MgXu96a3GvQ8go0mJ=s0-d-e1-ft#http://styles/default/xenforo/xenforo-smilies-sprite.png&quot;) 0px 0px no-repeat rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">Before that fix i had 20mbit/s syncing but after that i have 800mbit/s on 1GBit </span><img src="https://forum.proxmox.com/styles/default/xenforo/clear.png" alt=":)" title="Smile    :)" style="border:0px;vertical-align:text-bottom;margin:0px 1px;max-width:100%;width:18px;min-height:18px;color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background:url(&quot;https://ci4.googleusercontent.com/proxy/vrLCIN1cOYEuoPDPdqq6DU03g-ezr43tcfVCINBO6nQch6HyOxSRtWjO5Z11xxUHDBhyAJkE5VKNNygCoaCUVJ0MgXu96a3GvQ8go0mJ=s0-d-e1-ft#http://styles/default/xenforo/xenforo-smilies-sprite.png&quot;) 0px 0px no-repeat rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><div style="margin:1em 140px 1em 0px;padding:0px;border:1px solid rgb(221,229,234);overflow:auto;color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(248,251,253)"><div style="margin:0px;padding:8px;font-size:13px;color:rgb(52,77,93);border-bottom-width:1px;border-bottom-style:solid;border-bottom-color:rgb(221,229,234);background-color:rgb(255,255,255)">Code:</div><pre style="margin-top:0px;margin-bottom:0px;padding:0px 8px;font-family:Consolas,&quot;Courier New&quot;,Courier,monospace;line-height:26px;word-wrap:normal;font-size:10pt;overflow:auto;min-height:30px;max-height:500px;direction:ltr;background-image:-webkit-repeating-linear-gradient(top,rgba(0,0,0,0.0117647) 0px,rgba(0,0,0,0.0117647) 26px,rgba(0,0,0,0.0431373) 26px,rgba(0,0,0,0.0431373) 52px);background-repeat:repeat-x">NET | bond0    80% | pcki   13298 | pcko  133286 | si 3879 Kbps | so  807 Mbps | coll       0 | mlti      12 | erri       0 | erro       0 | drpi       0 | drpo       0 |
NET | eth1     80% | pcki   13298 | pcko  133286 | si 3879 Kbps | so  807 Mbps | coll       0 | mlti      12 | erri       0 | erro       0 | drpi       0 | drpo       0 |
NET | tap0      0% | pcki       4 | pcko       4 | si    0 Kbps | so   12 Kbps | coll       0 | mlti       0 | erri       0 | erro       0 | drpi       0 | drpo       0 |
NET | eth2</pre></div><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">it was all about stupid config file ..... and accually you need to edit proper config ....</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">First of all if you have working drbd9 cluster first stop all VMs and then all resources on both drbd nodes:</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><div style="margin:1em 140px 1em 0px;padding:0px;border:1px solid rgb(221,229,234);overflow:auto;color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(248,251,253)"><div style="margin:0px;padding:8px;font-size:13px;color:rgb(52,77,93);border-bottom-width:1px;border-bottom-style:solid;border-bottom-color:rgb(221,229,234);background-color:rgb(255,255,255)">Code:</div><pre style="margin-top:0px;margin-bottom:0px;padding:0px 8px;font-family:Consolas,&quot;Courier New&quot;,Courier,monospace;line-height:26px;word-wrap:normal;font-size:10pt;overflow:auto;min-height:30px;max-height:500px;direction:ltr;background-image:-webkit-repeating-linear-gradient(top,rgba(0,0,0,0.0117647) 0px,rgba(0,0,0,0.0117647) 26px,rgba(0,0,0,0.0431373) 26px,rgba(0,0,0,0.0431373) 52px);background-repeat:repeat-x">drbdadm disconnect all</pre></div><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">Then you need to edit config (and this is what i was looking for so long)</span><b style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"> /var/lib/drbd.d/drbdmanage_global_common.conf</b><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"> because editing /etc/drbd.d/global_common.conf doesnt work at all </span><img src="https://forum.proxmox.com/styles/default/xenforo/clear.png" alt=":)" title="Smile    :)" style="border:0px;vertical-align:text-bottom;margin:0px 1px;max-width:100%;width:18px;min-height:18px;color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background:url(&quot;https://ci4.googleusercontent.com/proxy/vrLCIN1cOYEuoPDPdqq6DU03g-ezr43tcfVCINBO6nQch6HyOxSRtWjO5Z11xxUHDBhyAJkE5VKNNygCoaCUVJ0MgXu96a3GvQ8go0mJ=s0-d-e1-ft#http://styles/default/xenforo/xenforo-smilies-sprite.png&quot;) 0px 0px no-repeat rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">Enter those settings to </span><b style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">/var/lib/drbd.d/drbdmanage_global_common.conf <span style="color:rgb(255,0,0)">ON BOTH NODES</span><br><div style="margin:1em 140px 1em 0px;padding:0px;border:1px solid rgb(221,229,234);overflow:auto;background-color:rgb(248,251,253)"><div style="margin:0px;padding:8px;font-size:13px;color:rgb(52,77,93);border-bottom-width:1px;border-bottom-style:solid;border-bottom-color:rgb(221,229,234);background-color:rgb(255,255,255)">Code:</div><pre style="margin-top:0px;margin-bottom:0px;padding:0px 8px;font-family:Consolas,&quot;Courier New&quot;,Courier,monospace;line-height:26px;word-wrap:normal;font-size:10pt;overflow:auto;min-height:30px;max-height:500px;direction:ltr;background-image:-webkit-repeating-linear-gradient(top,rgba(0,0,0,0.0117647) 0px,rgba(0,0,0,0.0117647) 26px,rgba(0,0,0,0.0431373) 26px,rgba(0,0,0,0.0431373) 52px);background-repeat:repeat-x"># it must be content of /var/lib/drbd.d/drbdmanage_global_common.conf !!!!
common {
disk {
        on-io-error             detach;
        no-disk-flushes ;
        no-disk-barrier;
        c-plan-ahead 10;
        c-fill-target 24M;
        c-min-rate 10M;
        c-max-rate 100M;
}.
net {
        # max-epoch-size          20000;
        max-buffers             36k;
        sndbuf-size            1024k ;
        rcvbuf-size            2048k;
}
}
</pre></div></b><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">Then simply restart drbd by:</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><b style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><div style="margin:1em 140px 1em 0px;padding:0px;border:1px solid rgb(221,229,234);overflow:auto;background-color:rgb(248,251,253)"><div style="margin:0px;padding:8px;font-size:13px;color:rgb(52,77,93);border-bottom-width:1px;border-bottom-style:solid;border-bottom-color:rgb(221,229,234);background-color:rgb(255,255,255)">Code:</div><pre style="margin-top:0px;margin-bottom:0px;padding:0px 8px;font-family:Consolas,&quot;Courier New&quot;,Courier,monospace;line-height:26px;word-wrap:normal;font-size:10pt;overflow:auto;min-height:30px;max-height:500px;direction:ltr;background-image:-webkit-repeating-linear-gradient(top,rgba(0,0,0,0.0117647) 0px,rgba(0,0,0,0.0117647) 26px,rgba(0,0,0,0.0431373) 26px,rgba(0,0,0,0.0431373) 52px);background-repeat:repeat-x">/etc/init.d/drbd restart</pre></div></b><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">And thats it. Syncing should be at 800mbits </span><img src="https://forum.proxmox.com/styles/default/xenforo/clear.png" alt=":)" title="Smile    :)" style="border:0px;vertical-align:text-bottom;margin:0px 1px;max-width:100%;width:18px;min-height:18px;color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background:url(&quot;https://ci4.googleusercontent.com/proxy/vrLCIN1cOYEuoPDPdqq6DU03g-ezr43tcfVCINBO6nQch6HyOxSRtWjO5Z11xxUHDBhyAJkE5VKNNygCoaCUVJ0MgXu96a3GvQ8go0mJ=s0-d-e1-ft#http://styles/default/xenforo/xenforo-smilies-sprite.png&quot;) 0px 0px no-repeat rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">In you have 10GBit just change c-max-rate to 1000M</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background-color:rgb(250,250,250)">Play with those settings </span><img src="https://forum.proxmox.com/styles/default/xenforo/clear.png" alt=":)" title="Smile    :)" style="border:0px;vertical-align:text-bottom;margin:0px 1px;max-width:100%;width:18px;min-height:18px;color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;line-height:20.5333px;background:url(&quot;https://ci4.googleusercontent.com/proxy/vrLCIN1cOYEuoPDPdqq6DU03g-ezr43tcfVCINBO6nQch6HyOxSRtWjO5Z11xxUHDBhyAJkE5VKNNygCoaCUVJ0MgXu96a3GvQ8go0mJ=s0-d-e1-ft#http://styles/default/xenforo/xenforo-smilies-sprite.png&quot;) 0px 0px no-repeat rgb(250,250,250)"><br></div></div><div class="gmail_extra"><span><br clear="all"><div><div data-smartmail="gmail_signature"><font style="color:rgb(153,153,153)" color="#666666" face="tahoma, sans-serif" size="1">-- <br><a href="http://sky-link.net" target="_blank">sky-link.net</a> Tytus Rogalewski<br>eMail: <a href="mailto:tytanick@gmail.com" target="_blank">tytanick@gmail.com</a><br>strona: <a href="http://sky-link.net" target="_blank">http://sky-link.net</a><br></font><font style="color:rgb(153,153,153)" size="1">kom. 790 202 300</font><br><font style="color:rgb(153,153,153)" color="#666666" face="tahoma, sans-serif" size="1">gg: 210533<br>skype: tytanick</font><font style="color:rgb(153,153,153)" size="1"><br>NIP: 9570976234<br>REGON: 221197388<br></font><br></div></div>
<br></span><div><div><div class="gmail_quote">2016-06-21 8:02 GMT+02:00 Tytus Rogalewski <span dir="ltr">&lt;<a href="mailto:tytanick@gmail.com" target="_blank">tytanick@gmail.com</a>&gt;</span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><p dir="ltr">Drbd 8.x was totally fine.<br>
9.0 in proxmox 4.2 is bugged i suppose.<br>
I will try 8.x in 4.2</p><div><div>
<div class="gmail_quote">21 cze 2016 01:00 &quot;Adam Goryachev&quot; &lt;<a href="mailto:mailinglists@websitemanagers.com.au" target="_blank">mailinglists@websitemanagers.com.au</a>&gt; napisał(a):<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On 20/06/16 22:47, Emmanuel Florac wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Le Sun, 19 Jun 2016 08:56:18 +0200<br>
Piero Baudino &lt;<a href="mailto:pbaudino@formatnet.it" target="_blank">pbaudino@formatnet.it</a>&gt; écrivait:<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi all,<br>
<br>
I have a cluster with 2 PVE servers with DRBD9.<br>
The replicated volume is about 7 Tb, the disks are 7200 rpm near line<br>
SAS. The communications channel for DRBD9 is done via 4 Gbit<br>
dedicated network cards in bond configuration (round robbin).<br>
I have created a VM with 1 Tb disk for test purpuse in the DRBD<br>
volume. After that, DRBD starts sync...<br>
The sync speed is about 10 Mbyte/sec<br>
The effective network speed misured with IPERF is about 3,6 Gbit/sec<br>
<br>
Is there a way to increse sync speed ?<br>
All the docs about this topic are related to 8.x.y DRBD version....<br>
</blockquote>
<br>
See this thread maybe:<br>
<a href="http://www.gossamer-threads.com/lists/drbd/users/27675" rel="noreferrer" target="_blank">http://www.gossamer-threads.com/lists/drbd/users/27675</a><br>
<br>
</blockquote>
<br>
Stupid question perhaps, but doesn&#39;t that thread also relate to 8.4.x rather than 9.0.x ?<br>
<br>
<br>
-- <br>
Adam Goryachev Website Managers <a href="http://www.websitemanagers.com.au" rel="noreferrer" target="_blank">www.websitemanagers.com.au</a><br>
_______________________________________________<br>
drbd-user mailing list<br>
<a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a><br>
<a href="http://lists.linbit.com/mailman/listinfo/drbd-user" rel="noreferrer" target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
</blockquote></div>
</div></div></blockquote></div><br></div></div></div>
</blockquote></div><br></div></div></div>
</blockquote></div><br></div>