<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Actually, that makes some sense. If the network is way faster than the sync, and the dd (which doesn’t even use the network) is the same speed, then there is something bad wrong with the underlying device or configuration.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>You are not going to be happy until you get that fixed. Then, the dd should beat the sync by a good bit.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>You can skip the dd and build your filesystem and use it RIGHT NOW, but there is still something wrong and the performance will probably suck. But, you can get some work done. <o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>If fixing the underlying problem doesn’t wipe your data, then an online verify and disconnect/connect (of the secondary node) will get you synced up with zero downtime.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>hth<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Dan<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Matt Baer [mailto:mbaer@lrnet1.com] <br><b>Sent:</b> Friday, August 05, 2011 12:34 PM<br><b>To:</b> Dan Barker<br><b>Subject:</b> Re: [DRBD-user] DRBD won't take 1G syncer rate<o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal style='margin-bottom:12.0pt'>Ok, looking at this, my guess is that dd and the sync would take roughly the same amount of time. Actually, if I am to believe the output of the kill command you included, using dd will actually take more time. So I just take your previous instructions and omit the dd command to skip it?<br><br>I don't care if the sync takes forever, I just want to be able to DO something while it's syncing.<br><br><o:p></o:p></p><div><p class=MsoNormal>On Fri, Aug 5, 2011 at 11:15 AM, Dan Barker <<a href="mailto:dbarker@visioncomm.net">dbarker@visioncomm.net</a>> wrote:<o:p></o:p></p><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>OK, You can skip the zero, but the devices won’t pass an online verify. It won’t hurt anything. All the sectors that need to be synced will be synced. The disks are mostly zeros, so an online verify wouldn’t do much, but it’s nice to know.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>To find out how long the DD will take, “kill –USR1 taskid” (frightening command, but it makes dd tell you how far it’s along and does NOT kill it. The 1M blocksize will help a lot. dd defaults to 512).</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>If you do skip the dd, the first verify will identify all the non-zero sectors, and they’ll sync up 100’s of times faster than a full sync.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>Good Luck!</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>Dan</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span style='font-size:10.0pt'>From:</span></b><span style='font-size:10.0pt'> Matt Baer [mailto:<a href="mailto:mbaer@lrnet1.com" target="_blank">mbaer@lrnet1.com</a>] <br><b>Sent:</b> Friday, August 05, 2011 12:10 PM</span><o:p></o:p></p><div><div><p class=MsoNormal><br><b>To:</b> Dan Barker<br><b>Subject:</b> Re: [DRBD-user] DRBD won't take 1G syncer rate<o:p></o:p></p></div></div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;margin-bottom:12.0pt'>Roger that. It's running, but they're 1.8TB a piece so it'll take a while. Just wanted to let you know, no need for it to go to the list. Thanks for the help thus far, it's been difficult to deal with this and I have to get it running ASAP.<o:p></o:p></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>On Fri, Aug 5, 2011 at 11:06 AM, Dan Barker <<a href="mailto:dbarker@visioncomm.net" target="_blank">dbarker@visioncomm.net</a>> wrote:<o:p></o:p></p><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>That’s not the backing device. The backing device is something like /dev/sdb. The drbd device is called device in your config. The backing device is called disk.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>It should not be mounted.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>Dan</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span style='font-size:10.0pt'>From:</span></b><span style='font-size:10.0pt'> Matt Baer [mailto:<a href="mailto:mbaer@lrnet1.com" target="_blank">mbaer@lrnet1.com</a>] <br><b>Sent:</b> Friday, August 05, 2011 11:44 AM</span><o:p></o:p></p><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><br><b>To:</b> Dan Barker<br><b>Cc:</b> <a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a><br><b>Subject:</b> Re: [DRBD-user] DRBD won't take 1G syncer rate<o:p></o:p></p></div></div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;margin-bottom:12.0pt'>After I down all, it won't let me issue the dd command citing:<br><br>dd: opening `/dev/drbd0': Read-only file system<o:p></o:p></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>On Fri, Aug 5, 2011 at 10:37 AM, Dan Barker <<a href="mailto:dbarker@visioncomm.net" target="_blank">dbarker@visioncomm.net</a>> wrote:<o:p></o:p></p><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>We’ve been off-list for a few messages, but this is now interesting enough to be public. I apologize for the top-posting. Please read backwards. Dan</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>Well, to be certain, I’d dd the disks to zeros individually, and then start with them sync’d. </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>drbdadm down all</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>dd if=/dev/zero of=/drbdbackingdevice bs=1M oflag=direct</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>on both sides.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>New Blank Disk:</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>===============</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>#On both nodes, initialize meta data and configure the device.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>drbdadm -- --force create-md r0</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>#They need to do the initial handshake, so they know their sizes.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>drbdadm up r0</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>#They are now Connected Secondary/Secondary Inconsistent/Inconsistent. Generate a new current-uuid and clear the dirty bitmap.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>drbdadm -- --clear-bitmap new-current-uuid r0</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>#They are now Connected Secondary/Secondary UpToDate/UpToDate.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>drbdadm primary r0</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>Now, recreate your empty ext3 file system and you are in sync.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>Dan</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span style='font-size:10.0pt'>From:</span></b><span style='font-size:10.0pt'> Matt Baer [mailto:<a href="mailto:mbaer@lrnet1.com" target="_blank">mbaer@lrnet1.com</a>] <br><b>Sent:</b> Friday, August 05, 2011 11:26 AM<br><b>To:</b> Dan Barker</span><o:p></o:p></p><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><br><b>Cc:</b> <a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a><br><b>Subject:</b> Re: [DRBD-user] DRBD won't take 1G syncer rate<o:p></o:p></p></div></div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;margin-bottom:12.0pt'>Well we're the perfect supplements for each other because, as you can see, I don't know DRBD from a hole in the wall.<br><br>Yes, it's a brand new resource. I don't think I would say it's full of zeros, as it has a clean ext3 file system on it.<br><br>Yes, I would LOVE to skip the sync, I've been dealing with this for weeks now and right when I was about to go live, I tested the failover and it didn't work because of a service heartbeat wanted to start wasn't going all that well. While troubleshooting, I lost my 100% perfectly live server and have to start from scratch. Problem is I only have two days to do it and the thing has to sync 1.8TB at 12MB/s. I have no idea where the bottleneck could be. Two servers, a cable connecting eth1 to eth1, both are auto-negotiated at 1gbps on their own /30 subnet. The only thing there would be garbage NIC cards, possible, but not probable, or the cable, more likely, but I've never had an issue with it until now. Freshly constructed servers, too.<br><br>I tried the drbdsetup /dev/drbd0 syncer -r 120M, been running like that for about 5 minutes now and it hasn't changed at all.<o:p></o:p></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>On Fri, Aug 5, 2011 at 10:13 AM, Dan Barker <<a href="mailto:dbarker@visioncomm.net" target="_blank">dbarker@visioncomm.net</a>> wrote:<o:p></o:p></p><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>Is this a brand new resource? Why are you doing a full sync? If it’s brand new (full of zeros), you can skip the sync. Instructions upon request.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>Btw, I don’t know why you are getting 12% of your requested syncer rate. I’m not a hot-shot linux performace analyzer, but there is a bottleneck somewhere. I get 25M routinely here on GB nics. I have my Syncer set to 25M. It drops to about 14M (each) if 2 are syncing.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>To change sync rate without stop/start drbd: drbdsetup /dev/drbd1 syncer -r 120M</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>AL Extents seems a bit low. I use 1801 (big prime number that felt about right).</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>Dan</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span style='font-size:10.0pt'>From:</span></b><span style='font-size:10.0pt'> Matt Baer [mailto:<a href="mailto:mbaer@lrnet1.com" target="_blank">mbaer@lrnet1.com</a>] <br><b>Sent:</b> Friday, August 05, 2011 11:03 AM<br><b>To:</b> Dan Barker</span><o:p></o:p></p><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><br><b>Subject:</b> Re: [DRBD-user] DRBD won't take 1G syncer rate<o:p></o:p></p></div></div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;margin-bottom:12.0pt'>Ok, revised /etc/drbd.conf and restarted DRBD with the following<o:p></o:p></p><div style='margin-left:30.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>common { syncer { rate 100M; al-extents 257; } }<o:p></o:p></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;margin-bottom:12.0pt'><br>And I'm getting from /proc/drbd:<o:p></o:p></p><div style='margin-left:30.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;margin-bottom:12.0pt'>GIT-hash: 3e69822d3bb4920a8c1bfdf7d647169eba7d2eb4 build by buildsvn@c5-x8664-build, 2008-10-03 11:30:17<br> 0: cs:SyncTarget st:Secondary/Primary ds:Inconsistent/UpToDate C r---<br> ns:0 nr:281056 dw:272864 dr:0 al:0 bm:16 lo:257 pe:1969 ua:256 ap:0 oos:1308428488<br> [>....................] sync'ed: 0.1% (1277762/1278028)M<br> finish: 25:57:39 speed: 13,904 (12,400) K/sec<o:p></o:p></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;margin-bottom:12.0pt'>And I only have one resource, r0. All it's syncing right now is the post mkfs.ext3 /dev/drbd0<o:p></o:p></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>On Fri, Aug 5, 2011 at 9:51 AM, Dan Barker <<a href="mailto:dbarker@visioncomm.net" target="_blank">dbarker@visioncomm.net</a>> wrote:<o:p></o:p></p><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>You are still mixing megabits and megabytes. Your 1000 megabit pipe won’t take a 600 megabyte stream, or a 150 megabyte stream. The maximum is about 125 MBps.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>DRBD talks (and is documented to talk) bytes. Most everyone else talks bits.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>You don’t mention the speed you are getting.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>Also, if you have 3 resources syncing, each will try for the syncer limit. So, to use 50% of your capacity to sync 3 resources, you’d specify the rate as 21M. Note: you can change the rate on the fly, during a sync.</span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'>Dan </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:#1F497D'> </span><o:p></o:p></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span style='font-size:10.0pt'>From:</span></b><span style='font-size:10.0pt'> <a href="mailto:drbd-user-bounces@lists.linbit.com" target="_blank">drbd-user-bounces@lists.linbit.com</a> [mailto:<a href="mailto:drbd-user-bounces@lists.linbit.com" target="_blank">drbd-user-bounces@lists.linbit.com</a>] <b>On Behalf Of </b>Matt Baer<br><b>Sent:</b> Friday, August 05, 2011 8:51 AM<br><b>To:</b> Caspar Smit<br><b>Cc:</b> <a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a><br><b>Subject:</b> Re: [DRBD-user] DRBD won't take 1G syncer rate</span><o:p></o:p></p><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> <o:p></o:p></p><p>I was playing with the settings yesterday and it let me set it at 600M and it didn't make a difference in the sync speed at all. I then tried it with your suggestion, dropped it to 150M just to be safe. Still no difference. I wonder what the deal is. Could it be that this is the initial sync?<o:p></o:p></p><p> <o:p></o:p></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>On Aug 5, 2011 1:29 AM, "Caspar Smit" <<a href="mailto:c.smit@truebit.nl" target="_blank">c.smit@truebit.nl</a>> wrote:<br>> Hi Matt,<br>> <br>> 1000M means 1000 Mb/s NOT 1000mbps. To reach 1000M you should have at least<br>> one (probably two) 10gbit interface(s). Since you have two 1gbit interfaces<br>> (bonded with balance-rr?) a value between 100M and around 170M would be more<br>> appropiate.<br>> <br>> Kind regards,<br>> Caspar<br>> Op 5 aug. 2011 08:21 schreef "Matt Baer" <<a href="mailto:mbaer@lrnet1.com" target="_blank">mbaer@lrnet1.com</a>> het volgende:<br>>> When setting the syncer rate in drbd.conf to 1G, it won't start, citing<br>> that<br>>> 1G is invalid. Get the same thing with 1000M. Any clue as to why? It<br>>> explicitly states that <<a href="mailto:mbaer@lrnet1.com" target="_blank">mbaer@lrnet1.com</a>>1G is acceptable in the docs.<br>> I've<br>>> triple checked and both interfaces are auto-negotiated at 1000mbps full<br>>> duplex.<o:p></o:p></p></div></div></div></div></div><p class=MsoNormal style='mso-margin-top-alt:auto;margin-bottom:12.0pt'><br>_______________________________________________<br>drbd-user mailing list<br><a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a><br><a href="http://lists.linbit.com/mailman/listinfo/drbd-user" target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><o:p></o:p></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><br><br clear=all><br>-- <br>Thanks,<br>Matt Baer<br>Network Manager<br>Leaf River Telephone Company<br>102 W Second Street<br>Leaf River, IL <br><a href="tel:815.738.2211" target="_blank">815.738.2211</a> - Main Office<br><a href="tel:866.738.2211" target="_blank">866.738.2211</a> - Toll Free<br><a href="mailto:mbaer@lrnet1.com" target="_blank">mbaer@lrnet1.com</a><o:p></o:p></p></div></div></div></div></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><br><br clear=all><br>-- <br>Thanks,<br>Matt Baer<br>Network Manager<br>Leaf River Telephone Company<br>102 W Second Street<br>Leaf River, IL <br><a href="tel:815.738.2211" target="_blank">815.738.2211</a> - Main Office<br><a href="tel:866.738.2211" target="_blank">866.738.2211</a> - Toll Free<br><a href="mailto:mbaer@lrnet1.com" target="_blank">mbaer@lrnet1.com</a><o:p></o:p></p></div></div></div></div></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><br><br clear=all><br>-- <br>Thanks,<br>Matt Baer<br>Network Manager<br>Leaf River Telephone Company<br>102 W Second Street<br>Leaf River, IL <br><a href="tel:815.738.2211" target="_blank">815.738.2211</a> - Main Office<br><a href="tel:866.738.2211" target="_blank">866.738.2211</a> - Toll Free<br><a href="mailto:mbaer@lrnet1.com" target="_blank">mbaer@lrnet1.com</a><o:p></o:p></p></div></div></div></div></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><br><br clear=all><br>-- <br>Thanks,<br>Matt Baer<br>Network Manager<br>Leaf River Telephone Company<br>102 W Second Street<br>Leaf River, IL <br><a href="tel:815.738.2211" target="_blank">815.738.2211</a> - Main Office<br><a href="tel:866.738.2211" target="_blank">866.738.2211</a> - Toll Free<br><a href="mailto:mbaer@lrnet1.com" target="_blank">mbaer@lrnet1.com</a><o:p></o:p></p></div></div></div></div></div><p class=MsoNormal><br><br clear=all><br>-- <br>Thanks,<br>Matt Baer<br>Network Manager<br>Leaf River Telephone Company<br>102 W Second Street<br>Leaf River, IL <br>815.738.2211 - Main Office<br>866.738.2211 - Toll Free<br><a href="mailto:mbaer@lrnet1.com" target="_blank">mbaer@lrnet1.com</a><o:p></o:p></p></div></body></html>