<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
        {font-family:Calibri;
        panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0cm;
        margin-bottom:.0001pt;
        font-size:11.0pt;
        font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
        {mso-style-priority:99;
        color:blue;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {mso-style-priority:99;
        color:purple;
        text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
        {mso-style-priority:99;
        margin-top:0cm;
        margin-right:0cm;
        margin-bottom:0cm;
        margin-left:36.0pt;
        margin-bottom:.0001pt;
        font-size:11.0pt;
        font-family:"Calibri","sans-serif";}
span.EmailStyle17
        {mso-style-type:personal-compose;
        font-family:"Calibri","sans-serif";
        color:windowtext;}
.MsoChpDefault
        {mso-style-type:export-only;
        font-family:"Calibri","sans-serif";}
@page WordSection1
        {size:612.0pt 792.0pt;
        margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
        {page:WordSection1;}
/* List Definitions */
@list l0
        {mso-list-id:573777594;
        mso-list-type:hybrid;
        mso-list-template-ids:2069542374 669299256 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l0:level1
        {mso-level-text:"%1\)";
        mso-level-tab-stop:none;
        mso-level-number-position:left;
        text-indent:-18.0pt;
        mso-ansi-font-size:11.0pt;
        mso-bidi-font-size:11.0pt;
        mso-ansi-font-weight:normal;
        mso-bidi-font-weight:normal;}
@list l0:level2
        {mso-level-number-format:alpha-lower;
        mso-level-tab-stop:none;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l0:level3
        {mso-level-number-format:roman-lower;
        mso-level-tab-stop:none;
        mso-level-number-position:right;
        text-indent:-9.0pt;}
@list l0:level4
        {mso-level-tab-stop:none;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l0:level5
        {mso-level-number-format:alpha-lower;
        mso-level-tab-stop:none;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l0:level6
        {mso-level-number-format:roman-lower;
        mso-level-tab-stop:none;
        mso-level-number-position:right;
        text-indent:-9.0pt;}
@list l0:level7
        {mso-level-tab-stop:none;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l0:level8
        {mso-level-number-format:alpha-lower;
        mso-level-tab-stop:none;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l0:level9
        {mso-level-number-format:roman-lower;
        mso-level-tab-stop:none;
        mso-level-number-position:right;
        text-indent:-9.0pt;}
ol
        {margin-bottom:0cm;}
ul
        {margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal>Hi there,<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>I’ve been using drbd for approx. 2 years now, and never had any big problems.<o:p></o:p></p><p class=MsoNormal>Recently, one of two machines in my cluster crashed, and I had to reinstall it completely.<o:p></o:p></p><p class=MsoNormal>Now I seem to be unable to sync that second machine with the first one.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>The situation:<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>I’m using drbd 8.4.0<o:p></o:p></p><p class=MsoNormal>Machine 1 is called earth, machine 2 is called vulcan.<o:p></o:p></p><p class=MsoNormal>Earth is the survivor half of my cluster, and vulcan had to be rebuilt.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>The actions I’ve taken:<o:p></o:p></p><p class=MsoNormal>After compiling drbd on vulcan, I copied the resource file from /etc/drbd.d from earth to<o:p></o:p></p><p class=MsoNormal>vulcan in the same place. In this case, the resource file for mysql, which looks like this :<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoListParagraph><span style='color:#3366FF'>resource mysql {<br> protocol C;<br> syncer {<br> rate 4M;<br> }<br> startup {<br> wfc-timeout 15;<br> degr-wfc-timeout 60;<br> }<o:p></o:p></span></p><p class=MsoListParagraph><span style='color:#3366FF'>handlers {<o:p></o:p></span></p><p class=MsoListParagraph><span style='color:#3366FF'>split-brain "/usr/lib/drbd/notify-split-brain.sh j.lammerts@chello.nl";<br>}<o:p></o:p></span></p><p class=MsoListParagraph><span style='color:#3366FF'>net {<br> cram-hmac-alg sha1;<br> shared-secret "xxxxxxxxxxx";<o:p></o:p></span></p><p class=MsoListParagraph><span style='color:#3366FF'>verify-alg sha1;<o:p></o:p></span></p><p class=MsoListParagraph><span style='color:#3366FF'><o:p> </o:p></span></p><p class=MsoListParagraph><span style='color:#3366FF'>after-sb-0pri discard-zero-changes;<o:p></o:p></span></p><p class=MsoListParagraph><span style='color:#3366FF'>after-sb-1pri discard-secondary;<o:p></o:p></span></p><p class=MsoNormal><span style='color:#3366FF'> after-sb-2pri disconnect;<br> }<br> on vulcan {<br> device /dev/drbd0;<br> disk /dev/sda5;<br> address 192.168.0.15:7788;<br> meta-disk internal;<br> }<br> on earth {<br> device /dev/drbd0;<br> disk /dev/sda5;<br> address 192.168.0.5:7788;<br> meta-disk internal;<br> }<br>}<br><br></span><o:p></o:p></p><p class=MsoNormal>Then, I created the device meta-data on vulcan:<o:p></o:p></p><p class=MsoNormal>drbdadm create-md mysql<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>After (re)starting drbd on both machines, the cat /proc/drbd shows this:<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>earth:<o:p></o:p></p><p class=MsoNormal>[root@earth ~]# cat /proc/drbd<o:p></o:p></p><p class=MsoNormal>version: 8.4.0 (api:1/proto:86-100)<o:p></o:p></p><p class=MsoNormal>GIT-hash: 28753f559ab51b549d16bcf487fe625d5919c49c build by root@earth, 2013-09-07 17:35:35<o:p></o:p></p><p class=MsoNormal> 0: cs:StandAlone ro:Primary/Unknown ds:UpToDate/DUnknown r-----<o:p></o:p></p><p class=MsoNormal> <span lang=NL>ns:0 nr:0 dw:19360172 dr:6497416 al:138 bm:50 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:216372<o:p></o:p></span></p><p class=MsoNormal><span lang=NL><o:p> </o:p></span></p><p class=MsoNormal>vulcan:<o:p></o:p></p><p class=MsoNormal>[root@vulcan drbd.d]# cat /proc/drbd<o:p></o:p></p><p class=MsoNormal>version: 8.4.0 (api:1/proto:86-100)<o:p></o:p></p><p class=MsoNormal>GIT-hash: 28753f559ab51b549d16bcf487fe625d5919c49c build by root@vulcan, 2013-09-12 16:25:17<o:p></o:p></p><p class=MsoNormal> 0: cs:StandAlone ro:Secondary/Unknown ds:Inconsistent/DUnknown r----s<o:p></o:p></p><p class=MsoNormal> <span lang=NL>ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:4652876<o:p></o:p></span></p><p class=MsoNormal><span lang=NL><o:p> </o:p></span></p><p class=MsoNormal>So both Standalone, and Primary/Unknown vs. Secondary/Unknown.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Having Googled for this situation and its solution, I tried the solution as described in the Linbit DRBD manual,<o:p></o:p></p><p class=MsoNormal>but “stopping short of 5.4”. The only thing that happens (as far as I can see) is that earth briefly goes into<o:p></o:p></p><p class=MsoNormal>the WFConnection state, and nothing else.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>I tried the following as well:<o:p></o:p></p><p class=MsoNormal>On earth:<o:p></o:p></p><p class=MsoNormal>drbdadm connect all<o:p></o:p></p><p class=MsoNormal>On vulcan:<o:p></o:p></p><p class=MsoNormal>drbdadm -- --discard-my-data connect all (or drbdadm connect –discard-my-data mysql, can’t remember exactly)<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>But this did not get the synching of the resource started as well.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>I’m out of ideas, and can’t really find anything searching Google different from what I have already tried.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>So, please, if anyone can give me a clou on how to resolve this situation, preferably without losing any data on earth,<o:p></o:p></p><p class=MsoNormal>I would be most grateful.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Thanks,<o:p></o:p></p><p class=MsoNormal>Hans<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p></div></body></html>