<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">The errors in connecting are logged. If you can’t find them, attempt to connect a resource (drbdadm connect r1, for example) to create the errors again, and
then look at the logs for the reason the connection was not established. The “status” will continue to show waiting for connection (WFC) but there will be a reason in the log files. If the logs are unclear, post the relevant portions back here and we’ll help.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Something like ‘dmesg | grep drbd’. You may want to do the logs on both drbd servers. You can do the connect command on either.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">hth<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Dan<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="margin-left:.5in"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> drbd-user-bounces@lists.linbit.com [mailto:drbd-user-bounces@lists.linbit.com]
<b>On Behalf Of </b>Eric<br>
<b>Sent:</b> Monday, January 21, 2013 1:24 AM<br>
<b>To:</b> drbd-user@lists.linbit.com<br>
<b>Subject:</b> [DRBD-user] Diagnosing a Failed Resource<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="font-size:10.0pt;font-family:"Courier New";color:black">I've configured corosync+pacemaker to managee a simple two-resource DRBD cluster:<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="font-size:10.0pt;font-family:"Courier New";color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Courier New";color:black">> san1:~ # crm configure show | cat -<br>
> node san1 \<br>
> attributes standby="off"<br>
> node san2 \<br>
> attributes standby="off"<br>
> primitive p_DRBD-r0 ocf:linbit:drbd \<br>
> params drbd_resource="r0" \<br>
> op monitor interval="60s"<br>
> primitive p_DRBD-r1 ocf:linbit:drbd \<br>
> params drbd_resource="r1" \<br>
> op monitor interval="60s"<br>
> primitive p_IP-1_253 ocf:heartbeat:IPaddr2 \<br>
> params ip="192.168.1.253" cidr_netmask="24" \<br>
> op monitor interval="30s"<br>
> primitive p_IP-1_254 ocf:heartbeat:IPaddr2 \<br>
> params ip="192.168.1.254" cidr_netmask="24" \<br>
> op monitor interval="30s"<br>
> primitive p_iSCSI-san1 ocf:heartbeat:iSCSITarget \<br>
> params iqn="iqn.2012-11.com.example.san1:sda" \<br>
> op monitor interval="10s"<br>
> primitive p_iSCSI-san1_0 ocf:heartbeat:iSCSILogicalUnit \<br>
> params target_iqn="iqn.2012-11.com.example.san1:sda" lun="0" path="/dev/drbd0" \<br>
> op monitor interval="10s"<br>
> primitive p_iSCSI-san1_1 ocf:heartbeat:iSCSILogicalUnit \<br>
> params target_iqn="iqn.2012-11.com.example.san1:sda" lun="1" path="/dev/drbd1" \<br>
> op monitor interval="10s"<br>
> primitive p_iSCSI-san1_2 ocf:heartbeat:iSCSILogicalUnit \<br>
> params target_iqn="iqn.2012-11.com.example.san1:sda" lun="2" path="/dev/drbd2" \<br>
> op monitor interval="10s"<br>
> primitive p_iSCSI-san1_3 ocf:heartbeat:iSCSILogicalUnit \<br>
> params target_iqn="iqn.2012-11.com.example.san1:sda" lun="3" path="/dev/drbd3" \<br>
> op monitor interval="10s"<br>
> primitive p_iSCSI-san2 ocf:heartbeat:iSCSITarget \<br>
> params iqn="iqn.2012-11.com.example.san2:sda" \<br>
> op monitor interval="10s"<br>
> primitive p_iSCSI-san2_0 ocf:heartbeat:iSCSILogicalUnit \<br>
> params target_iqn="iqn.2012-11.com.example.san2:sda" lun="0" path="/dev/drbd1000" \<br>
> op monitor interval="10s"<br>
> primitive p_iSCSI-san2_1 ocf:heartbeat:iSCSILogicalUnit \<br>
> params target_iqn="iqn.2012-11.com.example.san2:sda" lun="1" path="/dev/drbd1001" \<br>
> op monitor interval="10s"<br>
> primitive p_iSCSI-san2_2 ocf:heartbeat:iSCSILogicalUnit \<br>
> params target_iqn="iqn.2012-11.com.example.san2:sda" lun="2" path="/dev/drbd1002" \<br>
> op monitor interval="10s"<br>
> primitive p_iSCSI-san2_3 ocf:heartbeat:iSCSILogicalUnit \<br>
> params target_iqn="iqn.2012-11.com.example.san2:sda" lun="3" path="/dev/drbd1003" \<br>
> op monitor interval="10s"<br>
> group g_iSCSI-san1 p_iSCSI-san1 p_iSCSI-san1_0 p_iSCSI-san1_1 p_iSCSI-san1_2 p_iSCSI-san1_3 p_IP-1_254<br>
> group g_iSCSI-san2 p_iSCSI-san2 p_iSCSI-san2_0 p_iSCSI-san2_1 p_iSCSI-san2_2 p_iSCSI-san2_3 p_IP-1_253<br>
> ms ms_DRBD-r0 p_DRBD-r0 \<br>
> meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true"<br>
> ms ms_DRBD-r1 p_DRBD-r1 \<br>
> meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true"<br>
> location l_iSCSI-san1_and_DRBD-r0 p_IP-1_254 10240: san1<br>
> location l_iSCSI-san2_and_DRBD-r1 p_IP-1_253 10240: san2<br>
> colocation c_iSCSI_with_DRBD-r0 inf: g_iSCSI-san1 ms_DRBD-r0:Master<br>
> colocation c_iSCSI_with_DRBD-r1 inf: g_iSCSI-san2 ms_DRBD-r1:Master<br>
> order o_DRBD-r0_before_iSCSI-san1 inf: ms_DRBD-r0:promote g_iSCSI-san1:start<br>
> order o_DRBD-r1_before_iSCSI-san2 inf: ms_DRBD-r1:promote g_iSCSI-san2:start<br>
> property $id="cib-bootstrap-options" \<br>
> dc-version="1.1.7-77eeb099a504ceda05d648ed161ef8b1582c7daf" \<br>
> cluster-infrastructure="openais" \<br>
> expected-quorum-votes="2" \<br>
> stonith-enabled="false" \<br>
> no-quorum-policy="ignore"<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Courier New";color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Courier New";color:black">The cluster appears to be functioning correctly:<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in;background:white"><span style="font-size:10.0pt;font-family:"Courier New";color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:12.0pt;margin-left:.5in">
<span style="font-size:10.0pt;font-family:"Courier New";color:black">> san1:~ # crm_mon -1<br>
> ============<br>
> Last updated: Sun Jan 20 22:20:17 2013<br>
> Last change: Sun Jan 20 21:59:15 2013 by root via crm_attribute on san1<br>
> Stack: openais<br>
> Current DC: san1 - partition with quorum<br>
> Version: 1.1.7-77eeb099a504ceda05d648ed161ef8b1582c7daf<br>
> 2 Nodes configured, 2 expected votes<br>
> 16 Resources configured.<br>
> ============<br>
> <br>
> Online: [ san1 san2 ]<br>
> <br>
> Master/Slave Set: ms_DRBD-r0 [p_DRBD-r0]<br>
> Masters: [ san1 ]<br>
> Slaves: [ san2 ]<br>
> Resource Group: g_iSCSI-san1<br>
> p_iSCSI-san1 (ocf::heartbeat:iSCSITarget): Started san1<br>
> p_iSCSI-san1_0 (ocf::heartbeat:iSCSILogicalUnit): Started san1<br>
> p_iSCSI-san1_1 (ocf::heartbeat:iSCSILogicalUnit): Started san1<br>
> p_iSCSI-san1_2 (ocf::heartbeat:iSCSILogicalUnit): Started san1<br>
> p_iSCSI-san1_3 (ocf::heartbeat:iSCSILogicalUnit): Started san1<br>
> p_IP-1_254 (ocf::heartbeat:IPaddr2): Started san1<br>
> Master/Slave Set: ms_DRBD-r1 [p_DRBD-r1]<br>
> Masters: [ san2 ]<br>
> Slaves: [ san1 ]<br>
> Resource Group: g_iSCSI-san2<br>
> p_iSCSI-san2 (ocf::heartbeat:iSCSITarget): Started san2<br>
> p_iSCSI-san2_0 (ocf::heartbeat:iSCSILogicalUnit): Started san2<br>
> p_iSCSI-san2_1 (ocf::heartbeat:iSCSILogicalUnit): Started san2<br>
> p_iSCSI-san2_2 (ocf::heartbeat:iSCSILogicalUnit): Started san2<br>
> p_iSCSI-san2_3 (ocf::heartbeat:iSCSILogicalUnit): Started san2<br>
> p_IP-1_253 (ocf::heartbeat:IPaddr2): Started san2<br>
<br>
> san2:~ # crm_mon -1<br>
> ============<br>
> Last updated: Sun Jan 20 22:20:17 2013<br>
> Last change: Sun Jan 20 21:59:15 2013 by root via crm_attribute on san1<br>
> Stack: openais<br>
> Current DC: san1 - partition with quorum<br>
> Version: 1.1.7-77eeb099a504ceda05d648ed161ef8b1582c7daf<br>
> 2 Nodes configured, 2 expected votes<br>
> 16 Resources configured.<br>
> ============<br>
> <br>
> Online: [ san1 san2 ]<br>
> <br>
> Master/Slave Set: ms_DRBD-r0 [p_DRBD-r0]<br>
> Masters: [ san1 ]<br>
> Slaves: [ san2 ]<br>
> Resource Group: g_iSCSI-san1<br>
> p_iSCSI-san1 (ocf::heartbeat:iSCSITarget): Started san1<br>
> p_iSCSI-san1_0 (ocf::heartbeat:iSCSILogicalUnit): Started san1<br>
> p_iSCSI-san1_1 (ocf::heartbeat:iSCSILogicalUnit): Started san1<br>
> p_iSCSI-san1_2 (ocf::heartbeat:iSCSILogicalUnit): Started san1<br>
> p_iSCSI-san1_3 (ocf::heartbeat:iSCSILogicalUnit): Started san1<br>
> p_IP-1_254 (ocf::heartbeat:IPaddr2): Started san1<br>
> Master/Slave Set: ms_DRBD-r1 [p_DRBD-r1]<br>
> Masters: [ san2 ]<br>
> Slaves: [ san1 ]<br>
> Resource Group: g_iSCSI-san2<br>
> p_iSCSI-san2 (ocf::heartbeat:iSCSITarget): Started san2<br>
> p_iSCSI-san2_0 (ocf::heartbeat:iSCSILogicalUnit): Started san2<br>
> p_iSCSI-san2_1 (ocf::heartbeat:iSCSILogicalUnit): Started san2<br>
> p_iSCSI-san2_2 (ocf::heartbeat:iSCSILogicalUnit): Started san2<br>
> p_iSCSI-san2_3 (ocf::heartbeat:iSCSILogicalUnit): Started san2<br>
> p_IP-1_253 (ocf::heartbeat:IPaddr2): Started san2<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Courier New";color:black">However, the two DRBD resources do not appear to be communicating:<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Courier New";color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Courier New";color:black">> san1:~ # cat /proc/drbd
<br>
> version: 8.4.1 (api:1/proto:86-100)<br>
> GIT-hash: 91b4c048c1a0e06777b5f65d312b38d47abaea80 build by phil@fat-tyre, 2011-12-20 12:43:15<br>
> 0: cs:StandAlone ro:Primary/Unknown ds:UpToDate/DUnknown r-----<br>
> ns:0 nr:0 dw:0 dr:664 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:3259080<br>
> 1: cs:StandAlone ro:Primary/Unknown ds:UpToDate/DUnknown r-----<br>
> ns:0 nr:0 dw:0 dr:664 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<br>
> 2: cs:StandAlone ro:Primary/Unknown ds:UpToDate/DUnknown r-----<br>
> ns:0 nr:0 dw:0 dr:664 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<br>
> 3: cs:StandAlone ro:Primary/Unknown ds:UpToDate/DUnknown r-----<br>
> ns:0 nr:0 dw:0 dr:664 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<br>
> <br>
> 1000: cs:StandAlone ro:Secondary/Unknown ds:UpToDate/DUnknown r-----<br>
> ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<br>
> 1001: cs:StandAlone ro:Secondary/Unknown ds:UpToDate/DUnknown r-----<br>
> ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<br>
> 1002: cs:StandAlone ro:Secondary/Unknown ds:UpToDate/DUnknown r-----<br>
> ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<br>
> 1003: cs:StandAlone ro:Secondary/Unknown ds:UpToDate/DUnknown r-----<br>
> ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Courier New";color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:12.0pt;margin-left:.5in">
<span style="font-size:10.0pt;font-family:"Courier New";color:black">> san2:~ # cat /proc/drbd
<br>
> version: 8.4.1 (api:1/proto:86-100)<br>
> GIT-hash: 91b4c048c1a0e06777b5f65d312b38d47abaea80 build by phil@fat-tyre, 2011-12-20 12:43:15<br>
> 0: cs:WFConnection ro:Secondary/Unknown ds:UpToDate/DUnknown C r-----<br>
> ns:0 nr:0 dw:0 dr:664 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:140<br>
> 1: cs:WFConnection ro:Secondary/Unknown ds:UpToDate/DUnknown C r-----<br>
> ns:0 nr:0 dw:0 dr:664 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<br>
> 2: cs:WFConnection ro:Secondary/Unknown ds:UpToDate/DUnknown C r-----<br>
> ns:0 nr:0 dw:0 dr:664 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<br>
> 3: cs:WFConnection ro:Secondary/Unknown ds:UpToDate/DUnknown C r-----<br>
> ns:0 nr:0 dw:0 dr:664 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<br>
> <br>
> 1000: cs:WFConnection ro:Primary/Unknown ds:UpToDate/DUnknown C r-----<br>
> ns:0 nr:0 dw:0 dr:664 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<br>
> 1001: cs:WFConnection ro:Primary/Unknown ds:UpToDate/DUnknown C r-----<br>
> ns:0 nr:0 dw:0 dr:664 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<br>
> 1002: cs:WFConnection ro:Primary/Unknown ds:UpToDate/DUnknown C r-----<br>
> ns:0 nr:0 dw:0 dr:664 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<br>
> 1003: cs:WFConnection ro:Primary/Unknown ds:UpToDate/DUnknown C r-----<br>
> ns:0 nr:0 dw:0 dr:664 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Courier New";color:black">How can I begin to troubleshoot this error?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Courier New";color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Courier New";color:black">Eric Pretorious<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Courier New";color:black">Truckee, cA<o:p></o:p></span></p>
</div>
</div>
</div>
</body>
</html>