<html><body><div style="color:#000; background-color:#fff; font-family:times new roman, new york, times, serif;font-size:12pt"><div style="font-family: 'times new roman', 'new york', times, serif; font-size: 12pt; ">Hi,</div><div style="font-family: 'times new roman', 'new york', times, serif; font-size: 12pt; "><br></div><div style="font-family: 'times new roman', 'new york', times, serif; font-size: 12pt; ">I setup DRBD and Pacemaker using STONITH for DRBD and for Pacemaker. (Configs at bottom of email)</div><div style="font-family: 'times new roman', 'new york', times, serif; font-size: 12pt; "><br></div><div style="font-family: 'times new roman', 'new york', times, serif; font-size: 12pt; ">When I reboot the PRIMARY DRBD node (cnode-1-3-6), Pacemaker shows this location constraint:</div><div style="font-family: 'times new roman', 'new york', times, serif; font-size: 12pt; "><br></div><div><span class="Apple-tab-span" style="font-family: 'times
new roman', 'new york', times, serif; font-size: 12pt; white-space: pre; "> </span><font class="Apple-style-span" face="'times new roman', 'new york', times, serif">location drbd-fence-by-handler-ms-glance-drbd ms-glance-drbd \</font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><span class="Apple-tab-span" style="white-space:pre"> </span>rule $id="drbd-fence-by-handler-rule-ms-glance-drbd" $role="Master" -inf: #uname ne cnode-1-3-5</font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><br></font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif">and transitions the SECONDARY to PRIMARY. This makes sense to me.</font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><br></font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times,
serif">However, when I restart cnode-1-3-6 (cnode-1-3-5 still up as PRIMARY) the location constraint is not cleared as I would have expected. Also, DRBD is not started (I assume because of the location constraint). I would expect that since cnode-1-3-5 is still up the constraint would be moved and DRBD would change to SECONDARY.</font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><br></font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif">Am I correct that this location constraint should be cleared?</font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><br></font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif">I assumed this would be cleared by the DRBD handler after-resync-target "/usr/lib/drbd/crm-unfence-peer.sh" script but I do not believe it is
called.</font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><br></font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif">BTW, I am pretty sure I have ordering duplications in my Pacemaker configuration (pointed out by Andrew on the Pacemaker mailing list) but I am not sure if that is the problem.</font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><br></font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><br></font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif">Thanks,</font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><br></font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif">Bob</font></div><div><font class="Apple-style-span"
face="'times new roman', 'new york', times, serif"><br></font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif">drbd.conf file:</font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><br></font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><br></font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><div><span class="Apple-tab-span" style="white-space:pre"> </span>global {</div><div><span class="Apple-tab-span" style="white-space:pre"> </span> usage-count yes;</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>}</div><div><br></div><div><span class="Apple-tab-span" style="white-space:pre"> </span>common {</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>protocol C;</div><div><span class="Apple-tab-span"
style="white-space:pre"> </span>}</div><div><br></div><div><span class="Apple-tab-span" style="white-space:pre"> </span>resource glance-repos-drbd {</div><div><span class="Apple-tab-span" style="white-space:pre"> </span> disk {</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>fencing resource-and-stonith;</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>}</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>handlers {</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>fence-peer "/usr/lib/drbd/crm-fence-peer.sh";</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>after-resync-target "/usr/lib/drbd/crm-unfence-peer.sh";</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>}</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>on
cnode-1-3-5 {</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>device /dev/drbd1;</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>disk /dev/glance-repos/glance-repos-vol;</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>address 10.4.1.29:7789;</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>flexible-meta-disk /dev/glance-repos/glance-repos-drbd-meta-vol;</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>}</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>on cnode-1-3-6 {</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>device /dev/drbd1;</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>disk
/dev/glance-repos/glance-repos-vol;</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>address 10.4.1.30:7789;</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>flexible-meta-disk /dev/glance-repos/glance-repos-drbd-meta-vol;</div><div><span class="Apple-tab-span" style="white-space:pre"> </span> }</div><div><span class="Apple-tab-span" style="white-space:pre"> </span> syncer {</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>rate 40M;</div><div> <span class="Apple-tab-span" style="white-space:pre"> </span>}</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>}</div><div><br></div></font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif">Pacemaker configuration:</font></div><div><font class="Apple-style-span" face="'times new roman', 'new york',
times, serif"><br></font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><span class="Apple-tab-span" style="white-space:pre"> </span></font><font class="Apple-style-span" face="'times new roman', 'new york', times, serif">node cnode-1-3-5</font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><span class="Apple-tab-span" style="white-space:pre"> </span>node cnode-1-3-6</font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><br></font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><span class="Apple-tab-span" style="white-space:pre"> </span>primitive glance-drbd-p ocf:linbit:drbd \
params drbd_resource="glance-repos-drbd" \
op start interval="0" timeout="240" \
op stop interval="0" timeout="100" \
op monitor interval="59s" role="Master" timeout="30s" \
op monitor interval="61s" role="Slave" timeout="30s"</font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><br></font></div><div><font class="Apple-style-span" face="'times new roman', 'new york', times, serif"><span class="Apple-tab-span" style="white-space:pre"> </span></font><font class="Apple-style-span" face="'times new roman', 'new york', times, serif">primitive glance-fs-p ocf:heartbeat:Filesystem \
params device="/dev/drbd1" directory="/glance-mount" fstype="ext4" \
op start interval="0" timeout="60" \
op monitor interval="60" timeout="60" OCF_CHECK_LEVEL="20" \
op stop interval="0" timeout="120"</font></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>primitive glance-ip-p ocf:heartbeat:IPaddr2 \
params ip="10.4.0.25" nic="br100" \
op monitor interval="5s" </span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>primitive glance-lvm-p ocf:heartbeat:LVM \
params volgrpname="glance-repos" exclusive="true" \
op start interval="0" timeout="30" \
op stop interval="0" timeout="30" \
meta target-role="Started" </span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>primitive node-stonith-5-p stonith:external/ipmi \
op monitor interval="10m" timeout="1m" target_role="Started" \
params hostname="cnode-1-3-5 cnode-1-3-6" ipaddr="172.23.8.99" userid="ADMIN" passwd="foo" interface="lan" </span></div><div><br></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>primitive node-stonith-6-p stonith:external/ipmi \
op monitor interval="10m" timeout="1m" target_role="Started" \
params hostname="cnode-1-3-5 cnode-1-3-6" ipaddr="172.23.8.100" userid="ADMIN" passwd="foo" interface="lan" </span></div><div></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>group group-glance-fs glance-fs-p glance-ip-p \
meta target-role="Started" </span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>ms ms-glance-drbd glance-drbd-p \
meta master-node-max="1" clone-max="2" clone-node-max="1" globally-unique="false" notify="true" target-role="Master"</span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>clone cloneLvm glance-lvm-p</span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>location drbd-fence-by-handler-ms-glance-drbd ms-glance-drbd \
rule $id="drbd-fence-by-handler-rule-ms-glance-drbd" $role="Master" -inf: #uname ne cnode-1-3-5</span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>location loc-node-stonith-5 node-stonith-5-p \
rule $id="loc-node-stonith-5-rule" -inf: #uname eq cnode-1-3-5</span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>location loc-node-stonith-6 node-stonith-6-p \
rule $id="loc-node-stonith-6-rule" -inf: #uname eq cnode-1-3-6</span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>colocation coloc-drbd-and-fs-group inf: ms-glance-drbd:Master group-glance-fs </span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>order order-glance-drbd-demote-before-stop-drbd inf: ms-glance-drbd:demote ms-glance-drbd:stop </span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif;
"><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>order order-glance-drbd-promote-before-fs-group inf: ms-glance-drbd:promote group-glance-fs:start </span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>order order-glance-drbd-start-before-drbd-promote inf: ms-glance-drbd:start ms-glance-drbd:promote </span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span"
style="white-space:pre"> </span>order order-glance-fs-stop-before-demote-drbd inf: group-glance-fs:stop ms-glance-drbd:demote</span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>order order-glance-lvm-before-drbd 0: cloneLvm ms-glance-drbd:start </span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>property $id="cib-bootstrap-options" \
dc-version="1.0.8-042548a451fce8400660f6031f4da6f0223dd5dd" \
cluster-infrastructure="openais" \
expected-quorum-votes="2" \
stonith-enabled="true" \
no-quorum-policy="ignore" \
last-lrm-refresh="1311899021" </span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><br></span></div><div><span class="Apple-style-span" style="font-family: 'times new roman', 'new york', times, serif; "><span class="Apple-tab-span" style="white-space:pre"> </span>rsc_defaults $id="rsc-options" \
resource-stickiness="100"</span></div><div><br></div><div style="font-family: 'times new roman', 'new york', times, serif; font-size: 12pt; "><br></div></div></body></html>