<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Feb 27, 2016 at 11:18 AM, Eric Robinson <span dir="ltr"><<a href="mailto:eric.robinson@psmnv.com" target="_blank">eric.robinson@psmnv.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Sadly, it still isn’t working.<br>
<br>
Here is my crm config...<br>
<span class=""><br>
node ha13a<br>
node ha13b<br>
primitive p_drbd0 ocf:linbit:drbd \<br>
params drbd_resource=ha01_mysql \<br>
op monitor interval=31s role=Slave \<br>
op monitor interval=30s role=Master<br>
primitive p_drbd1 ocf:linbit:drbd \<br>
params drbd_resource=ha02_mysql \<br>
op monitor interval=29s role=Slave \<br>
op monitor interval=28s role=Master<br>
primitive p_fs_clust17 Filesystem \<br>
params device="/dev/vg_drbd0/lv_drbd0" directory="/ha01_mysql" fstype=ext3 options=noatime<br>
primitive p_fs_clust18 Filesystem \<br>
params device="/dev/vg_drbd1/lv_drbd1" directory="/ha02_mysql" fstype=ext3 options=noatime<br>
</span>primitive p_lvm_drbd0 LVM \<br>
params volgrpname=vg_drbd0<br>
primitive p_lvm_drbd1 LVM \<br>
params volgrpname=vg_drbd1<br>
<span class="">primitive p_vip_clust17 IPaddr2 \<br>
params ip=192.168.9.104 cidr_netmask=32 \<br>
op monitor interval=30s<br>
primitive p_vip_clust18 IPaddr2 \<br>
params ip=192.168.9.105 cidr_netmask=32 \<br>
op monitor interval=30s<br>
ms ms_drbd0 p_drbd0 \<br>
meta master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 notify=true target-role=Master<br>
ms ms_drbd1 p_drbd1 \<br>
meta master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 notify=true target-role=Master<br>
</span>colocation c_clust17 inf: p_vip_clust17 p_lvm_drbd0 ms_drbd0:Master<br>
colocation c_clust18 inf: p_vip_clust18 p_lvm_drbd1 ms_drbd1:Master<br>
order o_clust17 inf: ms_drbd0:promote p_lvm_drbd0:start p_vip_clust17<br>
order o_clust18 inf: ms_drbd1:promote p_lvm_drbd1:start p_vip_clust18<br>
<span class="">property cib-bootstrap-options: \<br>
dc-version=1.1.11-97629de \<br>
cluster-infrastructure="classic openais (with plugin)" \<br>
no-quorum-policy=ignore \<br>
stonith-enabled=false \<br>
maintenance-mode=false \<br>
expected-quorum-votes=2 \<br>
</span> last-lrm-refresh=1456529727<br>
# vim: set filetype=pcmk:<br>
<br>
Here is what my filter looks like...<br>
<span class=""><br>
filter = [ "a|/dev/sda*|", "a|/dev/drbd*|", "r|.*|" ]<br>
write_cache_state = 0<br>
volume_list = [ "vg00", "vg_drbd0", "vg_drbd1" ]<br>
<br>
<br>
</span>Here is what lvdisplay shows on node ha13a...<br>
<br>
[root@ha13a ~]# lvdisplay<br>
--- Logical volume ---<br>
LV Path /dev/vg00/lv00<br>
LV Name lv00<br>
VG Name vg00<br>
LV UUID BfYyBv-VPNI-2f5s-0kVZ-AoSr-dGcY-gojAzs<br>
LV Write Access read/write<br>
LV Creation host, time <a href="http://ha13a.mycharts.md" rel="noreferrer" target="_blank">ha13a.mycharts.md</a>, 2014-01-23 03:38:38 -0800<br>
LV Status available<br>
# open 1<br>
LV Size 78.12 GiB<br>
Current LE 20000<br>
Segments 1<br>
Allocation inherit<br>
Read ahead sectors auto<br>
- currently set to 256<br>
Block device 253:0<br>
<br>
--- Logical volume ---<br>
LV Path /dev/vg_drbd1/lv_drbd1<br>
LV Name lv_drbd1<br>
VG Name vg_drbd1<br>
LV UUID HLVYSz-mZbQ-rCUm-OMBg-a1G9-vqdg-FwRp5S<br>
LV Write Access read/write<br>
LV Creation host, time ha13b, 2016-02-26 13:48:51 -0800<br>
LV Status NOT available<br>
LV Size 1.00 TiB<br>
Current LE 262144<br>
Segments 1<br>
Allocation inherit<br>
Read ahead sectors auto<br>
<br>
--- Logical volume ---<br>
LV Path /dev/vg_drbd0/lv_drbd0<br>
LV Name lv_drbd0<br>
VG Name vg_drbd0<br>
LV UUID 2q0e0v-P2g1-inu4-GKDN-cTyn-e2L7-jCJ1BY<br>
LV Write Access read/write<br>
LV Creation host, time ha13a, 2016-02-26 13:48:06 -0800<br>
LV Status available<br>
# open 1<br>
LV Size 1.00 TiB<br>
Current LE 262144<br>
Segments 1<br>
Allocation inherit<br>
Read ahead sectors auto<br>
- currently set to 256<br>
Block device 253:1<br>
<br>
And here is what it shows on ha13b...<br>
<br>
[root@ha13b ~]# lvdisplay<br>
--- Logical volume ---<br>
LV Path /dev/vg_drbd1/lv_drbd1<br>
LV Name lv_drbd1<br>
VG Name vg_drbd1<br>
LV UUID HLVYSz-mZbQ-rCUm-OMBg-a1G9-vqdg-FwRp5S<br>
LV Write Access read/write<br>
LV Creation host, time ha13b, 2016-02-26 13:48:51 -0800<br>
LV Status available<br>
# open 1<br>
LV Size 1.00 TiB<br>
Current LE 262144<br>
Segments 1<br>
Allocation inherit<br>
Read ahead sectors auto<br>
- currently set to 256<br>
Block device 253:1<br>
<br>
--- Logical volume ---<br>
LV Path /dev/vg_drbd0/lv_drbd0<br>
LV Name lv_drbd0<br>
VG Name vg_drbd0<br>
LV UUID 2q0e0v-P2g1-inu4-GKDN-cTyn-e2L7-jCJ1BY<br>
LV Write Access read/write<br>
LV Creation host, time ha13a, 2016-02-26 13:48:06 -0800<br>
LV Status NOT available<br>
LV Size 1.00 TiB<br>
Current LE 262144<br>
Segments 1<br>
Allocation inherit<br>
Read ahead sectors auto<br>
<br>
--- Logical volume ---<br>
LV Path /dev/vg00/lv00<br>
LV Name lv00<br>
VG Name vg00<br>
LV UUID lIJWiz-2Y9j-cq2G-Ie4f-9wVK-xJbu-2s1f23<br>
LV Write Access read/write<br>
LV Creation host, time <a href="http://ha13b.mycharts.md" rel="noreferrer" target="_blank">ha13b.mycharts.md</a>, 2014-01-23 10:01:36 -0800<br>
LV Status available<br>
# open 1<br>
LV Size 78.12 GiB<br>
Current LE 20000<br>
Segments 1<br>
Allocation inherit<br>
Read ahead sectors auto<br>
- currently set to 256<br>
Block device 253:0<br>
<br>
And here is crm_mon...<br>
<br>
Last updated: Fri Feb 26 16:16:30 2016<br>
Last change: Fri Feb 26 16:12:39 2016<br>
<span class="">Stack: classic openais (with plugin)<br>
</span>Current DC: ha13a - partition with quorum<br>
<span class="">Version: 1.1.11-97629de<br>
2 Nodes configured, 2 expected votes<br>
</span>10 Resources configured<br>
<span class=""><br>
<br>
Online: [ ha13a ha13b ]<br>
<br>
Master/Slave Set: ms_drbd0 [p_drbd0]<br>
Masters: [ ha13a ]<br>
Slaves: [ ha13b ]<br>
Master/Slave Set: ms_drbd1 [p_drbd1]<br>
</span> Masters: [ ha13a ]<br>
Slaves: [ ha13b ]<br>
<span class="">p_vip_clust17 (ocf::heartbeat:IPaddr2): Started ha13a<br>
</span><span class="">p_fs_clust17 (ocf::heartbeat:Filesystem): Started ha13a<br>
<b>p_fs_clust18 (ocf::heartbeat:Filesystem): Started ha13b</b><br></span></blockquote><div> ^^^^^^^<br></div><div> how could this happen<br></div><div> without starting the LV first???<br></div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><span class="">
</span>p_lvm_drbd0 (ocf::heartbeat:LVM): Started ha13a<br>
<b>p_lvm_drbd1 (ocf::heartbeat:LVM): FAILED ha13b (unmanaged)</b><br></blockquote><div> ^^^^^^^^<br></div><div> failed, so no way p_fs_clust18<br></div><div> should be allowed to start <br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<br>
Failed actions:<br>
p_lvm_drbd1_stop_0 on ha13b 'unknown error' (1): call=104, status=complete, last-rc-change='Fri Feb 26 16:12:29 2016', queued=0ms, exec=10447ms<br>
p_lvm_drbd1_stop_0 on ha13b 'unknown error' (1): call=104, status=complete, last-rc-change='Fri Feb 26 16:12:29 2016', queued=0ms, exec=10447ms<br>
p_fs_clust17_start_0 on ha13b 'not installed' (5): call=110, status=complete, last-rc-change='Fri Feb 26 16:12:40 2016', queued=0ms, exec=46ms<br>
<br></blockquote><div><br></div><div>Can you please try following constraints instead the ones you have:<br><br>group g_drbd0 p_lvm_drbd0 p_fs_clust17 p_vip_clust17<br>group g_drbd1 p_lvm_drbd1 p_fs_clust18 p_vip_clust18<br>colocation c_clust17 inf: g_drbd0 ms_drbd0:Master<br>colocation c_clust18 inf: g_drbd1 ms_drbd1:Master<br>order o_clust17 inf: ms_drbd0:promote g_drbd0:start<br>order o_clust18 inf: ms_drbd1:promote g_drbd1:start<br><br> <br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
I've tried cleaning up all the resources, but this is what I get. Sometimes if I mess around enough, I can get everything up, but as soon as I tried to fail over one of the cluster IPs or filesystems, the whole thing goes to crap.<br>
<br>
Do you see any potential causes?<br>
<span class=""><font color="#888888"><br>
--Eric<br>
<br>
<br>
</font></span></blockquote></div><br></div></div>