<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Jul 17, 2016 at 3:55 PM, Roland Kammerer <span dir="ltr"><<a href="mailto:roland.kammerer@linbit.com" target="_blank">roland.kammerer@linbit.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex"><div><div>On Sun, Jul 17, 2016 at 07:28:16AM -0500, T.J. Yang wrote:<br>
> Hi<br>
><br>
> I am learning DRBD9 using Centos 7.2(See R1 gdoc).<br>
><br>
> All the latest rpm had been created and deployed on test node A,B,C.<br>
><br>
> Currently I am stuck at not able to add second node with following error<br>
><br>
> Please provide pointer where I might did wrong.<br>
><br>
> [root@centos7A ~]# drbdmanage add-node centos7B 192.168.42.130<br>
><br>
> Operation completed successfully<br>
><br>
> Operation completed successfully<br>
><br>
> Executing join command using ssh.<br>
><br>
> IMPORTANT: The output you see comes from centos7B<br>
><br>
> IMPORTANT: Your input is executed on centos7B<br>
><br>
> You are going to join an existing drbdmanage cluster.<br>
><br>
> CAUTION! Note that:<br>
><br>
> * Any previous drbdmanage cluster information may be removed<br>
><br>
> * Any remaining resources managed by a previous drbdmanage installation<br>
><br>
> that still exist on this system will no longer be managed by drbdmanage<br>
><br>
> Confirm:<br>
><br>
> yes/no: yes<br>
><br>
> ERROR:dbus.proxies:Introspect error on :1.39:/interface:<br>
> dbus.exceptions.DBusException: org.freedesktop.DBus.Error.NoReply: Did not<br>
> receive a reply. Possible causes include: the remote application did not<br>
> send a reply, the message bus security policy blocked the reply, the reply<br>
> timeout expired, or the network connection was broken.<br>
><br>
> Error: Cannot connect to the drbdmanaged process using DBus<br>
><br>
> The DBus subsystem returned the following error description:<br>
><br>
> org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible<br>
> causes include: the remote application did not send a reply, the message<br>
> bus security policy blocked the reply, the reply timeout expired, or the<br>
> network connection was broken.<br>
><br>
> Error: Attempt to execute the join command remotelyfailed<br>
><br>
> Join command for node centos7B:<br>
><br>
> drbdmanage join -p 6999 192.168.42.130 1 centos7A 192.168.42.129 0<br>
> kOSMSN72ywYj+wGBogHG<br>
<br>
</div></div>Just in case: You can get the "join" command for your node centos7B when<br>
you execute "drbdmanage howto-join centos7B".<br>
<br>
I would do the following:<br>
- Check if the control-volume on centos7A is up ("drbdsetup status<br>
.drbdctrl")<br></blockquote><div><br></div><div> I accidentally resolved above issue by rebooting CentoOS7A and B(not sure if I did anything more than reboot).</div><div><br></div><div>Now I have both control-volumes up on both A/B.</div><div><div>[root@centos7A drbd]# drbdsetup status .drbdctrl</div><div>.drbdctrl role:Secondary</div><div> volume:0 disk:UpToDate</div><div> volume:1 disk:UpToDate</div><div> centos7B role:Secondary</div><div> volume:0 peer-disk:UpToDate</div><div> volume:1 peer-disk:UpToDate</div><div><br></div><div>[root@centos7A drbd]# date</div><div>Sun Jul 17 16:19:21 CDT 2016</div><div>[root@centos7A drbd]#</div></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">
- Make sure the drbdmanage process is stopped on centos7B ("drbdmanage<br>
shutdown -q"). Make sure it is stopped (ps aux && kill if necessary).<br>
- Enter the "join" command you got on centos7A for the node centos7B on<br>
centos7B<br></blockquote><div><br></div><div>I went on to redo the whole process on another set of two CeontOS7 VM using example rpms created from git src. And ended up with exact dbus error message again. I did try to stop drbdmanage project on node 2. before I join the 2nd node(va03t)</div><div><br></div><div><br></div><div><div><font face="monospace, monospace">1. make sure control volume is up on drbd03A</font></div><div><font face="monospace, monospace"><br></font></div><div><font face="monospace, monospace">[root@drbd03A ~]# sudo drbdsetup status .drbdctrl</font></div><div><font face="monospace, monospace">.drbdctrl role:Secondary</font></div><div><font face="monospace, monospace"> volume:0 disk:UpToDate</font></div><div><font face="monospace, monospace"> volume:1 disk:UpToDate</font></div><div><font face="monospace, monospace"><br></font></div><div><font face="monospace, monospace">[root@drbd03A ~]# drbdmanage n</font></div><div><font face="monospace, monospace">+-------------------------------------------------------------------------+</font></div><div><font face="monospace, monospace">| Name | Pool Size | Pool Free | | State |</font></div><div><font face="monospace, monospace">|-------------------------------------------------------------------------|</font></div><div><font face="monospace, monospace">| drbd03A | 16380 | 16372 | | ok |</font></div><div><font face="monospace, monospace">+-------------------------------------------------------------------------+</font></div><div><font face="monospace, monospace">[root@drbd03A ~]#</font></div><div><font face="monospace, monospace"><br></font></div><div><font face="monospace, monospace">2. make drbdmanage process is not on drbd03B</font></div><div><font face="monospace, monospace">[root@drbd03B ~]# ps -eaf |egrep 'drbd'|egrep -v egrep</font></div><div><font face="monospace, monospace">root 3539 2 0 17:39 ? 00:00:00 [drbd-reissue]</font></div><div><font face="monospace, monospace">root 3984 2283 0 17:42 pts/2 00:00:00 grep -E --color=auto drbd</font></div><div><font face="monospace, monospace">[root@drbd03B ~]#</font></div><div><font face="monospace, monospace"><br></font></div><div><font face="monospace, monospace">3. adding 2nd node</font></div><div><font face="monospace, monospace">[root@drbd03A ~]# drbdmanage add-node drbd03B 10.65.184.3</font></div><div><font face="monospace, monospace">Operation completed successfully</font></div><div><font face="monospace, monospace">Operation completed successfully</font></div><div><font face="monospace, monospace"><br></font></div><div><font face="monospace, monospace">Executing join command using ssh.</font></div><div><font face="monospace, monospace">IMPORTANT: The output you see comes from drbd03B</font></div><div><font face="monospace, monospace">IMPORTANT: Your input is executed on drbd03B</font></div><div><font face="monospace, monospace">You are going to join an existing drbdmanage cluster.</font></div><div><font face="monospace, monospace">CAUTION! Note that:</font></div><div><font face="monospace, monospace"> * Any previous drbdmanage cluster information may be removed</font></div><div><font face="monospace, monospace"> * Any remaining resources managed by a previous drbdmanage installation</font></div><div><font face="monospace, monospace"> that still exist on this system will no longer be managed by drbdmanage</font></div><div><font face="monospace, monospace"><br></font></div><div><font face="monospace, monospace">Confirm:</font></div><div><font face="monospace, monospace"><br></font></div><div><font face="monospace, monospace"> yes/no: yes</font></div><div><font face="monospace, monospace">ERROR:dbus.proxies:Introspect error on :1.27:/interface: dbus.exceptions.DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken.</font></div><div><font face="monospace, monospace"><br></font></div><div><font face="monospace, monospace">Error: Cannot connect to the drbdmanaged process using DBus</font></div><div><font face="monospace, monospace">The DBus subsystem returned the following error description:</font></div><div><font face="monospace, monospace">org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken.</font></div><div><font face="monospace, monospace">Error: Attempt to execute the join command remotelyfailed</font></div><div><font face="monospace, monospace"><br></font></div><div><font face="monospace, monospace">Join command for node drbd03B:</font></div><div><font face="monospace, monospace">drbdmanage join -p 6999 10.65.184.3 1 drbd03A 192.168.42.129 0 JqgmtgCBj2knivkRIIub</font></div><div><font face="monospace, monospace">[root@drbd03A ~]#</font></div><div><font face="monospace, monospace"><br></font></div><div><font face="monospace, monospace">3.1 on drbd03B, join command were ssh into drbd03B from drbd03A</font></div><div><font face="monospace, monospace">[root@drbd03B ~]# ps -eaf |egrep 'drbd'|egrep -v egrep</font></div><div><font face="monospace, monospace">root 3539 2 0 17:39 ? 00:00:00 [drbd-reissue]</font></div><div><font face="monospace, monospace">root 3984 2283 0 17:42 pts/2 00:00:00 grep -E --color=auto drbd</font></div><div><font face="monospace, monospace">[root@drbd03B ~]# ps -eaf |egrep 'drbd'|egrep -v egrep</font></div><div><font face="monospace, monospace">root 3539 2 0 17:39 ? 00:00:00 [drbd-reissue]</font></div><div><font face="monospace, monospace">root 4148 4144 0 17:44 ? 00:00:00 /usr/bin/python /usr/bin/drbdmanage join -p 6999 10.65.184.3 1 drbd03A 192.168.42.129 0 JqgmtgCBj2knivkRIIub</font></div><div><font face="monospace, monospace">root 4199 2 0 17:44 ? 00:00:00 [drbd_w_.drbdctr]</font></div><div><font face="monospace, monospace">root 4201 2 0 17:44 ? 00:00:00 [drbd0_submit]</font></div><div><font face="monospace, monospace">root 4205 2 0 17:44 ? 00:00:00 [drbd1_submit]</font></div><div><font face="monospace, monospace">root 4221 2 0 17:44 ? 00:00:00 [drbd_s_.drbdctr]</font></div><div><font face="monospace, monospace">root 4224 2 0 17:44 ? 00:00:00 [drbd_r_.drbdctr]</font></div><div><font face="monospace, monospace">root 4226 1 0 17:44 ? 00:00:00 /usr/bin/python /usr/bin/dbus-drbdmanaged-service</font></div><div><font face="monospace, monospace">root 4269 4226 0 17:44 ? 00:00:00 drbdsetup events2 all</font></div><div><font face="monospace, monospace">root 4407 2283 0 17:45 pts/2 00:00:00 grep -E --color=auto drbd</font></div><div><font face="monospace, monospace">[root@drbd03B ~]# </font></div><div><br></div></div><div><br></div><div>so in short reboot both nodes help resolved the issue.</div><div><font color="#ff0000">drbd03A sent the ip address of centos7A(192.168.42.129)<font face="monospace, monospace">. this IP somehow got carry over from my 1st pairs of CentoOS7 VMs.</font></font></div><div><font face="monospace, monospace"><br></font></div><div><font face="monospace, monospace">afer drbd03A got rebooted. I am able to join 2nd node. </font></div><div><font face="monospace, monospace"><br></font></div><div><font face="monospace, monospace"><div>[root@drbd03A ~]# drbdmanage n</div><div>+--------------------------------------------------------------------------------+</div><div>| Name | Pool Size | Pool Free | | State |</div><div>|--------------------------------------------------------------------------------|</div><div>| drbd03A | 16380 | 16372 | | ok |</div><div>| drbd03B | 16380 | 16372 | | ok |</div><div>+--------------------------------------------------------------------------------+</div><div>[root@drbd03A ~]#</div></font></div><div><br></div><div>Thanks Roland for the debug procedure on 2nd node.</div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">
<br>
Regards, rck<br>
<br>
<br>
_______________________________________________<br>
drbd-user mailing list<br>
<a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a><br>
<a href="http://lists.linbit.com/mailman/listinfo/drbd-user" rel="noreferrer" target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div data-smartmail="gmail_signature">T.J. Yang</div>
</div></div>