[DRBD-user] drbdmanage restart failed

杨成伟 yangchengwei at qiyi.com
Wed Aug 30 10:54:19 CEST 2017

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


Hi Yannis,

I'm using drbdmanage-0.99.9 downloaded from linbit official site.

drbd90-utils-9.0.0-1.el7.elrepo.x86_64 and
kmod-drbd90-9.0.8-1.el7.elrepo.x86_64 from ELREPO

On Wed, Aug 30, 2017 at 08:20:24AM +0000, Yannis Milios wrote:
> Which version of drbdmanage/utils/kmod are you using?
> 
> Many issues have been sorted out in latest versions.
> 
> Yannis
> 
> 
> On Wed, 30 Aug 2017 at 07:58, 杨成伟 <yangchengwei at qiyi.com> wrote:
> 
>     Hi All,
> 
>     I'm following drbd 9.x user guide and has a 3 node(2 control, 1
>     satellite) setup.
> 
>     However, I'm not sure what I've did on one node and that node can not
>     restart by `drbdmanage restart`.
> 
>     It errors like below
> 
> 
>     ```
>     Attempting to startup the server through D-Bus activation...
>     ERROR:dbus.proxies:Introspect error on :1.96:/interface:
>     dbus.exceptions.DBusException: org.freedesktop.DBus.Error.NoReply: Did not
>     receive a reply. Possible causes include: the remote application did not
>     send a reply, the message bus security policy blocked the reply, the reply
>     timeout expired, or the network connection was broken.
>     D-Bus connection successful, server is running and reachable
>     ```
> 
> 
>     and from the dbus log(journalctl -u dbus -f), I found that drbdmanage
>     failed like below.
> 
> 
>     ```
>     Aug 30 13:10:42 mesos-test-dev002-whdx.qiyi.virtual dbus[815]: [system]
>     Activating service name='org.drbd.drbdmanaged' (using servicehelper)
>     Aug 30 13:10:42 mesos-test-dev002-whdx.qiyi.virtual dbus-daemon[815]: dbus
>     [815]: [system] Activating service name='org.drbd.drbdmanaged' (using
>     servicehelper)
>     Aug 30 13:10:42 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       DRBDmanage server, version 0.99.9 -- initializing on node
>     'mesos-test-dev002-whdx.qiyi.virtual'
>     Aug 30 13:10:42 mesos-test-dev002-whdx.qiyi.virtual dbus[815]: [system]
>     Successfully activated service 'org.drbd.drbdmanaged'
>     Aug 30 13:10:42 mesos-test-dev002-whdx.qiyi.virtual dbus-daemon[815]: dbus
>     [815]: [system] Successfully activated service 'org.drbd.drbdmanaged'
>     Aug 30 13:10:42 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       DrbdAdm: Running external command: drbdadm -vvv adjust .drbdctrl
>     Aug 30 13:10:42 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       DrbdAdm: External command 'drbdadm': Exit code 0
>     Aug 30 13:10:42 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       DRBDManage starting as potential leader node
>     Aug 30 13:10:59 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     ERROR      drbdsetup events tracing has failed, restarting
>     Aug 30 13:10:59 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       drbdsetup events tracing reestablished
>     Aug 30 13:11:17 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       Reading initial DRBD control volume status
>     Aug 30 13:11:17 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       Finished reading initial DRBD control volume status
>     Aug 30 13:11:17 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       Leader election by wait for connections
>     Aug 30 13:11:17 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       DrbdAdm: Running external command: drbdsetup
>     wait-connect-resource --wait-after-sb=yes --wfc-timeout=2 .drbd
>     ctrl
>     Aug 30 13:11:17 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       DrbdAdm: External command 'drbdsetup': Exit code 0
>     Aug 30 13:11:17 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       DrbdAdm: Running external command: drbdsetup primary .drbdctrl
>     Aug 30 13:11:18 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     ERROR      DrbdAdm: External command 'drbdsetup': Exit code 11
>     Aug 30 13:11:18 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       Leader election: lost election
>     Aug 30 13:11:24 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     ERROR      Signal creation failed, unhandled exception encountered
>     Aug 30 13:11:24 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     ERROR      Signal creation failed, unhandled exception encountered
>     Aug 30 13:11:24 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     ERROR      Signal creation failed, unhandled exception encountered
>     Aug 30 13:11:24 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       starting resource 'r0'
>     Aug 30 13:11:24 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       DrbdAdm: Running external command: drbdadm --config-to-test /var
>     /lib/drbd.d/drbdmanage_r0.res.tmp --config-t
>     o-exclude /var/lib/drbd.d/drbdmanage_r0.res sh-nop
>     Aug 30 13:11:24 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       DrbdAdm: External command 'drbdadm': Exit code 0
>     Aug 30 13:11:24 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       DrbdAdm: Running external command: drbdadm -c /var/lib/drbd.d/
>     drbdmanage_r0.res.tmp -d up r0
>     Aug 30 13:11:24 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       DrbdAdm: External command 'drbdadm': Exit code 0
>     Aug 30 13:11:24 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       DrbdAdm: Running external command: drbdadm -vvv adjust -c /var/
>     lib/drbd.d/drbdmanage_r0.res r0
>     Aug 30 13:11:24 mesos-test-dev002-whdx.qiyi.virtual drbdmanaged[28329]:
>     INFO       DrbdAdm: External command 'drbdadm': Exit code 0
>     ```
> 
> 
>     It seems `drbdmanage restart` fails because `drbdsetup primary .drbdctl`
>     fails,
>     so I just run this command on the node.
> 
> 
>     ```
>     [root at mesos-test-dev002-whdx ~]# drbdsetup primary .drbdctrl
>     .drbdctrl: State change failed: (-1) Multiple primaries not allowed by
>     config
>     ```
> 
> 
>     Apparently, it fails and said *Multiple primaries not allowed by config*,
>     I am not sure why it will run this command because drbdmanage role says
>     this node is not the leader
> 
> 
>     ```
>     [root at mesos-test-dev002-whdx ~]# drbdmanage role
>     Operation completed successfully
>     potential leader (CL: mesos-test-dev001-whdx.qiyi.virtual)
>     ```
> 
> 
>     Any help? Thanks in advance!
> 
>     --
>     Thanks,
>     Chengwei
>     _______________________________________________
>     drbd-user mailing list
>     drbd-user at lists.linbit.com
>     http://lists.linbit.com/mailman/listinfo/drbd-user
> 
> --
> Sent from Gmail Mobile
> SECURITY NOTE: file ~/.netrc must not be accessible by others

-- 
杨成伟 技术产品中心 - 计算云
手机 & 微信:18519140512
分机:010-6267-7069
----------------------------
QAE: 快速部署上线你的服务
        -- http://gitlab.qiyi.domain/mesos/qae
Docker: 不解释
        -- http://gitlab.qiyi.domain/docker/docker
GitLab: 你值得拥有的 Git 代码托管,Code Review, CI 一站式服务
        -- http://gitlab.qiyi.domain/gitlab/gitlab
Redmine: 好用的项目管理工具
        -- http://redmine.qiyi.virtual
Mutt: "All mail clients suck. This one just sucks less." -me, circa 1995
        -- http://www.mutt.org/



More information about the drbd-user mailing list