<div dir="ltr"><div>Hi </div><div><br></div><div>I am testing out latest DRBD9 rpms, hoping to create bravo,alpha and charlie 3 nodes cluster. Need pointer on where I did wrong.</div><div><br></div><div>1. rpms created and installed on centos 7.3</div><div><br></div><div><div>[root@bravo log]# ls /root/drbd9-rpms/</div><div>drbd-bash-completion-8.9.10-1.el7.centos.x86_64.rpm</div><div>drbd-debuginfo-8.9.10-1.el7.centos.x86_64.rpm</div><div>drbd-heartbeat-8.9.10-1.el7.centos.x86_64.rpm</div><div>drbd-kernel-debuginfo-9.0.6-1.el7.centos.x86_64.rpm</div><div>drbdmanage-0.98.2-1.noarch.rpm</div><div>drbdmanage-0.98.2-1.src.rpm</div><div>drbd-pacemaker-8.9.10-1.el7.centos.x86_64.rpm</div><div>drbd-udev-8.9.10-1.el7.centos.x86_64.rpm</div><div>drbd-utils-8.9.10-1.el7.centos.x86_64.rpm</div><div>drbd-xen-8.9.10-1.el7.centos.x86_64.rpm</div><div>kmod-drbd-9.0.6_3.10.0_514.2.2-1.el7.centos.x86_64.rpm</div><div>[root@bravo log]#</div></div><div><br></div><div><div>2.  Trying add 2nd node alpha from bravo node.</div><div><br></div><div>drbdmanage add-node alpha  192.168.174.136<br></div><div><br></div><div>The command failed after waiting on server (which server ?)</div><div><br></div><div>I login into alpha to run the command manually.</div><div><br></div><div>[root@alpha drbd9-rpms]# /bin/python /usr/bin/drbdmanage join -p 6999 192.168.174.136 1 bravo 192.168.174.141 0 AMcP2OIcqCwO+iTer5Bx</div><div>You are going to join an existing drbdmanage cluster.</div><div>CAUTION! Note that:</div><div>  * Any previous drbdmanage cluster information may be removed</div><div>  * Any remaining resources managed by a previous drbdmanage installation</div><div>    that still exist on this system will no longer be managed by drbdmanage</div><div><br></div><div>Confirm:</div><div><br></div><div>  yes/no: yes</div><div>Waiting for server: ...............</div><div>Error: Server currently not ready, please retry later</div><div>[root@alpha drbd9-rpms]#</div></div><div><br></div><div>3. messages from bravo:dmesg</div><div><br></div><div><div>[ 8924.782800] drbd .drbdctrl/0 drbd0: my node_id: 0</div><div>[ 8924.783326] drbd .drbdctrl/0 drbd0: drbd_bm_resize called with capacity == 8112</div><div>[ 8924.783893] drbd .drbdctrl/0 drbd0: resync bitmap: bits=1014 words=496 pages=1</div><div>[ 8924.784785] drbd .drbdctrl/0 drbd0: recounting of set bits took additional 0ms</div><div>[ 8924.785320] drbd .drbdctrl/0 drbd0: Suspended AL updates</div><div>[ 8924.785909] drbd .drbdctrl/0 drbd0: disk( Attaching -&gt; Inconsistent )</div><div>[ 8924.786426] drbd .drbdctrl/0 drbd0: attached to current UUID: 0000000000000004</div><div>[ 8924.793622] drbd .drbdctrl/1 drbd1: disk( Diskless -&gt; Attaching )</div><div>[ 8924.794266] drbd .drbdctrl/1 drbd1: Maximum number of peer devices = 31</div><div>[ 8924.794863] drbd .drbdctrl/1 drbd1: my node_id: 0</div><div>[ 8924.795341] drbd .drbdctrl/1 drbd1: Adjusting my ra_pages to backing device&#39;s (32 -&gt; 1024)</div><div>[ 8924.795869] drbd .drbdctrl/1 drbd1: my node_id: 0</div><div>[ 8924.796384] drbd .drbdctrl/1 drbd1: drbd_bm_resize called with capacity == 8112</div><div>[ 8924.796943] drbd .drbdctrl/1 drbd1: resync bitmap: bits=1014 words=496 pages=1</div><div>[ 8924.800141] drbd .drbdctrl/1 drbd1: recounting of set bits took additional 0ms</div><div>[ 8924.800703] drbd .drbdctrl/1 drbd1: Suspended AL updates</div><div>[ 8924.801227] drbd .drbdctrl/1 drbd1: disk( Attaching -&gt; Inconsistent )</div><div>[ 8924.801735] drbd .drbdctrl/1 drbd1: attached to current UUID: 0000000000000004</div><div>[ 8924.805723] drbd .drbdctrl: Preparing cluster-wide state change 2748733687 (0-&gt;-1 7683/4609)</div><div>[ 8924.805754] drbd .drbdctrl: Committing cluster-wide state change 2748733687 (0ms)</div><div>[ 8924.806785] drbd .drbdctrl: role( Secondary -&gt; Primary )</div><div>[ 8924.807294] drbd .drbdctrl/0 drbd0: disk( Inconsistent -&gt; UpToDate )</div><div>[ 8924.807834] drbd .drbdctrl/1 drbd1: disk( Inconsistent -&gt; UpToDate )</div><div>[ 8924.808402] drbd .drbdctrl/0 drbd0: size = 4056 KB (4056 KB)</div><div>[ 8924.809295] drbd .drbdctrl/1 drbd1: size = 4056 KB (4056 KB)</div><div>[ 8924.810123] drbd .drbdctrl: Forced to consider local data as UpToDate!</div><div>[ 8924.810637] drbd .drbdctrl/0 drbd0: new current UUID: 2691EE64A4980DDF weak: FFFFFFFFFFFFFFFE</div><div>[ 8924.811408] drbd .drbdctrl/1 drbd1: new current UUID: CFE588BC8E2BF993 weak: FFFFFFFFFFFFFFFE</div><div>[ 8924.817828] drbd .drbdctrl: role( Primary -&gt; Secondary )</div><div>[ 8925.540669] drbd .drbdctrl: Preparing cluster-wide state change 4197545272 (0-&gt;-1 3/1)</div><div>[ 8925.540788] drbd .drbdctrl: Committing cluster-wide state change 4197545272 (1ms)</div><div>[ 8925.541798] drbd .drbdctrl: role( Secondary -&gt; Primary )</div><div>[ 8925.970160] drbd .drbdctrl/1 drbd1: new current UUID: 8A126F160C84B47D weak: FFFFFFFFFFFFFFFE</div><div>[ 9031.800065] drbd .drbdctrl alpha: Starting sender thread (from drbdsetup [42363])</div><div>[ 9031.802265] drbd .drbdctrl alpha: conn( StandAlone -&gt; Unconnected )</div><div>[ 9031.804923] drbd .drbdctrl/0 drbd0: new current UUID: E095B253DA29FF13 weak: FFFFFFFFFFFFFFFE</div><div>[ 9031.805838] drbd .drbdctrl alpha: Starting receiver thread (from drbd_w_.drbdctr [42225])</div><div>[ 9031.806840] drbd .drbdctrl alpha: conn( Unconnected -&gt; Connecting )</div><div>[ 9031.807425] drbd .drbdctrl tcp:alpha: bind before listen failed, err = -99</div><div>[ 9031.808002] drbd .drbdctrl alpha: Failed to initiate connection, err=-99</div><div>[ 9031.808551] drbd .drbdctrl alpha: conn( Connecting -&gt; Disconnecting )</div><div>[ 9031.811144] drbd .drbdctrl alpha: Connection closed</div><div>[ 9031.813713] drbd .drbdctrl alpha: conn( Disconnecting -&gt; StandAlone )</div><div>[ 9031.814300] drbd .drbdctrl alpha: Terminating receiver thread</div><div>[ 9166.872047] drbd .drbdctrl alpha: Terminating sender thread</div><div>[ 9173.689001] drbd .drbdctrl alpha: Starting sender thread (from drbdsetup [42510])</div><div>[ 9173.690998] drbd .drbdctrl alpha: conn( StandAlone -&gt; Unconnected )</div><div>[ 9173.691672] drbd .drbdctrl alpha: Starting receiver thread (from drbd_w_.drbdctr [42225])</div><div>[ 9173.695329] drbd .drbdctrl alpha: conn( Unconnected -&gt; Connecting )</div><div>[ 9173.695979] drbd .drbdctrl tcp:alpha: bind before listen failed, err = -99</div><div>[ 9173.696512] drbd .drbdctrl alpha: Failed to initiate connection, err=-99</div><div>[ 9173.697128] drbd .drbdctrl alpha: conn( Connecting -&gt; Disconnecting )</div><div>[ 9173.700659] drbd .drbdctrl alpha: Connection closed</div><div>[ 9173.708018] drbd .drbdctrl alpha: conn( Disconnecting -&gt; StandAlone )</div><div>[ 9173.708724] drbd .drbdctrl alpha: Terminating receiver thread</div><div>[ 9208.874316] drbd .drbdctrl alpha: Terminating sender thread</div><div>[ 9211.583005] drbd .drbdctrl alpha: Starting sender thread (from drbdsetup [42622])</div><div>[ 9211.585018] drbd .drbdctrl alpha: conn( StandAlone -&gt; Unconnected )</div><div>[ 9211.585660] drbd .drbdctrl alpha: Starting receiver thread (from drbd_w_.drbdctr [42225])</div><div>[ 9211.586687] drbd .drbdctrl alpha: conn( Unconnected -&gt; Connecting )</div><div>[ 9211.587275] drbd .drbdctrl tcp:alpha: bind before listen failed, err = -99</div><div>[ 9211.587809] drbd .drbdctrl alpha: Failed to initiate connection, err=-99</div><div>[ 9211.588439] drbd .drbdctrl alpha: conn( Connecting -&gt; Disconnecting )</div><div>[ 9211.592332] drbd .drbdctrl alpha: Connection closed</div><div>[ 9211.593019] drbd .drbdctrl alpha: conn( Disconnecting -&gt; StandAlone )</div><div>[ 9211.593684] drbd .drbdctrl alpha: Terminating receiver thread</div><div>[ 9286.627280] drbd .drbdctrl alpha: Terminating sender thread</div><div>[ 9302.338123] drbd .drbdctrl alpha: Starting sender thread (from drbdsetup [42713])</div><div>[ 9302.340168] drbd .drbdctrl alpha: conn( StandAlone -&gt; Unconnected )</div><div>[ 9302.340743] drbd .drbdctrl alpha: Starting receiver thread (from drbd_w_.drbdctr [42225])</div><div>[ 9302.344261] drbd .drbdctrl alpha: conn( Unconnected -&gt; Connecting )</div><div>[ 9302.344825] drbd .drbdctrl tcp:alpha: bind before listen failed, err = -99</div><div>[ 9302.345511] drbd .drbdctrl alpha: Failed to initiate connection, err=-99</div><div>[ 9302.346043] drbd .drbdctrl alpha: conn( Connecting -&gt; Disconnecting )</div><div>[ 9302.347804] drbd .drbdctrl alpha: Connection closed</div><div>[ 9302.350944] drbd .drbdctrl alpha: conn( Disconnecting -&gt; StandAlone )</div><div>[ 9302.351550] drbd .drbdctrl alpha: Terminating receiver thread</div><div>[root@bravo log]#</div></div><div><br></div><div>4.  list node</div><div><br></div><div><div>[root@bravo log]# drbdmanage n</div><div>+---------------------------------------------------------------------------------------------------------+</div><div>| Name  | Pool Size | Pool Free |      |                                                            State |</div><div>|---------------------------------------------------------------------------------------------------------|</div><div>| alpha |   unknown |   unknown |      | offline/quorum vote ignored, pending actions: adjust connections |</div><div>| bravo |      4088 |      4080 |      |                                                               ok |</div><div>+---------------------------------------------------------------------------------------------------------+</div><div>[root@bravo log]#</div></div><div><br></div><br clear="all"><div><br></div>-- <br><div class="gmail_signature">T.J. Yang</div>
</div>