[DRBD-user] "vanilia" drbd+pacemaker(corosync) setup on debian lenny problem

Lukasz fenomenalnydyzio at interia.pl
Mon Apr 12 15:31:34 CEST 2010

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


i'm just starting with drbd :) 
My firs setup is very simply - below i paste my drbd and pacemaker configuration - 
and in general it works, but it has one BAD thing that make me come to a standstill :(
(i hope you know what i mean - i'm still learning english).

So everything is ok (drbd works - i can mount it, host oberon is a Master) 
and now, in crm, i type a command:

#> node standby oberon

nothing special - now daphnis is a Master, i can mount /dev/drbd on it, etc...
but when we come with:

#> node online oberon 

something strange happens...  

logs shows:

drbd0: peer( Secondary -> Unknown ) conn( Connected -> TearDown ) pdsk( UpToDate -> Outdated ) 
drbd0: Creating new current UUID
drbd0: asender terminated
drbd0: Terminating asender thread
drbd0: Connection closed
drbd0: conn( TearDown -> Unconnected ) 
drbd0: receiver terminated
drbd0: Restarting receiver thread
drbd0: receiver (re)started
drbd0: conn( Unconnected -> WFConnection ) 
drbd0: Handshake successful: DRBD Network Protocol version 86
drbd0: conn( WFConnection -> WFReportParams ) 
drbd0: Starting asender thread (from drbd0_receiver [20985])
drbd0: drbd_sync_handshake:
drbd0: self 5BDA41FD95504311:C755DDAA0637ADF7:4A02628C8CFDA19B:E46E3D123558741E
drbd0: peer C755DDAA0637ADF6:0000000000000000:4A02628C8CFDA19A:E46E3D123558741E
drbd0: uuid_compare()=1 by rule 7
drbd0: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) 
drbd0: conn( WFBitMapS -> SyncSource ) pdsk( Outdated -> Inconsistent ) 
drbd0: Began resync as SyncSource (will sync 0 KB [0 bits set]).
drbd0: Resync done (total 1 sec; paused 0 sec; 0 K/sec)
drbd0: conn( SyncSource -> Connected ) pdsk( Inconsistent -> UpToDate ) 
drbd0: role( Primary -> Secondary ) 
... and GOTO START

Logs are repeating on and on with one cycle (as showed above) to last for one minute
- pacemaker is switching drbd from oberon to daphnis and back and cant stop!
To stop this i have to type in crm:

#> node standby daphnis 
#> node online daphnis

... and everything is ok again.

Is it normal? Something wrong with my config or i've forgot about something? 

As i write at the beginning i just start with drbd and i'm sure that this 'strange 
behaviour' is a result of my lack of understanding (but pacemaker or drbd???) 
but can anyone show me any hint how to make this works better (now after restoring
oberon online the drbd device is unusable :((( )  

best regards


debian lenny, XEN, paravirtualization
 pacemaker     1.0.8-3~bpo50+1  
 corosync      1.2.0-3~bpo50+1
 drbd8-utils   2:8.0.14-2+lenny1
 drbd8-modules-2.6.26-2-xen-686   2.6.26+8.0.14-6+lenny3

--- drbd.conf ---------------------

global {
   usage-count yes;

common {
  syncer { rate 10M; }

resource r0 {
  protocol C;
  handlers {
    pri-on-incon-degr "echo o > /proc/sysrq-trigger ; halt -f";
    pri-lost-after-sb "echo o > /proc/sysrq-trigger ; halt -f";
    local-io-error "echo o > /proc/sysrq-trigger ; halt -f";
    outdate-peer "/usr/lib/drbd/outdate-peer2.sh on oberon on daphnis";

  startup {
    degr-wfc-timeout 120;    # 2 minutes.

  disk {
    on-io-error   detach;
    fencing resource-only;

  net {
    after-sb-0pri discard-zero-changes;
    after-sb-1pri discard-secondary;
    after-sb-2pri disconnect;
    rr-conflict disconnect;

  syncer {
    rate 10M;
    al-extents 257;

  on daphnis {
    device     /dev/drbd0;
    disk       /dev/xvdb1;
    meta-disk  internal;

  on oberon {
    device    /dev/drbd0;
    disk      /dev/xvdb1;
    meta-disk internal;

--- crm conf -----------------

node daphnis \
        attributes standby="off"
node oberon \
        attributes standby="off"
primitive drbd0 ocf:heartbeat:drbd \
        params drbd_resource="r0" ignore_deprecation="true" \
        op monitor interval="30" \
        op start interval="0" timeout="240" \
        op stop interval="0" timeout="100"
ms ms-drbd0 drbd0 \
        meta clone-max="2" notify="true" globally-unique="false" target-role="Master" is-managed="true"
location ms-drbd0-location ms-drbd0 \
        rule $id="rule-ms-drbd0" inf: #uname eq oberon \
        rule $id="rule-ms-drbd0-0" 200: #uname eq daphnis
property $id="cib-bootstrap-options" \
        dc-version="1.0.8-2c98138c2f070fcb6ddeab1084154cffbf44ba75" \
        cluster-infrastructure="openais" \
        expected-quorum-votes="2" \
        stonith-enabled="false" \
        symmetric-cluster="false" \
        no-quorum-policy="ignore" \

More information about the drbd-user mailing list