[DRBD-user] Re: DRBDv8 + LVM (problems in cstate)(LONG)

Igor Morgado igormorgado.listas at gmail.com
Wed Aug 16 21:25:58 CEST 2006

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


On 8/16/06, Lars Ellenberg <Lars.Ellenberg at linbit.com> wrote:
>
> / 2006-08-16 15:06:45 -0300
> \ Igor Morgado:
> > Lars.. didn't work
>
> > I give the following command in both nodes (one after another, just for
> try)
> > magratea:/usr/local/bin# drbdadm connect all
> > cricket:/# drbdadm connect all
>
> this maybe was bad.


this is VERY bad ;-)


each "drbdadm connect" does a disconnect first, then reconnect.
> and if we have trouble communicating during the initial handshake,
> we might decide that we won't try again for some reason, and go
> standalone.
>
> how much time between those commands?


first I have tried only on node 1 after 30 seconds on node 2 (and I notice
that both are still stand alone). Then I have tried on both with one second
difference (they are with clock syncronized)


> The log reported:
>
> please, try to get the line wraps right.
> and try with one resource first, no point in multiplying the log
> messages by numbers of devices here while you try to get a grip on it.


The log was taken as in /var/log/messages file. I will try again (the clock
shows the REALTIME)

Here goes again (with a timestamp on every command)

magratea:/$ export PS1="[\t]\h:\w\$ "

[16:20:21]magratea:/$ cat /proc/drbd
version: 8.0pre4 (api:83/proto:82)
SVN Revision: 2267 build by root at magratea, 2006-08-09 11:57:39
 0: cs:StandAlone st:Primary/Unknown ds:UpToDate/DUnknown r---
    ns:0 nr:0 dw:8089 dr:8982 al:0 bm:0 lo:0 pe:0 ua:0 ap:0
        resync: used:0/7 hits:0 misses:0 starving:0 dirty:0 changed:0
        act_log: used:0/257 hits:1193 misses:0 starving:0 dirty:0 changed:0
 1: cs:StandAlone st:Primary/Unknown ds:UpToDate/DUnknown r---
    ns:0 nr:0 dw:6456 dr:31350 al:0 bm:0 lo:0 pe:0 ua:0 ap:0
        resync: used:0/7 hits:0 misses:0 starving:0 dirty:0 changed:0
        act_log: used:0/257 hits:788 misses:0 starving:0 dirty:0 changed:0
 2: cs:StandAlone st:Primary/Unknown ds:UpToDate/DUnknown r---
    ns:0 nr:0 dw:90437 dr:17451 al:1 bm:0 lo:0 pe:0 ua:0 ap:0
        resync: used:0/7 hits:0 misses:0 starving:0 dirty:0 changed:0
        act_log: used:0/257 hits:15622 misses:1 starving:0 dirty:0 changed:1
 3: cs:Unconfigured
 4: cs:Unconfigured
 5: cs:Unconfigured
 6: cs:Unconfigured
 7: cs:Unconfigured
 8: cs:Unconfigured
 9: cs:Unconfigured
10: cs:Unconfigured
11: cs:Unconfigured
12: cs:Unconfigured
13: cs:Unconfigured
14: cs:Unconfigured
[16:20:24]magratea:/$

cricket:/$ export PS1="[\t]\h:\w\$ "
[16:20:53]cricket:/$ cat /proc/drbd
version: 8.0pre4 (api:83/proto:82)
SVN Revision: 2267 build by root at magratea, 2006-08-09 11:57:39
 0: cs:StandAlone st:Secondary/Unknown ds:Inconsistent/DUnknown r---
    ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0
        resync: used:0/7 hits:0 misses:0 starving:0 dirty:0 changed:0
        act_log: used:0/257 hits:0 misses:0 starving:0 dirty:0 changed:0
 1: cs:StandAlone st:Secondary/Unknown ds:Inconsistent/DUnknown r---
    ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0
        resync: used:0/7 hits:0 misses:0 starving:0 dirty:0 changed:0
        act_log: used:0/257 hits:0 misses:0 starving:0 dirty:0 changed:0
 2: cs:StandAlone st:Secondary/Unknown ds:Inconsistent/DUnknown r---
    ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0
        resync: used:0/7 hits:0 misses:0 starving:0 dirty:0 changed:0
        act_log: used:0/257 hits:0 misses:0 starving:0 dirty:0 changed:0
 3: cs:Unconfigured
 4: cs:Unconfigured
 5: cs:Unconfigured
 6: cs:Unconfigured
 7: cs:Unconfigured
 8: cs:Unconfigured
 9: cs:Unconfigured
10: cs:Unconfigured
11: cs:Unconfigured
12: cs:Unconfigured
13: cs:Unconfigured
14: cs:Unconfigured
[16:21:00]cricket:/$

[16:21:00]cricket:/$ /etc/init.d/drbd stop
Stopping all DRBD resources.
[16:21:18]cricket:/$ /etc/init.d/drbd stop
Stopping all DRBD resources.
[16:21:20]cricket:/$ cat /proc/drbd
cat: /proc/drbd: No such file or directory
[16:21:27]cricket:/$ /etc/init.d/drbd start
Starting DRBD resources:    [ d0 d1 d2 s0 s1 s2 n0 n1 n2 ].
..........
***************************************************************
 DRBD's startup script waits for the peer node(s) to appear.
 - In case this node was already a degraded cluster before the
   reboot the timeout is 0 seconds. [degr-wfc-timeout]
 - If the peer was available before the reboot the timeout will
   expire after 0 seconds. [wfc-timeout]
   (These values are for resource 'marvin.root'; 0 sec -> wait forever)
 To abort waiting enter 'yes' [  15]:

(at magratea)
[16:22:02]magratea:/$ drbdadm connect all
[16:22:09]magratea:/$


(at cricket)
 To abort waiting enter 'yes' [  38]:
[16:22:09]cricket:/$


the log file from this period. (from both hosts)

Aug 16 16:13:47 magratea kernel: drbd1: Connection closed
Aug 16 16:22:09 magratea kernel: drbd0: conn( StandAlone -> Unconnected )
Aug 16 16:22:09 magratea kernel: drbd0: conn( Unconnected -> WFConnection )
Aug 16 16:22:09 magratea kernel: drbd0: conn( WFConnection -> WFReportParams
)
Aug 16 16:22:09 magratea kernel: drbd1: conn( StandAlone -> Unconnected )
Aug 16 16:22:09 magratea kernel: drbd1: conn( Unconnected -> WFConnection )
Aug 16 16:22:09 magratea kernel: drbd2: conn( StandAlone -> Unconnected )
Aug 16 16:22:09 magratea kernel: drbd2: conn( Unconnected -> WFConnection )
Aug 16 16:22:09 magratea kernel: drbd0: Handshake successful: DRBD Network
Protocol version 82
Aug 16 16:22:09 magratea kernel: drbd1: conn( WFConnection -> WFReportParams
)
Aug 16 16:22:09 magratea kernel: drbd2: conn( WFConnection -> WFReportParams
)
Aug 16 16:22:09 magratea kernel: drbd0: conn( WFReportParams -> StandAlone )
Aug 16 16:22:09 magratea kernel: drbd0: asender terminated
Aug 16 16:22:09 magratea kernel: drbd1: Handshake successful: DRBD Network
Protocol version 82
Aug 16 16:22:09 magratea kernel: drbd0: receiver terminated
Aug 16 16:22:09 magratea kernel: drbd0: tl_clear()
Aug 16 16:22:09 magratea kernel: drbd0: Connection closed
Aug 16 16:22:09 magratea kernel: drbd2: Handshake successful: DRBD Network
Protocol version 82
Aug 16 16:22:09 magratea kernel: drbd1: conn( WFReportParams -> StandAlone )
Aug 16 16:22:09 magratea kernel: drbd1: asender terminated
Aug 16 16:22:09 magratea kernel: drbd2: conn( WFReportParams -> StandAlone )
Aug 16 16:22:09 magratea kernel: drbd2: asender terminated
Aug 16 16:22:09 magratea kernel: drbd2: receiver terminated
Aug 16 16:22:09 magratea kernel: drbd2: tl_clear()
Aug 16 16:22:09 magratea kernel: drbd2: Connection closed
Aug 16 16:22:09 magratea kernel: drbd1: receiver terminated
Aug 16 16:22:09 magratea kernel: drbd1: tl_clear()
Aug 16 16:22:09 magratea kernel: drbd1: Connection closed


Aug 16 16:13:47 cricket kernel: drbd1: Connection closed
Aug 16 16:21:18 cricket kernel: drbd0: disk( Inconsistent -> Diskless )
Aug 16 16:21:18 cricket kernel: drbd0: worker terminated
Aug 16 16:21:18 cricket kernel: drbd0: drbd_bm_resize called with capacity
== 0
Aug 16 16:21:18 cricket kernel: drbd1: disk( Inconsistent -> Diskless )
Aug 16 16:21:18 cricket kernel: drbd1: worker terminated
Aug 16 16:21:18 cricket kernel: drbd1: drbd_bm_resize called with capacity
== 0
Aug 16 16:21:18 cricket kernel: drbd2: disk( Inconsistent -> Diskless )
Aug 16 16:21:18 cricket kernel: drbd2: worker terminated
Aug 16 16:21:18 cricket kernel: drbd2: drbd_bm_resize called with capacity
== 0
Aug 16 16:21:18 cricket kernel: drbd: module cleanup done.
Aug 16 16:21:31 cricket kernel: drbd: initialised. Version:
8.0pre4(api:83/proto:82)
Aug 16 16:21:31 cricket kernel: drbd: SVN Revision: 2267 build by
root at magratea, 2006-08-09 11:57:39
Aug 16 16:21:31 cricket kernel: drbd: registered as block device major 147
Aug 16 16:21:31 cricket kernel: drbd0: disk( Diskless -> Attaching )
Aug 16 16:21:31 cricket kernel: klogd 1.4.1, ---------- state change
----------
Aug 16 16:21:31 cricket kernel: No module symbols loaded - kernel modules
not enabled.
Aug 16 16:21:31 cricket kernel: drbd0: Found 6 transactions (80 active
extents) in activity log.
Aug 16 16:21:31 cricket kernel: drbd0: drbd_bm_resize called with capacity
== 2097016
Aug 16 16:21:31 cricket kernel: drbd0: resync bitmap: bits=262127 words=8192
Aug 16 16:21:31 cricket kernel: drbd0: size = 1023 MB (1048508 KB)
Aug 16 16:21:31 cricket kernel: drbd0: reading of bitmap took 0 jiffies
Aug 16 16:21:31 cricket kernel: drbd0: recounting of set bits took
additional 0 jiffies
Aug 16 16:21:31 cricket kernel: drbd0: 1023 MB marked out-of-sync by on disk
bit-map.
Aug 16 16:21:31 cricket kernel: drbd0: disk( Attaching -> Inconsistent )
Aug 16 16:21:31 cricket kernel: drbd0: Writing meta data super block now.
Aug 16 16:21:31 cricket kernel: drbd1: disk( Diskless -> Attaching )
Aug 16 16:21:31 cricket kernel: drbd1: Found 6 transactions (98 active
extents) in activity log.
Aug 16 16:21:31 cricket kernel: drbd1: drbd_bm_resize called with capacity
== 2097016
Aug 16 16:21:31 cricket kernel: drbd1: resync bitmap: bits=262127 words=8192
Aug 16 16:21:31 cricket kernel: drbd1: size = 1023 MB (1048508 KB)
Aug 16 16:21:31 cricket kernel: drbd1: reading of bitmap took 0 jiffies
Aug 16 16:21:31 cricket kernel: drbd1: recounting of set bits took
additional 0 jiffies
Aug 16 16:21:31 cricket kernel: drbd1: 1023 MB marked out-of-sync by on disk
bit-map.
Aug 16 16:21:31 cricket kernel: drbd1: disk( Attaching -> Inconsistent )
Aug 16 16:21:31 cricket kernel: drbd1: Writing meta data super block now.
Aug 16 16:21:31 cricket kernel: drbd2: disk( Diskless -> Attaching )
Aug 16 16:21:31 cricket kernel: drbd2: Found 6 transactions (222 active
extents) in activity log.
Aug 16 16:21:31 cricket kernel: drbd2: drbd_bm_resize called with capacity
== 8388280
Aug 16 16:21:31 cricket kernel: drbd2: resync bitmap: bits=1048535
words=32768
Aug 16 16:21:31 cricket kernel: drbd2: size = 4095 MB (4194140 KB)
Aug 16 16:21:31 cricket kernel: drbd2: reading of bitmap took 1 jiffies
Aug 16 16:21:31 cricket kernel: drbd2: recounting of set bits took
additional 0 jiffies
Aug 16 16:21:31 cricket kernel: drbd2: 4095 MB marked out-of-sync by on disk
bit-map.
Aug 16 16:21:31 cricket kernel: drbd2: disk( Attaching -> Inconsistent )
Aug 16 16:21:31 cricket kernel: drbd2: Writing meta data super block now.
Aug 16 16:21:31 cricket kernel: drbd0: conn( StandAlone -> Unconnected )
Aug 16 16:21:31 cricket kernel: drbd0: conn( Unconnected -> WFConnection )
Aug 16 16:21:31 cricket kernel: drbd1: conn( StandAlone -> Unconnected )
Aug 16 16:21:31 cricket kernel: drbd1: conn( Unconnected -> WFConnection )
Aug 16 16:21:31 cricket kernel: drbd2: conn( StandAlone -> Unconnected )
Aug 16 16:21:31 cricket kernel: drbd2: conn( Unconnected -> WFConnection )
Aug 16 16:22:09 cricket kernel: drbd0: conn( WFConnection -> WFReportParams
)
Aug 16 16:22:09 cricket kernel: drbd0: Handshake successful: DRBD Network
Protocol version 82
Aug 16 16:22:09 cricket kernel: drbd1: conn( WFConnection -> WFReportParams
)
Aug 16 16:22:09 cricket kernel: drbd2: conn( WFConnection -> WFReportParams
)
Aug 16 16:22:09 cricket kernel: drbd0: conn( WFReportParams -> StandAlone )
Aug 16 16:22:09 cricket kernel: drbd0: asender terminated
Aug 16 16:22:09 cricket kernel: drbd0: receiver terminated
Aug 16 16:22:09 cricket kernel: drbd0: tl_clear()
Aug 16 16:22:09 cricket kernel: drbd0: Connection closed
Aug 16 16:22:09 cricket kernel: drbd1: Handshake successful: DRBD Network
Protocol version 82
Aug 16 16:22:09 cricket kernel: drbd2: Handshake successful: DRBD Network
Protocol version 82
Aug 16 16:22:09 cricket kernel: drbd1: conn( WFReportParams -> StandAlone )
Aug 16 16:22:09 cricket kernel: drbd1: asender terminated
Aug 16 16:22:09 cricket kernel: drbd2: conn( WFReportParams -> StandAlone )
Aug 16 16:22:09 cricket kernel: drbd2: asender terminated
Aug 16 16:22:09 cricket kernel: drbd2: receiver terminated
Aug 16 16:22:09 cricket kernel: drbd2: tl_clear()
Aug 16 16:22:09 cricket kernel: drbd2: Connection closed
Aug 16 16:22:09 cricket kernel: drbd1: receiver terminated
Aug 16 16:22:09 cricket kernel: drbd1: tl_clear()
Aug 16 16:22:09 cricket kernel: drbd1: Connection closed
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linbit.com/pipermail/drbd-user/attachments/20060816/bc2ad76d/attachment.htm>


More information about the drbd-user mailing list