<br><br><div><span class="gmail_quote">On 8/16/06, <b class="gmail_sendername">Lars Ellenberg</b> <<a href="mailto:Lars.Ellenberg@linbit.com">Lars.Ellenberg@linbit.com</a>> wrote:</span><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
/ 2006-08-16 15:06:45 -0300<br>\ Igor Morgado:<br>> Lars.. didn't work<br><br>> I give the following command in both nodes (one after another, just for try)<br>> magratea:/usr/local/bin# drbdadm connect all<br>> cricket:/# drbdadm connect all
<br><br>this maybe was bad.</blockquote><div><br>this is VERY bad ;-)<br> <br></div><br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">each "drbdadm connect" does a disconnect first, then reconnect.
<br>and if we have trouble communicating during the initial handshake,<br>we might decide that we won't try again for some reason, and go<br>standalone.<br><br>how much time between those commands?</blockquote><div><br>first I have tried only on node 1 after 30 seconds on node 2 (and I notice that both are still stand alone). Then I have tried on both with one second difference (they are with clock syncronized)
<br><br></div><br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">> The log reported:<br><br>please, try to get the line wraps right.<br>
and try with one resource first, no point in multiplying the log<br>messages by numbers of devices here while you try to get a grip on it.</blockquote><div><br>The log was taken as in /var/log/messages file. I will try again (the clock shows the REALTIME)
<br></div></div><br>Here goes again (with a timestamp on every command)<br><br>magratea:/$ export PS1="[\t]\h:\w\$ "<br><br>[16:20:21]magratea:/$ cat /proc/drbd<br>version: 8.0pre4 (api:83/proto:82)<br>SVN Revision: 2267 build by
root@magratea, 2006-08-09 11:57:39<br> 0: cs:StandAlone st:Primary/Unknown ds:UpToDate/DUnknown r---<br> ns:0 nr:0 dw:8089 dr:8982 al:0 bm:0 lo:0 pe:0 ua:0 ap:0<br> resync: used:0/7 hits:0 misses:0 starving:0 dirty:0 changed:0
<br> act_log: used:0/257 hits:1193 misses:0 starving:0 dirty:0 changed:0<br> 1: cs:StandAlone st:Primary/Unknown ds:UpToDate/DUnknown r---<br> ns:0 nr:0 dw:6456 dr:31350 al:0 bm:0 lo:0 pe:0 ua:0 ap:0<br> resync: used:0/7 hits:0 misses:0 starving:0 dirty:0 changed:0
<br> act_log: used:0/257 hits:788 misses:0 starving:0 dirty:0 changed:0<br> 2: cs:StandAlone st:Primary/Unknown ds:UpToDate/DUnknown r---<br> ns:0 nr:0 dw:90437 dr:17451 al:1 bm:0 lo:0 pe:0 ua:0 ap:0<br> resync: used:0/7 hits:0 misses:0 starving:0 dirty:0 changed:0
<br> act_log: used:0/257 hits:15622 misses:1 starving:0 dirty:0 changed:1<br> 3: cs:Unconfigured<br> 4: cs:Unconfigured<br> 5: cs:Unconfigured<br> 6: cs:Unconfigured<br> 7: cs:Unconfigured<br> 8: cs:Unconfigured<br>
9: cs:Unconfigured<br>10: cs:Unconfigured<br>11: cs:Unconfigured<br>12: cs:Unconfigured<br>13: cs:Unconfigured<br>14: cs:Unconfigured<br>[16:20:24]magratea:/$<br><br>cricket:/$ export PS1="[\t]\h:\w\$ "<br>[16:20:53]cricket:/$ cat /proc/drbd
<br>version: 8.0pre4 (api:83/proto:82)<br>SVN Revision: 2267 build by root@magratea, 2006-08-09 11:57:39<br> 0: cs:StandAlone st:Secondary/Unknown ds:Inconsistent/DUnknown r---<br> ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0
<br> resync: used:0/7 hits:0 misses:0 starving:0 dirty:0 changed:0<br> act_log: used:0/257 hits:0 misses:0 starving:0 dirty:0 changed:0<br> 1: cs:StandAlone st:Secondary/Unknown ds:Inconsistent/DUnknown r---
<br> ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0<br> resync: used:0/7 hits:0 misses:0 starving:0 dirty:0 changed:0<br> act_log: used:0/257 hits:0 misses:0 starving:0 dirty:0 changed:0<br> 2: cs:StandAlone st:Secondary/Unknown ds:Inconsistent/DUnknown r---
<br> ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0<br> resync: used:0/7 hits:0 misses:0 starving:0 dirty:0 changed:0<br> act_log: used:0/257 hits:0 misses:0 starving:0 dirty:0 changed:0<br> 3: cs:Unconfigured
<br> 4: cs:Unconfigured<br> 5: cs:Unconfigured<br> 6: cs:Unconfigured<br> 7: cs:Unconfigured<br> 8: cs:Unconfigured<br> 9: cs:Unconfigured<br>10: cs:Unconfigured<br>11: cs:Unconfigured<br>12: cs:Unconfigured<br>13: cs:Unconfigured
<br>14: cs:Unconfigured<br>[16:21:00]cricket:/$<br><br>[16:21:00]cricket:/$ /etc/init.d/drbd stop<br>Stopping all DRBD resources.<br>[16:21:18]cricket:/$ /etc/init.d/drbd stop<br>Stopping all DRBD resources.<br>[16:21:20]cricket:/$ cat /proc/drbd
<br>cat: /proc/drbd: No such file or directory<br>[16:21:27]cricket:/$ /etc/init.d/drbd start<br>Starting DRBD resources: [ d0 d1 d2 s0 s1 s2 n0 n1 n2 ].<br>..........<br>***************************************************************
<br> DRBD's startup script waits for the peer node(s) to appear.<br> - In case this node was already a degraded cluster before the<br> reboot the timeout is 0 seconds. [degr-wfc-timeout]<br> - If the peer was available before the reboot the timeout will
<br> expire after 0 seconds. [wfc-timeout]<br> (These values are for resource 'marvin.root'; 0 sec -> wait forever)<br> To abort waiting enter 'yes' [ 15]:<br><br>(at magratea)<br>[16:22:02]magratea:/$ drbdadm connect all
<br>[16:22:09]magratea:/$<br><br><br>(at cricket)<br> To abort waiting enter 'yes' [ 38]:<br>[16:22:09]cricket:/$<br><br><br>the log file from this period. (from both hosts)<br><br>Aug 16 16:13:47 magratea kernel: drbd1: Connection closed
<br>Aug 16 16:22:09 magratea kernel: drbd0: conn( StandAlone -> Unconnected )<br>Aug 16 16:22:09 magratea kernel: drbd0: conn( Unconnected -> WFConnection )<br>Aug 16 16:22:09 magratea kernel: drbd0: conn( WFConnection -> WFReportParams )
<br>Aug 16 16:22:09 magratea kernel: drbd1: conn( StandAlone -> Unconnected )<br>Aug 16 16:22:09 magratea kernel: drbd1: conn( Unconnected -> WFConnection )<br>Aug 16 16:22:09 magratea kernel: drbd2: conn( StandAlone -> Unconnected )
<br>Aug 16 16:22:09 magratea kernel: drbd2: conn( Unconnected -> WFConnection )<br>Aug 16 16:22:09 magratea kernel: drbd0: Handshake successful: DRBD Network Protocol version 82<br>Aug 16 16:22:09 magratea kernel: drbd1: conn( WFConnection -> WFReportParams )
<br>Aug 16 16:22:09 magratea kernel: drbd2: conn( WFConnection -> WFReportParams )<br>Aug 16 16:22:09 magratea kernel: drbd0: conn( WFReportParams -> StandAlone )<br>Aug 16 16:22:09 magratea kernel: drbd0: asender terminated
<br>Aug 16 16:22:09 magratea kernel: drbd1: Handshake successful: DRBD Network Protocol version 82<br>Aug 16 16:22:09 magratea kernel: drbd0: receiver terminated<br>Aug 16 16:22:09 magratea kernel: drbd0: tl_clear()<br>Aug 16 16:22:09 magratea kernel: drbd0: Connection closed
<br>Aug 16 16:22:09 magratea kernel: drbd2: Handshake successful: DRBD Network Protocol version 82<br>Aug 16 16:22:09 magratea kernel: drbd1: conn( WFReportParams -> StandAlone )<br>Aug 16 16:22:09 magratea kernel: drbd1: asender terminated
<br>Aug 16 16:22:09 magratea kernel: drbd2: conn( WFReportParams -> StandAlone )<br>Aug 16 16:22:09 magratea kernel: drbd2: asender terminated<br>Aug 16 16:22:09 magratea kernel: drbd2: receiver terminated<br>Aug 16 16:22:09 magratea kernel: drbd2: tl_clear()
<br>Aug 16 16:22:09 magratea kernel: drbd2: Connection closed<br>Aug 16 16:22:09 magratea kernel: drbd1: receiver terminated<br>Aug 16 16:22:09 magratea kernel: drbd1: tl_clear()<br>Aug 16 16:22:09 magratea kernel: drbd1: Connection closed
<br><br><br>Aug 16 16:13:47 cricket kernel: drbd1: Connection closed<br>Aug 16 16:21:18 cricket kernel: drbd0: disk( Inconsistent -> Diskless )<br>Aug 16 16:21:18 cricket kernel: drbd0: worker terminated<br>Aug 16 16:21:18 cricket kernel: drbd0: drbd_bm_resize called with capacity == 0
<br>Aug 16 16:21:18 cricket kernel: drbd1: disk( Inconsistent -> Diskless )<br>Aug 16 16:21:18 cricket kernel: drbd1: worker terminated<br>Aug 16 16:21:18 cricket kernel: drbd1: drbd_bm_resize called with capacity == 0
<br>Aug 16 16:21:18 cricket kernel: drbd2: disk( Inconsistent -> Diskless )<br>Aug 16 16:21:18 cricket kernel: drbd2: worker terminated<br>Aug 16 16:21:18 cricket kernel: drbd2: drbd_bm_resize called with capacity == 0
<br>Aug 16 16:21:18 cricket kernel: drbd: module cleanup done.<br>Aug 16 16:21:31 cricket kernel: drbd: initialised. Version: 8.0pre4 (api:83/proto:82)<br>Aug 16 16:21:31 cricket kernel: drbd: SVN Revision: 2267 build by
root@magratea, 2006-08-09 11:57:39<br>Aug 16 16:21:31 cricket kernel: drbd: registered as block device major 147<br>Aug 16 16:21:31 cricket kernel: drbd0: disk( Diskless -> Attaching )<br>Aug 16 16:21:31 cricket kernel: klogd
1.4.1, ---------- state change ----------<br>Aug 16 16:21:31 cricket kernel: No module symbols loaded - kernel modules not enabled.<br>Aug 16 16:21:31 cricket kernel: drbd0: Found 6 transactions (80 active extents) in activity log.
<br>Aug 16 16:21:31 cricket kernel: drbd0: drbd_bm_resize called with capacity == 2097016<br>Aug 16 16:21:31 cricket kernel: drbd0: resync bitmap: bits=262127 words=8192<br>Aug 16 16:21:31 cricket kernel: drbd0: size = 1023 MB (1048508 KB)
<br>Aug 16 16:21:31 cricket kernel: drbd0: reading of bitmap took 0 jiffies<br>Aug 16 16:21:31 cricket kernel: drbd0: recounting of set bits took additional 0 jiffies<br>Aug 16 16:21:31 cricket kernel: drbd0: 1023 MB marked out-of-sync by on disk bit-map.
<br>Aug 16 16:21:31 cricket kernel: drbd0: disk( Attaching -> Inconsistent )<br>Aug 16 16:21:31 cricket kernel: drbd0: Writing meta data super block now.<br>Aug 16 16:21:31 cricket kernel: drbd1: disk( Diskless -> Attaching )
<br>Aug 16 16:21:31 cricket kernel: drbd1: Found 6 transactions (98 active extents) in activity log.<br>Aug 16 16:21:31 cricket kernel: drbd1: drbd_bm_resize called with capacity == 2097016<br>Aug 16 16:21:31 cricket kernel: drbd1: resync bitmap: bits=262127 words=8192
<br>Aug 16 16:21:31 cricket kernel: drbd1: size = 1023 MB (1048508 KB)<br>Aug 16 16:21:31 cricket kernel: drbd1: reading of bitmap took 0 jiffies<br>Aug 16 16:21:31 cricket kernel: drbd1: recounting of set bits took additional 0 jiffies
<br>Aug 16 16:21:31 cricket kernel: drbd1: 1023 MB marked out-of-sync by on disk bit-map.<br>Aug 16 16:21:31 cricket kernel: drbd1: disk( Attaching -> Inconsistent )<br>Aug 16 16:21:31 cricket kernel: drbd1: Writing meta data super block now.
<br>Aug 16 16:21:31 cricket kernel: drbd2: disk( Diskless -> Attaching )<br>Aug 16 16:21:31 cricket kernel: drbd2: Found 6 transactions (222 active extents) in activity log.<br>Aug 16 16:21:31 cricket kernel: drbd2: drbd_bm_resize called with capacity == 8388280
<br>Aug 16 16:21:31 cricket kernel: drbd2: resync bitmap: bits=1048535 words=32768<br>Aug 16 16:21:31 cricket kernel: drbd2: size = 4095 MB (4194140 KB)<br>Aug 16 16:21:31 cricket kernel: drbd2: reading of bitmap took 1 jiffies
<br>Aug 16 16:21:31 cricket kernel: drbd2: recounting of set bits took additional 0 jiffies<br>Aug 16 16:21:31 cricket kernel: drbd2: 4095 MB marked out-of-sync by on disk bit-map.<br>Aug 16 16:21:31 cricket kernel: drbd2: disk( Attaching -> Inconsistent )
<br>Aug 16 16:21:31 cricket kernel: drbd2: Writing meta data super block now.<br>Aug 16 16:21:31 cricket kernel: drbd0: conn( StandAlone -> Unconnected )<br>Aug 16 16:21:31 cricket kernel: drbd0: conn( Unconnected -> WFConnection )
<br>Aug 16 16:21:31 cricket kernel: drbd1: conn( StandAlone -> Unconnected )<br>Aug 16 16:21:31 cricket kernel: drbd1: conn( Unconnected -> WFConnection )<br>Aug 16 16:21:31 cricket kernel: drbd2: conn( StandAlone -> Unconnected )
<br>Aug 16 16:21:31 cricket kernel: drbd2: conn( Unconnected -> WFConnection )<br>Aug 16 16:22:09 cricket kernel: drbd0: conn( WFConnection -> WFReportParams )<br>Aug 16 16:22:09 cricket kernel: drbd0: Handshake successful: DRBD Network Protocol version 82
<br>Aug 16 16:22:09 cricket kernel: drbd1: conn( WFConnection -> WFReportParams )<br>Aug 16 16:22:09 cricket kernel: drbd2: conn( WFConnection -> WFReportParams )<br>Aug 16 16:22:09 cricket kernel: drbd0: conn( WFReportParams -> StandAlone )
<br>Aug 16 16:22:09 cricket kernel: drbd0: asender terminated<br>Aug 16 16:22:09 cricket kernel: drbd0: receiver terminated<br>Aug 16 16:22:09 cricket kernel: drbd0: tl_clear()<br>Aug 16 16:22:09 cricket kernel: drbd0: Connection closed
<br>Aug 16 16:22:09 cricket kernel: drbd1: Handshake successful: DRBD Network Protocol version 82<br>Aug 16 16:22:09 cricket kernel: drbd2: Handshake successful: DRBD Network Protocol version 82<br>Aug 16 16:22:09 cricket kernel: drbd1: conn( WFReportParams -> StandAlone )
<br>Aug 16 16:22:09 cricket kernel: drbd1: asender terminated<br>Aug 16 16:22:09 cricket kernel: drbd2: conn( WFReportParams -> StandAlone )<br>Aug 16 16:22:09 cricket kernel: drbd2: asender terminated<br>Aug 16 16:22:09 cricket kernel: drbd2: receiver terminated
<br>Aug 16 16:22:09 cricket kernel: drbd2: tl_clear()<br>Aug 16 16:22:09 cricket kernel: drbd2: Connection closed<br>Aug 16 16:22:09 cricket kernel: drbd1: receiver terminated<br>Aug 16 16:22:09 cricket kernel: drbd1: tl_clear()
<br>Aug 16 16:22:09 cricket kernel: drbd1: Connection closed<br><br><br>