[DRBD-user] DRBD 8.2.5 on Debian/SID

Pascal Charest pascal.charest at gmail.com
Wed Feb 13 04:41:33 CET 2008

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


 Hi,

I've been using DRBD for about two years and since I'm between two
freelances contracts, I decided to play with DRBD a bit more. This mail
might be on the long side, but it end with an help offer so bear with me
;-).

Install process:
I installed 2 Debian/SID systems in my lab, both of which is a totally
identical, minimal, install. The first system is named Ruby, second one is
Crystal. I installed with the following commands :

# apt-get install git-core
# cd /usr/local/src
# git-clone git://git.drbd.org/drbd-8.2.git drbd-8.2
# apt-get install linux-headers-`uname -r` build-essential flex
docbook-utils
# cd /usr/local/src/drbd-8.2
# make
# make doc
# make install

I then modified /etc/drbd.conf to fit my config (/etc/drbd.conf - available
at the url in _1_ ). Everything is working great with the standard
Primary/Secondary mode with an ext3 filesystem.

Where problems appear :

I wanted to try the new "online verifiy". Things then got a bit ugly.

Please note : this is no production environment, I'm not freak enough to put
an unstable DRBD (version 8.2.5) on an unstable distribution (Debian/SID,
kernel 2.6.24-1). Those systems are in a lab environment and available for
any test you want me to throw at them.  Not sure if it is a bug or simply a
miss-configuration on my side. If it is the latter feel free to throw me
back at my books ;-)

The status seem good :
ruby# cat /proc/drbd
version: 8.2.5 (api:88/proto:86-88)
GIT-hash: db3f40437ed29d4f4fcefca8154d6972dc101561 build by root at ruby,
2008-02-12 19:45:26
 0: cs:Connected st:Primary/Secondary ds:UpToDate/UpToDate C r---
    ns:4 nr:0 dw:4 dr:17 al:0 bm:0 lo:0 pe:0 ua:0 ap:0
    resync: used:0/31 hits:0 misses:0 starving:0 dirty:0 changed:0
    act_log: used:0/257 hits:1 misses:0 starving:0 dirty:0 changed:0

crystal# cat /proc/drbd
version: 8.2.5 (api:88/proto:86-88)
GIT-hash: db3f40437ed29d4f4fcefca8154d6972dc101561 build by root at crystal,
2008-02-12 14:22:58
 0: cs:Connected st:Secondary/Primary ds:UpToDate/UpToDate C r---
    ns:0 nr:4 dw:4 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0
    resync: used:0/31 hits:0 misses:0 starving:0 dirty:0 changed:0
    act_log: used:0/257 hits:0 misses:0 starving:0 dirty:0 changed:0

There is a weird warning (on crystal) when I use the mounted fs on ruby :
drbd0: local disk flush failed with status -5

This error does seem to come from ./drbd/drbd_receiver.c concerning
BarrierAck, which my dmesg, at drbd startup clearly state:

drbd0: Barriers not supported on meta data device - disabling


And, as soon as I use, on Ruby (the primary), this command, it get even
weirder:

# drbdadm verify store

DRBD fail with those errors:

Jade:

drbd0: conn( Connected -> VerifyS )
drbd0: sock_recvmsg returned -104
drbd0: peer( Secondary -> Unknown ) conn( VerifyS -> NetworkFailure )
pdsk( UpToDate -> DUnknown )
drbd0: asender terminated
drbd0: Terminating asender thread
drbd0: sock was shut down by peer
drbd0: short read expecting header on sock: r=0
drbd0: Creating new current UUID
drbd0: Writing meta data super block now.
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: drbd_rs_complete_io() called, but extent not found
drbd0: tl_clear()
drbd0: Connection closed
drbd0: conn( NetworkFailure -> Unconnected )
drbd0: receiver terminated
drbd0: receiver (re)started
drbd0: conn( Unconnected -> WFConnection )

(The drbd status is now Primary/unknown, uptodate/Dunknown)

Crystal :

drbd0: conn( Connected -> VerifyT )
drbd0: unknown command?? on meta m: 0x83740267 c: 8192 l: 6144
drbd0: peer( Primary -> Unknown ) conn( VerifyT -> Disconnecting )
pdsk( UpToDate -> DUnknown )
drbd0: asender terminated
drbd0: Terminating asender thread
drbd0: Writing meta data super block now.
drbd0: short read expecting header on sock: r=-512
drbd0: tl_clear()
drbd0: Connection closed
drbd0: conn( Disconnecting -> StandAlone )
drbd0: receiver terminated
drbd0: Terminating receiver thread

(The drbd status is now secondary/unknown, uptodate/Dunknown)

Some informations you might be interested in :

#cat /proc/crypto (identical on both sys.)
Name         : hmac(md5)
driver       : hmac(md5-generic)
module       : kernel
priority     : 0
refcnt       : 2
type         : hash
blocksize    : 64
digestsize   : 16

name         : md5
driver       : md5-generic
module       : kernel
priority     : 0
refcnt       : 3
type         : digest
blocksize    : 64
digestsize   : 16


#uname -a (identical on both sys, except for hostname)
Linux ruby 2.6.24-1-686 #1 SMP Mon Feb 11 14:37:45 UTC 2008 i686 GNU/Linux



On a side note:
As I've said in the introduction, I'm currently between contract, so I've
got some free time. I wanted to know if there is any interest in 1) an
update to the INSTALL file (with, maybe, INSTALL.debian, INSTALL.suse,
etc...) 2) an interest in documentation translation toward french. Once
again, please note that "no" is a valid answer ;-).

_1_ : link to googledocs,  /etc/drbd.conf :
http://docs.google.com/Doc?id=dhcjg4tt_34hdrpz8dw

Pascal Charest


-- 
Pascal Charest, Free software consultant (GNU/linux)
http://blog.pacharest.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linbit.com/pipermail/drbd-user/attachments/20080212/d82d4a99/attachment.htm>


More information about the drbd-user mailing list