[DRBD-user] Re: [Ocfs2-users] OCFS2 over DRBDv8

Alexei_Roudnev Alexei_Roudnev at exigengroup.com
Thu Aug 17 23:12:39 CEST 2006

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


I advice against it. Even if it is possible, you definitkly will run into
DRBD/o2cb conflict in case of any network glitch,
and will have all your nodes self-fencing. In addition, DRDB is not fast
enough for OCFSv2 default settings.

Through, it all may be very interesting to discover in the lab.

----- Original Message ----- 
From: "Kilian CAVALOTTI" <kilian.cavalotti at lip6.fr>
To: <ocfs2-users at oss.oracle.com>; <drbd-user at linbit.com>
Sent: Thursday, August 17, 2006 7:48 AM
Subject: [Ocfs2-users] OCFS2 over DRBDv8


Hi all,

I'm new to OCFS2, but not so new to DRBD. I'd like to use the new
primary/primary feature of DRBDv8 to create a shared storage space and
concurrently access it from multiple clients, using OCFS2.

I configured two hosts with DRBD, allowed two primaries, and successfully
made each partition primary.

# cat /proc/drbd
version: 8.0pre4 (api:84/proto:82)
SVN Revision: 2375M build by root at moby, 2006-08-17 15:54:17
 0: cs:Connected st:Primary/Primary ds:UpToDate/UpToDate r---
    ns:0 nr:1398278 dw:1398278 dr:98 al:0 bm:1895 lo:0 pe:0 ua:0 ap:0
        resync: used:0/7 hits:86007 misses:1381 starving:0 dirty:0
changed:1381
        act_log: used:0/257 hits:0 misses:0 starving:0 dirty:0 changed:0
 1: cs:Unconfigured

I tried to format the volume with a traditionnal filesystem, and
successfully mounted it on both nodes.

I then tried with ocfs2. On the first node, mkfs and mount went without a
hitch, but on the second one, I systematically get an error when I try to
do anything on the volume (fsck'ing, starting ocfs2-heartbeat, mounting,
etc.). dmesg shows the following,

drbd0: role( Secondary -> Primary )
drbd0: Writing meta data super block now.
(6672,0):o2hb_setup_one_bio:290 ERROR: Error adding page to bio i = 1,
vec_len = 4096, len = 0
, start = 0
(6672,0):o2hb_read_slots:385 ERROR: status = -5
(6672,0):o2hb_populate_slot_data:1279 ERROR: status = -5
(6672,0):o2hb_region_dev_write:1379 ERROR: status = -5


It seems that the heartbeat process can't write to the device, for an
unknown reason:

open("/sys/kernel/config/cluster", O_RDONLY|O_NONBLOCK|O_DIRECTORY) = 4
fstat(4, {st_mode=S_IFDIR|0755, st_size=0, ...}) = 0
fcntl(4, F_SETFD, FD_CLOEXEC)           = 0
getdents64(4, /* 3 entries */, 4096)    = 88
getdents64(4, /* 0 entries */, 4096)    = 0
close(4)                                = 0
mkdir("/sys/kernel/config/cluster/ocfs2_cluster/heartbeat/D6F76726AFE4472CBF
0650A1FEF09135",
0755) = 0
open("/sys/kernel/config/cluster/ocfs2_cluster/heartbeat/D6F76726AFE4472CBF0
650A1FEF09135/block_bytes",
O_WRONLY) = 4
write(4, "512", 3)                      = 3
close(4)                                = 0
open("/sys/kernel/config/cluster/ocfs2_cluster/heartbeat/D6F76726AFE4472CBF0
650A1FEF09135/start_block",
O_WRONLY) = 4
write(4, "2176", 4)                     = 4
close(4)                                = 0
open("/sys/kernel/config/cluster/ocfs2_cluster/heartbeat/D6F76726AFE4472CBF0
650A1FEF09135/blocks",
O_WRONLY) = 4
write(4, "255", 3)                      = 3
close(4)                                = 0
open("/dev/drbd0", O_RDWR)              = 4
open("/sys/kernel/config/cluster/ocfs2_cluster/heartbeat/D6F76726AFE4472CBF0
650A1FEF09135/dev",
O_WRONLY) = 5
write(5, "4", 1)                        = -1 EIO (Input/output error)
close(5)                                = 0
close(4)                                = 0
rmdir("/sys/kernel/config/cluster/ocfs2_cluster/heartbeat/D6F76726AFE4472CBF
0650A1FEF09135")
= 0
semop(0, 0x7fff930bfe30, 1)             = 0
close(3)                                = 0
write(2, "mkfs.ocfs2", 10mkfs.ocfs2)              = 10
write(2, ": ", 2: )                       = 2
write(2, "I/O error on channel", 20I/O error on channel)    = 20
write(2, " ", 1 )                        = 1
write(2, "while initializing the dlm", 26while initializing the dlm) = 26
write(2, "\r\n", 2

I can't figure if it's a DRBD- or a OCFS2-related issue, and I'd take any
enlightenment with gratitude.

BTW, I use amd64, debian-provided 2.6.17 kernel, drbd8-module-source
8.0pre4-1 (I tried SVN trunk too), and ocfs2-tools 1.2.1-1.

Thanks in advance,
-- 
Kilian CAVALOTTI                      Administrateur réseaux et systèmes
UPMC / CNRS - LIP6 (C870)
8, rue du Capitaine Scott                          Tel. : 01 44 27 88 54
75015 Paris - France                               Fax. : 01 44 27 70 00

_______________________________________________
Ocfs2-users mailing list
Ocfs2-users at oss.oracle.com
http://oss.oracle.com/mailman/listinfo/ocfs2-users





More information about the drbd-user mailing list