[DRBD-user] OCFS2 over DRBDv8

Kilian CAVALOTTI kilian.cavalotti at lip6.fr
Thu Aug 17 16:48:20 CEST 2006

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


Hi all,

I'm new to OCFS2, but not so new to DRBD. I'd like to use the new 
primary/primary feature of DRBDv8 to create a shared storage space and 
concurrently access it from multiple clients, using OCFS2.

I configured two hosts with DRBD, allowed two primaries, and successfully 
made each partition primary. 

# cat /proc/drbd
version: 8.0pre4 (api:84/proto:82)
SVN Revision: 2375M build by root at moby, 2006-08-17 15:54:17
 0: cs:Connected st:Primary/Primary ds:UpToDate/UpToDate r---
    ns:0 nr:1398278 dw:1398278 dr:98 al:0 bm:1895 lo:0 pe:0 ua:0 ap:0
        resync: used:0/7 hits:86007 misses:1381 starving:0 dirty:0 
changed:1381
        act_log: used:0/257 hits:0 misses:0 starving:0 dirty:0 changed:0
 1: cs:Unconfigured

I tried to format the volume with a traditionnal filesystem, and 
successfully mounted it on both nodes.

I then tried with ocfs2. On the first node, mkfs and mount went without a 
hitch, but on the second one, I systematically get an error when I try to 
do anything on the volume (fsck'ing, starting ocfs2-heartbeat, mounting, 
etc.). dmesg shows the following,

drbd0: role( Secondary -> Primary )
drbd0: Writing meta data super block now.
(6672,0):o2hb_setup_one_bio:290 ERROR: Error adding page to bio i = 1, 
vec_len = 4096, len = 0
, start = 0
(6672,0):o2hb_read_slots:385 ERROR: status = -5
(6672,0):o2hb_populate_slot_data:1279 ERROR: status = -5
(6672,0):o2hb_region_dev_write:1379 ERROR: status = -5


It seems that the heartbeat process can't write to the device, for an 
unknown reason:

open("/sys/kernel/config/cluster", O_RDONLY|O_NONBLOCK|O_DIRECTORY) = 4
fstat(4, {st_mode=S_IFDIR|0755, st_size=0, ...}) = 0
fcntl(4, F_SETFD, FD_CLOEXEC)           = 0
getdents64(4, /* 3 entries */, 4096)    = 88
getdents64(4, /* 0 entries */, 4096)    = 0
close(4)                                = 0
mkdir("/sys/kernel/config/cluster/ocfs2_cluster/heartbeat/D6F76726AFE4472CBF0650A1FEF09135", 
0755) = 0
open("/sys/kernel/config/cluster/ocfs2_cluster/heartbeat/D6F76726AFE4472CBF0650A1FEF09135/block_bytes", 
O_WRONLY) = 4
write(4, "512", 3)                      = 3
close(4)                                = 0
open("/sys/kernel/config/cluster/ocfs2_cluster/heartbeat/D6F76726AFE4472CBF0650A1FEF09135/start_block", 
O_WRONLY) = 4
write(4, "2176", 4)                     = 4
close(4)                                = 0
open("/sys/kernel/config/cluster/ocfs2_cluster/heartbeat/D6F76726AFE4472CBF0650A1FEF09135/blocks", 
O_WRONLY) = 4
write(4, "255", 3)                      = 3
close(4)                                = 0
open("/dev/drbd0", O_RDWR)              = 4
open("/sys/kernel/config/cluster/ocfs2_cluster/heartbeat/D6F76726AFE4472CBF0650A1FEF09135/dev", 
O_WRONLY) = 5
write(5, "4", 1)                        = -1 EIO (Input/output error)
close(5)                                = 0
close(4)                                = 0
rmdir("/sys/kernel/config/cluster/ocfs2_cluster/heartbeat/D6F76726AFE4472CBF0650A1FEF09135") 
= 0
semop(0, 0x7fff930bfe30, 1)             = 0
close(3)                                = 0
write(2, "mkfs.ocfs2", 10mkfs.ocfs2)              = 10
write(2, ": ", 2: )                       = 2
write(2, "I/O error on channel", 20I/O error on channel)    = 20
write(2, " ", 1 )                        = 1
write(2, "while initializing the dlm", 26while initializing the dlm) = 26
write(2, "\r\n", 2

I can't figure if it's a DRBD- or a OCFS2-related issue, and I'd take any 
enlightenment with gratitude.

BTW, I use amd64, debian-provided 2.6.17 kernel, drbd8-module-source 
8.0pre4-1 (I tried SVN trunk too), and ocfs2-tools 1.2.1-1.

Thanks in advance, 
-- 
Kilian CAVALOTTI                      Administrateur réseaux et systèmes
UPMC / CNRS - LIP6 (C870)
8, rue du Capitaine Scott                          Tel. : 01 44 27 88 54
75015 Paris - France                               Fax. : 01 44 27 70 00



More information about the drbd-user mailing list