[DRBD-user] drbd and large disk

[Desjardins, Kristian]

I am trying to setup drbd (8.0.4) on a large raid system, 9.745 TB and
it does not see all of the disk.  I wasn't sure of the state of drbd
w.r.t. block devices larger than 4TB.  It seems to work, almost.. Also,
I am using a custom OpenVZ RHEL kernel 2.6.18-8.1.8.el5.028stab039.1 and
I can't compile 8.0.6 (8.0.5 compiles but upon loading it says that it
is 8.0.4), the error output is way below..

Thanks.



drbd.conf:

global { usage-count yes; }

resource ftp1 {
        protocol C;
        disk {
                on-io-error   detach;
        }
        syncer {
                rate 80M;
                al-extents 257;
        }
        net {
                cram-hmac-alg sha1; shared-secret "";
        }
        on ccrsftp1 {
                device    /dev/drbd0;
                disk      /dev/sdb1;
                address   192.168.0.1:7789;
                flexible-meta-disk   internal;
        }
        on ccrsftp2 {
                device    /dev/drbd0;
                disk      /dev/sdb1;
                address   192.168.0.2:7789;
                flexible-meta-disk internal;
        }
}

drbdadm create-md ftp1

Valid meta-data already in place, recreate new?
[need to type 'yes' to confirm] yes

Creating meta data...
initialising activity log
NOT initialized bitmap (290420 KB)
New drbd meta data block sucessfully created.


drbdadm  up ftp1

output from kernel:

drbd0: disk( Diskless -> Attaching )
drbd0: No usable activity log found.
drbd0: max_segment_size ( = BIO size ) = 32768
drbd0: drbd_bm_resize called with capacity == 19032384136
drbd0: resync bitmap: bits=2379048017 words=37172626
drbd0: size = 9075 GB (9516192068 KB)
drbd0: writing of bitmap took 1824 jiffies
drbd0: 9075 GB marked out-of-sync by on disk bit-map.
drbd0: 9516192068 KB now marked out-of-sync by on disk bit-map.
drbd0: BUG! md_sync_timer expired! Worker calls drbd_md_sync().
drbd0: reading of bitmap took 7888 jiffies
drbd0: recounting of set bits took additional 205 jiffies
drbd0: 9075 GB marked out-of-sync by on disk bit-map.
drbd0: disk( Attaching -> Inconsistent )
drbd0: conn( StandAlone -> Unconnected )
drbd0: receiver (re)started
drbd0: conn( Unconnected -> WFConnection )


parted /dev/sdb

GNU Parted 1.8.1
Using /dev/sdb
Welcome to GNU Parted! Type 'help' to view a list of commands.
(parted) p

Model: DELL PERC 5/E Adapter (scsi)
Disk /dev/sdb: 9745GB
Sector size (logical/physical): 512B/512B
Partition Table: gpt

Number  Start   End     Size    File system  Name  Flags
 1      17.4kB  9745GB  9745GB  xfs          ftp1

(parted)


8.0.6 compile error:

drbd-8.0.6/drbd/drbd_main.c: In function 'is_valid_state_transition':
drbd-8.0.6/drbd/drbd_main.c:599: error: 'SS_NoNetConfig' undeclared
(first use in this function)
drbd-8.0.6/drbd/drbd_main.c:599: error: (Each undeclared identifier is
reported only once
drbd-8.0.6/drbd/drbd_main.c:599: error: for each function it appears
in.)

8.0.5 saying it is 8.0.4:

[drbd-8.0.5]$ strings drbd/drbd.ko | grep 8.0.4
version: 8.0.4 (api:%d/proto:%d)
<6>drbd: initialised. Version: 8.0.4 (api:%d/proto:%d)
description=drbd - Distributed Replicated Block Device v8.0.4