[DRBD-user] "attempt to access beyond end of device", but w/ lots of available space....

[Little, Kevin]

Hi, all.

I'm using 8.0.3 DRBD on a PPC platform, MontaVista 2.6.21_mvlcge500 base (ppc64).

I'm running into the "attempt to access beyond end of device" condition written up on the list, but it looks to me that I have over 500MB (26%) of the drbd partition still available, even after the copy would be complete.

I did the check of IMD space requirements as per the formula given by Lars, and it looks ok (see below).

Any insights?

Thanks in advance!

         -k

Version: 8.0.3 (api:86)
SVN Revision: 2881 build by build at node-44, 2008-04-03 21:30:55

## we're going to attempt to copy a 311MB file...

primarybox:/public/klittle# ls -lh /sw/bigfile
-rwxr-xr-x 1 root root 311M Mar  9  2009 /sw/bigfile

## target is /public/klittle; /public is mounted on device /dev/drbd3:

primarybox:/public/klittle# df .
Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/drbd3             1929068   1019452    811624  56% /public

## thus a copy of bigfile will take ~304000 1k-blocks.
## this should leave ~507600 blocks (26%) available after the copy is done.

## /public was a existing partition prior to being put under drbd;
## it was mounted on device /dev/sda7

primarybox:/public/klittle# grep -e drbd3 -e sda7 /proc/partitions
   8     7    1959898 sda7
 147     3    1959800 drbd3

primarybox:/public/klittle# drbdadm dump public
resource public {
    on slot8a {
        device           /dev/drbd3;
        disk             /dev/sda7;
        address          127.1.2.178:7791;
        meta-disk        internal;
    }
    on slot9a {
        device           /dev/drbd3;
        disk             /dev/sda7;
        address          127.1.2.176:7791;
        meta-disk        internal;
    }
    net {
        after-sb-0pri    disconnect;
        after-sb-1pri    discard-secondary;
        after-sb-2pri    disconnect;
    }
}

## check IMD space requirements:
##     1959898/(4*8*512*2)= 59.81134033203125
##     60 + 36= 96
##     1959898-96= 1959802 check!

## note: for logistical/development reasons, I have skipped /dev/drbd1:
primarybox:/public/klittle# ls -la /dev/drbd*
brw-r--r-- 1 root root 147, 0 Jan  1 12:00 /dev/drbd
brw-r--r-- 1 root root 147, 2 Jan  1 12:00 /dev/drbd2
brw-r--r-- 1 root root 147, 3 Jan  1 12:00 /dev/drbd3


## but, even with head-room of 500MB (26%)...

primarybox:/public/klittle# cp /sw/bigfile .
attempt to access beyond end of device
drbd3: rw=1, want=3919608, limit=3919600
Buffer I/O error on device drbd3, logical block 489950
lost page write due to I/O error on drbd3
attempt to access beyond end of device
drbd3: rw=1, want=3919616, limit=3919600
Buffer I/O error on device drbd3, logical block 489951
lost page write due to I/O error on drbd3
attempt to access beyond end of device
drbd3: rw=1, want=3919624, limit=3919600
Buffer I/O error on device drbd3, logical block 489952
lost page write due to I/O error on drbd3
...
attempt to access beyond end of device
drbd3: rw=1, want=3919688, limit=3919600
attempt to access beyond end of device
drbd3: rw=1, want=3919696, limit=3919600
...

primarybox:/public/klittle#
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linbit.com/pipermail/drbd-user/attachments/20090309/9be9afa8/attachment.htm>