[DRBD-user] drbd Input/output error

[Dan Barker]

> -----Original Message-----
> From: drbd-user-bounces at lists.linbit.com [mailto:drbd-user-
> bounces at lists.linbit.com] On Behalf Of Piotr Kloc
> Sent: Friday, February 14, 2014 7:49 PM
> To: drbd-user at lists.linbit.com
> Subject: [DRBD-user] drbd Input/output error
> 
> Hello !
> I have problem with drbd
> 
> primary
> 
> [root at wirt ~]# cat /proc/drbd
> version: 8.3.13 (api:88/proto:86-96)
> GIT-hash: 83ca112086600faacab2f157bc5a9324f7bd7f77 build by root at sighted,
> 2012-10-09 12:47:51
> 
>  1: cs:StandAlone ro:Primary/Unknown ds:Diskless/DUnknown   r-----
>     ns:0 nr:72 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
> [root at wirt ~]#
> 
> and secondary
> 
> [root at wirt2 ~]# cat /proc/drbd
> version: 8.3.13 (api:88/proto:86-96)
> GIT-hash: 83ca112086600faacab2f157bc5a9324f7bd7f77 build by root at sighted,
> 2012-10-09 12:47:51
> 
>  1: cs:WFConnection ro:Secondary/Unknown ds:Diskless/DUnknown C r-----
>     ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
> [root at wirt2 ~]#
> 
> 
> 
> on primary i got
> 
> [root at wirt ~]# lvs
>   /dev/drbd1: read failed after 0 of 4096 at 1892425662464: Input/output
> error
>   /dev/drbd1: read failed after 0 of 4096 at 1892425728000: Input/output
> error
>   /dev/drbd1: read failed after 0 of 4096 at 0: Input/output error
>   /dev/drbd1: read failed after 0 of 4096 at 4096: Input/output error
>   LV   VG   Attr       LSize   Pool Origin Data%  Move Log Cpy%Sync
> Convert
>   root vg0  -wi-ao----  50.00g
>   swap vg0  -wi-ao----  16.00g
>   tmp  vg0  -wi-ao----  25.00g
>   vm1  vg1  -wi-ao----   1.17t
>   vm2  vg1  -wi-ao---- 400.00g
> 
> 
> I have LVM on DRBD and DRBD is on the /dev/md2 RAID1 system

No, drbd is not on anything: cs:StandAlone ro:Primary/Unknown ds:Diskless/DUnknown

You have not shown the resource definition files, so we can only guess. What has been done after / filled up? I would think at least freeing some space and a reboot, but you don't say.

> 
>  device minor 1;
>                 disk /dev/md2;
>                 address IP:7788;
>                 meta-disk internal;
> 
> 
> 
> There was  temporary out of space on / partition and then we got this
> errors
> 
> How we can fix this now ?
> Can I run fsck on  /dev/drbd1 ?

No, you can't do anything against a diskless resource.

> 
> 
> Piotr

The I/O errors are expected - drbd's devices are not present or not available. LVM may have grabbed them if your filters are not set up correctly. Again, please provide more doc. Output from mount, your drbd resource definition files and your LVM filters.

Dan