Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.
Hi everybody,
first things first:
2X dual Xeon connected via Gbe (Intel), each 1Gig Ram, Highmem supp. off,
Kernel 2.6.12.2, Raid 10 on 3ware S-ATA controllers.
I got a nice little problem which I think is a bit uncommon. I've been using
drbd for a while now with reiserfs on top. Yesterday the filesystem suddenly
went crazy:
Aug 3 09:17:11 test1 kernel: ReiserFS: drbd0: warning: vs-4080:
reiserfs_free_block: free_block (drbd0:32939)[dev:blocknr]: bit already
cleared
Aug 3 09:17:24 test1 kernel: ReiserFS: warning: is_tree_node: node level 1
does not match to the expected one 2
Aug 3 09:17:24 test1 kernel: ReiserFS: drbd0: warning: vs-5150:
search_by_key: invalid format found in block 32870. Fsck?
Aug 3 09:17:24 test1 kernel: ReiserFS: drbd0: warning: vs-13050:
reiserfs_update_sd: i/o failure occurred trying to update [2 2019235 0x0 SD]
stat data
After this the machine locked up. Fscking it didn't help. Now I thougt I'd try
Ext3 and see how it performs. Mkfs stuck. Now I tried to invalidate my one
and only resource r0:
Machine1:
version: 0.7.11 (api:77/proto:74)
SVN Revision: 1799 build by pete at test1, 2005-08-03 18:24:38
0: cs:Connected st:Primary/Secondary ld:Consistent
ns:7451187 nr:0 dw:6398519 dr:1651619 al:3082 bm:981 lo:0 pe:0 ua:0 ap:0
drbdadm invalidate r0
ioctl(,INVALIDATE,) failed: Operation now in progress
Only in 'Connected' cstate possible.
Command '/sbin/drbdsetup /dev/drbd0 invalidate' terminated with exit code 20
drbdadm aborting
Machine2:
version: 0.7.11 (api:77/proto:74)
SVN Revision: 1799 build by pete at test2, 2005-07-14 13:14:36
0: cs:Connected st:Secondary/Primary ld:Consistent
ns:0 nr:572548 dw:572548 dr:0 al:0 bm:281 lo:0 pe:0 ua:0 ap:0
Hmm, both say they're connected, still I cannot invalidate r0. Lets make the
primary secondary and vice versa:
Machine1:
drbdadm secondary r0
cat /proc/drbd
version: 0.7.11 (api:77/proto:74)
SVN Revision: 1799 build by pete at test1, 2005-08-03 18:24:38
0: cs:Connected st:Secondary/Secondary ld:Consistent
ns:7451187 nr:0 dw:6398519 dr:1651619 al:3082 bm:1238 lo:0 pe:0 ua:0 ap:0
drbd0: Primary/Secondary --> Secondary/Secondary
Machine2:
drbdadm primary r0
cat /proc/drbd
version: 0.7.11 (api:77/proto:74)
SVN Revision: 1799 build by pete at test2, 2005-07-14 13:14:36
0: cs:Connected st:Primary/Secondary ld:Consistent
ns:0 nr:572548 dw:572548 dr:0 al:0 bm:281 lo:0 pe:0 ua:0 ap:0
drbd0: Secondary/Secondary --> Primary/Secondary
drbdadm invalidate r0
ioctl(,INVALIDATE,) failed: Operation now in progress
Only in 'Connected' cstate possible.
Command '/sbin/drbdsetup /dev/drbd0 invalidate' terminated with exit code 20
drbdadm aborting
Any ideas ?
BTW I would be interested in experiences regarding the filesystem of your
choice- I didn't choose ext3 due to aspects of performance and fscking. I had
some lockups with XFS. Reiser went well until yesterday although I bonnied
pretty much on it.
Regards
Stephan