Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.
On Mon, Jun 20, 2011 at 1:02 PM, Gianluca Cecchi
<gianluca.cecchi at gmail.com> wrote:
> After the r0 resource is syncronized and drbdsrv1 is Primary, issuing
> mkfs -t ext3 /dev/drbd0
> generates a panic on it and drbdsrv2 going to:
Tried basic config with
resource "r0" {
..
device minor 0;
disk /dev/vdb1;
meta-disk internal;
on drbdsrv1 {
address 10.4.5.167:7789;
}
on drbdsrv2 {
address 10.4.5.168:7789;
}
}
keeps getting panic; with the other node not connected I'm able to get
stack trace output on serial console.
See below.
Trace is the same with or without the volume tag used.
I re-created meta-data each time.
BTW: on the same node and the same config but using drbd83 as provided
by CentOS I'm able to format the file system without any panic (as
expected..)
[root at drbdsrv1 ~]# uname -r
2.6.18-238.12.1.el5
[root at drbdsrv1 ~]# cat /proc/drbd
version: 8.3.8 (api:88/proto:86-94)
GIT-hash: d78846e52224fd00562f7c225bcc25b2d422321d build by
mockbuild at builder10.centos.org, 2010-06-04 08:04:16
0: cs:WFConnection ro:Primary/Unknown ds:UpToDate/DUnknown C r----
ns:0 nr:0 dw:132620 dr:44 al:49 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b
oos:4194092
[root at drbdsrv1 ~]# rpm -qi drbd83
Name : drbd83 Relocations: (not relocatable)
Version : 8.3.8 Vendor: CentOS
Release : 1.el5.centos Build Date: Fri 04 Jun
2010 02:04:27 PM CEST
Install Date: Tue 21 Jun 2011 10:53:43 AM CEST Build Host:
builder10.centos.org
Group : System Environment/Kernel Source RPM:
drbd83-8.3.8-1.el5.centos.src.rpm
Size : 442168 License: GPL
Signature : DSA/SHA1, Tue 22 Jun 2010 01:33:52 PM CEST, Key ID
a8a447dce8562897
is there any interest in testing upcoming drbd 8.4 on RH EL 5 based
systems or am I pointing to the wrong mailing list?
Thanks,
Gianluca
here it is the output on serial console with stack trace:
SELinux: Disabled at runtime.
type=1404 audit(1308586927.897:2): selinux=0 auid=4294967295 ses=4294967295
INIT: version 2.86 booting
Welcome to CentOS release 5.6 (Final)
Press 'I' to enter interactive startup.
Setting clock (localtime): Mon Jun 20 18:22:07 CEST 2011 [ OK ]
Starting udev: [ OK ]
Loading default keymap (it): [ OK ]
Setting hostname drbdsrv1: [ OK ]
No devices found
failed to stat() /dev/mapper/no
failed to stat() /dev/mapper/block
failed to stat() /dev/mapper/devices
failed to stat() /dev/mapper/found
Setting up Logical Volume Management: 3 logical volume(s) in volume
group "VolGroup00" now active
[ OK ]
Checking filesystems
Checking all file systems.
[/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/vda2
/: clean, 13611/524288 files, 199188/524120 blocks
[/sbin/fsck.ext3 (1) -- /usr] fsck.ext3 -a /dev/VolGroup00/LV_usr
/dev/VolGroup00/LV_usr: recovering journal
/dev/VolGroup00/LV_usr: clean, 48967/786432 files, 312440/786432 blocks
[/sbin/fsck.ext3 (1) -- /var] fsck.ext3 -a /dev/VolGroup00/LV_var
/dev/VolGroup00/LV_var: recovering journal
/dev/VolGroup00/LV_var: clean, 1195/131072 files, 179945/524288 blocks
[/sbin/fsck.ext3 (1) -- /tmp] fsck.ext3 -a /dev/VolGroup00/LV_tmp
/dev/VolGroup00/LV_tmp: recovering journal
/dev/VolGroup00/LV_tmp: clean, 15/131072 files, 35318/524288 blocks
[/sbin/fsck.ext3 (1) -- /boot] fsck.ext3 -a /dev/vda1
/boot: recovering journal
/boot: clean, 41/128520 files, 38232/514048 blocks
[ OK ]
Remounting root filesystem in read-write mode: [ OK ]
Mounting local filesystems: [ OK ]
Enabling local filesystem quotas: [ OK ]
Enabling /etc/fstab swaps: [ OK ]
INIT: Entering runlevel: 3
Entering non-interactive startup
Starting sysstat: Calling the system activity data collector (sadc):
[ OK ]
Starting background readahead: [ OK ]
Bringing up loopback interface: [ OK ]
Bringing up interface eth0: [ OK ]
Starting system logger: [ OK ]
Starting kernel logger: [ OK ]
Starting irqbalance: [ OK ]
Starting portmap: [ OK ]
Starting NFS statd: [ OK ]
Starting RPC idmapd: [ OK ]
Starting system message bus: [ OK ]
Mounting other filesystems: [ OK ]
Starting acpi daemon: [ OK ]
Starting HAL daemon: [ OK ]
Starting monitoring for VG VolGroup00: 3 logical volume(s) in volume
group "VolGroup00" monitored
[ OK ]
Starting sshd: [ OK ]
Starting xinetd: [ OK ]
Starting sendmail: [ OK ]
Starting sm-client: [ OK ]
Starting console mouse services: [ OK ]
Starting crond: [ OK ]
Starting anacron: [ OK ]
[ OK ] atd: [ OK ]
Starting jexec: Starting jexec services[ OK ]
block drbd0: meta data flush failed with status -95, disabling md-flushes
block drbd1: meta data flush failed with status -95, disabling md-flushes
BUG: unable to handle kernel NULL pointer dereference at virtual
address 00000ae8
printing eip:
c04f09a0
*pde = 78757067
Oops: 0000 [#1]
SMP
last sysfs file: /block/drbd1/range
Modules linked in: drbd(U) lockd sunrpc dm_multipath scsi_dh video
backlight sbs power_meter hwmon i2c_ec dell_wmi wmi button battery
asus_acpi ac parport_pc lp parport floppy snd_hda_intel snd_seq_dummy
snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss
snd_mixer_oss snd_pcm snd_timer snd_page_alloc snd_hwdep snd i2c_piix4
i2c_core serio_raw soundcore pcspkr tpm_tis tpm tpm_bios virtio_net
ide_cd cdrom virtio_balloon dm_raid45 dm_message dm_region_hash
dm_mem_cache dm_snapshot dm_zero dm_mirror dm_log dm_mod ata_piix
libata sd_mod scsi_mod virtio_blk virtio_pci virtio_ring virtio ext3
jbd uhci_hcd ohci_hcd ehci_hcd
CPU: 0
EIP: 0060:[<c04f09a0>] Tainted: G S VLI
EFLAGS: 00010002 (2.6.18-238.12.1.el5 #1)
EIP is at rb_next+0x7/0x23
eax: f6e9d970 ebx: 00000ae0 ecx: f6e9d95c edx: 00000ae0
esi: f6e9d970 edi: f79ad124 ebp: 00000006 esp: c076ceb8
ds: 007b es: 007b ss: 0068
Process swapper (pid: 0, ti=c076c000 task=c068e3c0 task.ti=c0708000)
Stack: f8e64e39 f6e9d970 f79ad000 f6e9d95c f8e5278c c076cf14 00000000 00000000
f79ad000 00000086 c076cf14 00000017 f79ad000 f8e52c12 f6e9d95c f7f15bc0
c045c998 00000086 c076cf14 00000017 f6e9d95c f8e46c7f f79ad000 00000000
Call Trace:
[<f8e64e39>] drbd_remove_interval+0x29/0x8b [drbd]
[<f8e5278c>] _req_may_be_done+0xaf/0x402 [drbd]
[<f8e52c12>] __req_mod+0x11e/0xd81 [drbd]
[<c045c998>] mempool_free+0x5f/0x63
[<f8e46c7f>] drbd_request_endio+0xa8/0xd6 [drbd]
[<f8e46bd7>] drbd_request_endio+0x0/0xd6 [drbd]
[<c047c0d9>] bio_endio+0x50/0x55
[<c04e1ea6>] __end_that_request_first+0x219/0x511
[<f883b416>] vring_get_buf+0xab/0xc1 [virtio_ring]
[<f884429b>] blk_done+0x43/0x98 [virtio_blk]
[<f883b0bc>] vring_interrupt+0x24/0x2f [virtio_ring]
[<f881616b>] vp_interrupt+0x6a/0xa7 [virtio_pci]
[<c044fed5>] handle_IRQ_event+0x45/0x8c
[<c044ffa0>] __do_IRQ+0x84/0xd6
[<c044ff1c>] __do_IRQ+0x0/0xd6
[<c04074d6>] do_IRQ+0x99/0xc3
[<c040597a>] common_interrupt+0x1a/0x20
[<c0403c1a>] default_idle+0x0/0x59
[<c0403c4b>] default_idle+0x31/0x59
[<c0403d12>] cpu_idle+0x9f/0xb9
[<c070d9fa>] start_kernel+0x37b/0x383
=======================
Code: 8b 00 85 c0 74 0b 8b 50 08 85 d2 74 04 89 d0 eb f5 c3 8b 00 85
c0 74 0b 8b 50 04 85 d2 74 04 89 d0 eb f5 c3 8b 50 04 85 d2 74 0d <8b>
42 08 85 c0 74 12 89 c2 eb f5 89 d0 8b 10 83 e2 fc 74 05 3b
EIP: [<c04f09a0>] rb_next+0x7/0x23 SS:ESP 0068:c076ceb8
<0>Kernel panic - not syncing: Fatal exception in interrupt
WARNING: at kernel/panic.c:137 panic()
[<c042557c>] panic+0x147/0x15b
[<c040650c>] die+0x240/0x274
[<c0622310>] do_page_fault+0x41a/0x52d
[<c041ef4e>] __activate_task+0x4a/0x59
[<c0621ef6>] do_page_fault+0x0/0x52d
[<c0405abd>] error_code+0x39/0x40
[<c04f09a0>] rb_next+0x7/0x23
[<f8e64e39>] drbd_remove_interval+0x29/0x8b [drbd]
[<f8e5278c>] _req_may_be_done+0xaf/0x402 [drbd]
[<f8e52c12>] __req_mod+0x11e/0xd81 [drbd]
[<c045c998>] mempool_free+0x5f/0x63
[<f8e46c7f>] drbd_request_endio+0xa8/0xd6 [drbd]
[<f8e46bd7>] drbd_request_endio+0x0/0xd6 [drbd]
[<c047c0d9>] bio_endio+0x50/0x55
[<c04e1ea6>] __end_that_request_first+0x219/0x511
[<f883b416>] vring_get_buf+0xab/0xc1 [virtio_ring]
[<f884429b>] blk_done+0x43/0x98 [virtio_blk]
[<f883b0bc>] vring_interrupt+0x24/0x2f [virtio_ring]
[<f881616b>] vp_interrupt+0x6a/0xa7 [virtio_pci]
[<c044fed5>] handle_IRQ_event+0x45/0x8c
[<c044ffa0>] __do_IRQ+0x84/0xd6
[<c044ff1c>] __do_IRQ+0x0/0xd6
[<c04074d6>] do_IRQ+0x99/0xc3
[<c040597a>] common_interrupt+0x1a/0x20
[<c0403c1a>] default_idle+0x0/0x59
[<c0403c4b>] default_idle+0x31/0x59
[<c0403d12>] cpu_idle+0x9f/0xb9
[<c070d9fa>] start_kernel+0x37b/0x383
=======================
WARNING: at drivers/input/serio/i8042.c:846 i8042_panic_blink()
[<c059fda8>] i8042_panic_blink+0xce/0x206
[<c042553e>] panic+0x109/0x15b
[<c040650c>] die+0x240/0x274
[<c0622310>] do_page_fault+0x41a/0x52d
[<c041ef4e>] __activate_task+0x4a/0x59
[<c0621ef6>] do_page_fault+0x0/0x52d
[<c0405abd>] error_code+0x39/0x40
[<c04f09a0>] rb_next+0x7/0x23
[<f8e64e39>] drbd_remove_interval+0x29/0x8b [drbd]
[<f8e5278c>] _req_may_be_done+0xaf/0x402 [drbd]
[<f8e52c12>] __req_mod+0x11e/0xd81 [drbd]
[<c045c998>] mempool_free+0x5f/0x63
[<f8e46c7f>] drbd_request_endio+0xa8/0xd6 [drbd]
[<f8e46bd7>] drbd_request_endio+0x0/0xd6 [drbd]
[<c047c0d9>] bio_endio+0x50/0x55
[<c04e1ea6>] __end_that_request_first+0x219/0x511
[<f883b416>] vring_get_buf+0xab/0xc1 [virtio_ring]
[<f884429b>] blk_done+0x43/0x98 [virtio_blk]
[<f883b0bc>] vring_interrupt+0x24/0x2f [virtio_ring]
[<f881616b>] vp_interrupt+0x6a/0xa7 [virtio_pci]
[<c044fed5>] handle_IRQ_event+0x45/0x8c
[<c044ffa0>] __do_IRQ+0x84/0xd6
[<c044ff1c>] __do_IRQ+0x0/0xd6
[<c04074d6>] do_IRQ+0x99/0xc3
[<c040597a>] common_interrupt+0x1a/0x20
[<c0403c1a>] default_idle+0x0/0x59
[<c0403c4b>] default_idle+0x31/0x59
[<c0403d12>] cpu_idle+0x9f/0xb9
[<c070d9fa>] start_kernel+0x37b/0x383
=======================
WARNING: at drivers/input/serio/i8042.c:849 i8042_panic_blink()
[<c059fe5a>] i8042_panic_blink+0x180/0x206
[<c042553e>] panic+0x109/0x15b
[<c040650c>] die+0x240/0x274
[<c0622310>] do_page_fault+0x41a/0x52d
[<c041ef4e>] __activate_task+0x4a/0x59
[<c0621ef6>] do_page_fault+0x0/0x52d
[<c0405abd>] error_code+0x39/0x40
[<c04f09a0>] rb_next+0x7/0x23
[<f8e64e39>] drbd_remove_interval+0x29/0x8b [drbd]
[<f8e5278c>] _req_may_be_done+0xaf/0x402 [drbd]
[<f8e52c12>] __req_mod+0x11e/0xd81 [drbd]
[<c045c998>] mempool_free+0x5f/0x63
[<f8e46c7f>] drbd_request_endio+0xa8/0xd6 [drbd]
[<f8e46bd7>] drbd_request_endio+0x0/0xd6 [drbd]
[<c047c0d9>] bio_endio+0x50/0x55
[<c04e1ea6>] __end_that_request_first+0x219/0x511
[<f883b416>] vring_get_buf+0xab/0xc1 [virtio_ring]
[<f884429b>] blk_done+0x43/0x98 [virtio_blk]
[<f883b0bc>] vring_interrupt+0x24/0x2f [virtio_ring]
[<f881616b>] vp_interrupt+0x6a/0xa7 [virtio_pci]
[<c044fed5>] handle_IRQ_event+0x45/0x8c
[<c044ffa0>] __do_IRQ+0x84/0xd6
[<c044ff1c>] __do_IRQ+0x0/0xd6
[<c04074d6>] do_IRQ+0x99/0xc3
[<c040597a>] common_interrupt+0x1a/0x20
[<c0403c1a>] default_idle+0x0/0x59
[<c0403c4b>] default_idle+0x31/0x59
[<c0403d12>] cpu_idle+0x9f/0xb9
[<c070d9fa>] start_kernel+0x37b/0x383
=======================
WARNING: at drivers/input/serio/i8042.c:851 i8042_panic_blink()
[<c059feb7>] i8042_panic_blink+0x1dd/0x206
[<c042553e>] panic+0x109/0x15b
[<c040650c>] die+0x240/0x274
[<c0622310>] do_page_fault+0x41a/0x52d
[<c041ef4e>] __activate_task+0x4a/0x59
[<c0621ef6>] do_page_fault+0x0/0x52d
[<c0405abd>] error_code+0x39/0x40
[<c04f09a0>] rb_next+0x7/0x23
[<f8e64e39>] drbd_remove_interval+0x29/0x8b [drbd]
[<f8e5278c>] _req_may_be_done+0xaf/0x402 [drbd]
[<f8e52c12>] __req_mod+0x11e/0xd81 [drbd]
[<c045c998>] mempool_free+0x5f/0x63
[<f8e46c7f>] drbd_request_endio+0xa8/0xd6 [drbd]
[<f8e46bd7>] drbd_request_endio+0x0/0xd6 [drbd]
[<c047c0d9>] bio_endio+0x50/0x55
[<c04e1ea6>] __end_that_request_first+0x219/0x511
[<f883b416>] vring_get_buf+0xab/0xc1 [virtio_ring]
[<f884429b>] blk_done+0x43/0x98 [virtio_blk]
[<f883b0bc>] vring_interrupt+0x24/0x2f [virtio_ring]
[<f881616b>] vp_interrupt+0x6a/0xa7 [virtio_pci]
[<c044fed5>] handle_IRQ_event+0x45/0x8c
[<c044ffa0>] __do_IRQ+0x84/0xd6
[<c044ff1c>] __do_IRQ+0x0/0xd6
[<c04074d6>] do_IRQ+0x99/0xc3
[<c040597a>] common_interrupt+0x1a/0x20
[<c0403c1a>] default_idle+0x0/0x59
[<c0403c4b>] default_idle+0x31/0x59
[<c0403d12>] cpu_idle+0x9f/0xb9
[<c070d9fa>] start_kernel+0x37b/0x383
=======================