Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.
Hi, i have some problems with drbd 0.7-pre8 under SuSE Linux Enterprise Server 8 with SP3 (kernel 2.4.21). After solving the compiling issues, "modprobing" drbd module runs fine. But every time drbd tries to sync data, i become a kernel oops. After starting the drbd service script, the oops appear on booth sides. I have to reboot the nodes (only virtual machines in a VMWARE-GSX-Server cluster, based on SLES-8 SP2 and drbd 6.10, funny, isn't it?), "rmmoding" doesn't function. Here the data from the two nodes. The nodes are connected via interconnects (eth1, eth2). eth0 is the public interface. The kernel oops are decoded via ksymoops. I hope the data are sufficient. Perhaps someone can help me, please. So long Michael ----------------------------------- ------cut-NODE A: scl01v20--- ----------------------------------- scl01v20:~ # lsmod Module Size Used by Not tainted st 27460 0 (autoclean) (unused) sr_mod 14072 0 (autoclean) (unused) cdrom 26336 0 (autoclean) [sr_mod] sg 32416 0 (autoclean) isa-pnp 31068 0 (unused) pcnet32 14144 3 (autoclean) mii 2384 0 (autoclean) [pcnet32] lvm-mod 63584 1 (autoclean) reiserfs 204212 1 BusLogic 89724 3 sd_mod 12928 6 scsi_mod 97228 5 [st sr_mod sg BusLogic sd_mod] scl01v20:~ # date Mon Jun 28 18:50:19 CEST 2004 scl01v20:~ # uname -a Linux scl01v20 2.4.21-215-default #1 Tue Apr 27 16:17:49 UTC 2004 i686 unknown scl01v20:~ # /etc/rc.d/drbd start Starting DRBD resources: ioctl(,SET_DISK_CONFIG,) failed: Device or resource busy Command line was '/sbin/drbdsetup /dev/nb0 disk /dev/data/lvt01 /dev/data/meta01 0' drbdsetup exited with code 20 Failed setting up drbd0 scl01v20:~ # /etc/rc.d/drbd start Starting DRBD resources: [drbd0] Waiting until resources are connected (or timeouted)ioctl(,WAIT_*,) failed: Timer expired drbdsetup exited with code 20 . scl01v20:~ # scl01v20:~ # lsmod Module Size Used by Not tainted drbd 118468 1 st 27460 0 (autoclean) (unused) sr_mod 14072 0 (autoclean) (unused) cdrom 26336 0 (autoclean) [sr_mod] sg 32416 0 (autoclean) isa-pnp 31068 0 (unused) pcnet32 14144 3 (autoclean) mii 2384 0 (autoclean) [pcnet32] lvm-mod 63584 9 (autoclean) reiserfs 204212 1 BusLogic 89724 3 sd_mod 12928 6 scsi_mod 97228 5 [st sr_mod sg BusLogic sd_mod] scl01v20:~ # cat /proc/drbd version: 0.7-pre8 (api:74/proto:72) 0: cs:WFConnection st:Secondary/Unknown ld:Consistent ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 1: cs:Unconfigured 2: cs:Unconfigured 3: cs:Unconfigured 4: cs:Unconfigured 5: cs:Unconfigured 6: cs:Unconfigured 7: cs:Unconfigured 8: cs:Unconfigured 9: cs:Unconfigured 10: cs:Unconfigured 11: cs:Unconfigured 12: cs:Unconfigured 13: cs:Unconfigured 14: cs:Unconfigured 15: cs:Unconfigured 16: cs:Unconfigured 17: cs:Unconfigured 18: cs:Unconfigured 19: cs:Unconfigured 20: cs:Unconfigured 21: cs:Unconfigured 22: cs:Unconfigured 23: cs:Unconfigured 24: cs:Unconfigured 25: cs:Unconfigured 26: cs:Unconfigured 27: cs:Unconfigured 28: cs:Unconfigured 29: cs:Unconfigured 30: cs:Unconfigured 31: cs:Unconfigured scl01v20:~ # scl01v20:~ # cat /proc/drbd version: 0.7-pre8 (api:74/proto:72) 0: cs:SyncSource st:Secondary/Secondary ld:Consistent ns:0 nr:0 dw:0 dr:6688 al:0 bm:0 lo:0 pe:52 ua:32 ap:0 [>...................] sync'ed: 4.6% (132908/139264)K finish: 0:44:18 speed: 45 (353) K/sec 1: cs:Unconfigured 2: cs:Unconfigured 3: cs:Unconfigured 4: cs:Unconfigured 5: cs:Unconfigured 6: cs:Unconfigured 7: cs:Unconfigured 8: cs:Unconfigured 9: cs:Unconfigured 10: cs:Unconfigured 11: cs:Unconfigured 12: cs:Unconfigured 13: cs:Unconfigured 14: cs:Unconfigured 15: cs:Unconfigured 16: cs:Unconfigured 17: cs:Unconfigured 18: cs:Unconfigured 19: cs:Unconfigured 20: cs:Unconfigured 21: cs:Unconfigured 22: cs:Unconfigured 23: cs:Unconfigured 24: cs:Unconfigured 25: cs:Unconfigured 26: cs:Unconfigured 27: cs:Unconfigured 28: cs:Unconfigured 29: cs:Unconfigured 30: cs:Unconfigured 31: cs:Unconfigured scl01v20:~ # drbdsetup /dev/nb0 show Lower device: 58:01 (lvm(58,1)) Meta device: 58:02 (lvm(58,2)) Meta index: 0 Disk options: Local address: 192.168.85.1:14000 Remote address: 192.168.85.2:14000 Wire protocol: C Net options: timeout = 6.0 sec (default) connect-int = 10 sec (default) ping-int = 10 sec (default) max-epoch-size = 2048 (default) max-buffers = 2048 (default) sndbuf-size = 131070 (default) ko-count = 0 (default) Syncer options: rate = 600 KB/sec group = 1 al-extents = 257 scl01v20:~ # scl01v20:~ # scl01v20:~ # lvscan lvscan -- ACTIVE "/dev/data/lv01" [1000 MB] lvscan -- ACTIVE "/dev/data/lvt01" [200 MB] lvscan -- ACTIVE "/dev/data/meta01" [152 MB] lvscan -- 3 logical volumes with 1.32 GB total in 1 volume group lvscan -- 3 active logical volumes scl01v20:~ # cat /etc/drbd.conf # # drbd.conf example # # parameters you _need_ to change are the hostname, device, disk, # address and port in the "on <hostname> {}" sections, as well as # the disk-size. # # you ought to know about the protocol, inittimeout, # skip-wait and load-only; and the fsckcmd. # # you probably want to set the sync-min/-max, and maybe -nice. # # Common Trouble: # increase the tl-size if you encounter "tl-size too small!!". # # increase timeout and maybe ping-int in net{}, if you see # problems with "connection lost/connection enabled" # (or change your setup to reduce network latency; make sure full # duplex behaves as such; check average roundtrip times while # network is saturated ...) # global { # use this if you want to define more resources later # without reloading the module. # by default we load the module with exactly as many devices # as configured mentioned in this file. # minor_count=5 # this is for people who set up a drbd device via the # loopback network interface or between two VMs on the same # box, for testing/simulating/presentation # otherwise it could trigger a run_tasq_queue deadlock. # I'm not sure whether this deadlock can happen with two # nodes, but it seems at least extremly unlikely; and since # the io_hints boost performance, keep them enabled. # disable_io_hints minor_count 32; } # # this need not be drbd#, you may use phony resource names, # like "resource web" or "resource mail", too # resource drbd0 { protocol C; startup { wfc-timeout 5; degr-wfc-timeout 120; } syncer { rate 600k; group 1; al-extents 257; } on scl01v20 { device /dev/nb0; disk /dev/data/lvt01; meta-disk /dev/data/meta01[0]; address 192.168.85.1:14000; } on scl01v21 { device /dev/nb0; disk /dev/data/lvt01; meta-disk /dev/data/meta01[0]; address 192.168.85.2:14000; } } scl01v20:~ # ifconfig eth0 Link encap:Ethernet HWaddr 00:50:56:45:02:B8 inet addr:172.16.20.120 Bcast:172.16.255.255 Mask:255.255.0.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:2833 errors:0 dropped:0 overruns:0 frame:0 TX packets:814 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:100 RX bytes:237718 (232.1 Kb) TX bytes:111468 (108.8 Kb) Interrupt:9 Base address:0x10c0 eth1 Link encap:Ethernet HWaddr 00:50:56:45:02:B9 inet addr:192.168.85.1 Bcast:192.168.85.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:5092 errors:0 dropped:0 overruns:0 frame:0 TX packets:5356 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:100 RX bytes:469274 (458.2 Kb) TX bytes:7035892 (6.7 Mb) Interrupt:10 Base address:0x10e0 eth2 Link encap:Ethernet HWaddr 00:50:56:45:02:BA inet addr:192.168.86.1 Bcast:192.168.86.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:34 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:100 RX bytes:5370 (5.2 Kb) TX bytes:0 (0.0 b) Interrupt:9 Base address:0x1400 lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) scl01v20:~ # --------------------- ------ OOPS ------- --------------------- scl01v20:~ # tail -f /var/log/messages|ksymoops ksymoops 2.4.5 on i686 2.4.21-215-default. Options used -V (default) -k /proc/ksyms (default) -l /proc/modules (default) -o /lib/modules/2.4.21-215-default/ (default) -m /boot/System.map-2.4.21-215-default (default) Warning: You did not tell me where to find symbol information. I will assume that the log matches the kernel and modules that are running right now and I'll use the default options above for symbol resolution. If the current kernel and/or modules do not match the log, you can get more accurate output by telling me the kernel version and where to find map, modules, ksyms etc. ksymoops -h explains the options. Jun 28 18:52:21 scl01v20 kernel: Unable to handle kernel NULL pointer dereference at virtual address 00000004 Jun 28 18:52:21 scl01v20 kernel: c8a481cf Jun 28 18:52:21 scl01v20 kernel: *pde = 00000000 Jun 28 18:52:21 scl01v20 kernel: Oops: 0002 2.4.21-215-default #1 Tue Apr 27 16:17:49 UTC 2004 Jun 28 18:52:21 scl01v20 kernel: CPU: 0 Jun 28 18:52:21 scl01v20 kernel: EIP: 0010: [lvm-mod:__insmod_lvm-mod_O/lib/modules/2.4.21-215-default/kernel/dr+-86081073/96] Not tainted Jun 28 18:52:21 scl01v20 kernel: EIP: 0010:[<c8a481cf>] Not tainted Using defaults from ksymoops -t elf32-i386 -a i386 Jun 28 18:52:21 scl01v20 kernel: EFLAGS: 00000086 Jun 28 18:52:21 scl01v20 kernel: eax: c8da1f6c ebx: c8da1f64 ecx: 00000000 edx: 00000000 Jun 28 18:52:21 scl01v20 kernel: esi: 00000086 edi: c8a20428 ebp: c8da1f64 esp: c8da1f28 Jun 28 18:52:21 scl01v20 kernel: ds: 0018 es: 0018 ss: 0018 Jun 28 18:52:21 scl01v20 kernel: Process drbd0_receiver (pid: 1275, stackpage=c8da1000) Jun 28 18:52:21 scl01v20 kernel: Stack: c8a20000 c8a20468 c8a4832a c8a20468 c8da1f64 c8da0000 c8a48976 00000000 Jun 28 18:52:21 scl01v20 kernel: c8da0000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 Jun 28 18:52:21 scl01v20 kernel: c8da0000 00000000 00000000 00000000 00000000 c8a201d0 c8a20000 c8a201d0 Jun 28 18:52:21 scl01v20 kernel: Call Trace: [lvm-mod:__insmod_lvm-mod_O/lib/modules/2.4.21-215-default/kernel/dr+-86080726/96] (16) [lvm-mod:__insmod_lvm-mod_O/lib/modules/2.4.21-215-default/kernel/dr+-86079114/96] (84) [lvm-mod:__insmod_lvm-mod_O/lib/modules/2.4.21-215-default/kernel/dr+-86072400/96] (32) Jun 28 18:52:21 scl01v20 kernel: Call Trace: [<c8a4832a>] (16) [<c8a48976>] (84) [<c8a4a3b0>] (32) Jun 28 18:52:21 scl01v20 kernel: [<c8a4b983>] (20) [<c8a4c13f>] (20) [<c8a51994>] (20) [<c0107486>] (08) Jun 28 18:52:21 scl01v20 kernel: [<c8a51920>] (04) Jun 28 18:52:21 scl01v20 kernel: Code: 89 4a 04 89 11 89 40 04 89 43 08 56 9d 5b 5e c3 90 55 57 56 >>EIP; c8a481cf <[sr_mod]sr_registered+1290adb/64a896c> <===== >>eax; c8da1f6c <[sr_mod]sr_registered+15ea878/64a896c> >>ebx; c8da1f64 <[sr_mod]sr_registered+15ea870/64a896c> >>edi; c8a20428 <[sr_mod]sr_registered+1268d34/64a896c> >>ebp; c8da1f64 <[sr_mod]sr_registered+15ea870/64a896c> >>esp; c8da1f28 <[sr_mod]sr_registered+15ea834/64a896c> Trace; c8a4832a <[sr_mod]sr_registered+1290c36/64a896c> Trace; c8a48976 <[sr_mod]sr_registered+1291282/64a896c> Trace; c8a4a3b0 <[sr_mod]sr_registered+1292cbc/64a896c> Trace; c8a4b983 <[sr_mod]sr_registered+129428f/64a896c> Trace; c8a4c13f <[sr_mod]sr_registered+1294a4b/64a896c> Trace; c8a51994 <[sr_mod]sr_registered+129a2a0/64a896c> Trace; c0107486 <arch_kernel_thread+26/30> Trace; c8a51920 <[sr_mod]sr_registered+129a22c/64a896c> Code; c8a481cf <[sr_mod]sr_registered+1290adb/64a896c> 00000000 <_EIP>: Code; c8a481cf <[sr_mod]sr_registered+1290adb/64a896c> <===== 0: 89 4a 04 mov %ecx,0x4(%edx) <===== Code; c8a481d2 <[sr_mod]sr_registered+1290ade/64a896c> 3: 89 11 mov %edx,(%ecx) Code; c8a481d4 <[sr_mod]sr_registered+1290ae0/64a896c> 5: 89 40 04 mov %eax,0x4(%eax) Code; c8a481d7 <[sr_mod]sr_registered+1290ae3/64a896c> 8: 89 43 08 mov %eax,0x8(%ebx) Code; c8a481da <[sr_mod]sr_registered+1290ae6/64a896c> b: 56 push %esi Code; c8a481db <[sr_mod]sr_registered+1290ae7/64a896c> c: 9d popf Code; c8a481dc <[sr_mod]sr_registered+1290ae8/64a896c> d: 5b pop %ebx Code; c8a481dd <[sr_mod]sr_registered+1290ae9/64a896c> e: 5e pop %esi Code; c8a481de <[sr_mod]sr_registered+1290aea/64a896c> f: c3 ret Code; c8a481df <[sr_mod]sr_registered+1290aeb/64a896c> 10: 90 nop Code; c8a481e0 <[sr_mod]sr_registered+1290aec/64a896c> 11: 55 push %ebp Code; c8a481e1 <[sr_mod]sr_registered+1290aed/64a896c> 12: 57 push %edi Code; c8a481e2 <[sr_mod]sr_registered+1290aee/64a896c> 13: 56 push %esi ----------------------------------- ------cut-NODE A: scl01v21--- ----------------------------------- scl01v21:~ # lsmod Module Size Used by Not tainted st 27460 0 (autoclean) (unused) sr_mod 14072 0 (autoclean) (unused) sg 32416 0 (autoclean) isa-pnp 31068 0 (unused) pcnet32 14144 3 (autoclean) mii 2384 0 (autoclean) [pcnet32] ide-cd 30208 0 (autoclean) cdrom 26336 0 (autoclean) [sr_mod ide-cd] lvm-mod 63584 1 (autoclean) reiserfs 204212 1 BusLogic 89724 3 sd_mod 12928 6 scsi_mod 97228 5 [st sr_mod sg BusLogic sd_mod] scl01v21:~ # date Mon Jun 28 18:50:30 CEST 2004 scl01v21:~ # uname -a Linux scl01v21 2.4.21-215-default #1 Tue Apr 27 16:17:49 UTC 2004 i686 unknown scl01v21:~ # /etc/rc.d/drbd start Starting DRBD resources: ioctl(,SET_DISK_CONFIG,) failed: Device or resource busy Command line was '/sbin/drbdsetup /dev/nb0 disk /dev/data/lvt01 /dev/data/meta01 0' drbdsetup exited with code 20 Failed setting up drbd0 scl01v21:~ # /etc/rc.d/drbd start Starting DRBD resources: [drbd0] Waiting until resources are connected (or timeouted). scl01v21:~ # cat /proc/drbd version: 0.7-pre8 (api:74/proto:72) 0: cs:SyncTarget st:Secondary/Secondary ld:Inconsistent ns:0 nr:6356 dw:6356 dr:0 al:0 bm:0 lo:0 pe:361 ua:0 ap:0 [>...................] sync'ed: 4.6% (132908/139264)K finish: 0:11:04 speed: 190 (529) K/sec 1: cs:Unconfigured 2: cs:Unconfigured 3: cs:Unconfigured 4: cs:Unconfigured 5: cs:Unconfigured 6: cs:Unconfigured 7: cs:Unconfigured 8: cs:Unconfigured 9: cs:Unconfigured 10: cs:Unconfigured 11: cs:Unconfigured 12: cs:Unconfigured 13: cs:Unconfigured 14: cs:Unconfigured 15: cs:Unconfigured 16: cs:Unconfigured 17: cs:Unconfigured 18: cs:Unconfigured 19: cs:Unconfigured 20: cs:Unconfigured 21: cs:Unconfigured 22: cs:Unconfigured 23: cs:Unconfigured 24: cs:Unconfigured 25: cs:Unconfigured 26: cs:Unconfigured 27: cs:Unconfigured 28: cs:Unconfigured 29: cs:Unconfigured 30: cs:Unconfigured 31: cs:Unconfigured scl01v21:~ # cat /proc/drbd version: 0.7-pre8 (api:74/proto:72) 0: cs:SyncTarget st:Secondary/Secondary ld:Inconsistent ns:0 nr:6356 dw:6356 dr:0 al:0 bm:0 lo:0 pe:1201 ua:0 ap:0 [>...................] sync'ed: 4.6% (132908/139264)K finish: 1:11:59 speed: 29 (276) K/sec 1: cs:Unconfigured 2: cs:Unconfigured 3: cs:Unconfigured 4: cs:Unconfigured 5: cs:Unconfigured 6: cs:Unconfigured 7: cs:Unconfigured 8: cs:Unconfigured 9: cs:Unconfigured 10: cs:Unconfigured 11: cs:Unconfigured 12: cs:Unconfigured 13: cs:Unconfigured 14: cs:Unconfigured 15: cs:Unconfigured 16: cs:Unconfigured 17: cs:Unconfigured 18: cs:Unconfigured 19: cs:Unconfigured 20: cs:Unconfigured 21: cs:Unconfigured 22: cs:Unconfigured 23: cs:Unconfigured 24: cs:Unconfigured 25: cs:Unconfigured 26: cs:Unconfigured 27: cs:Unconfigured 28: cs:Unconfigured 29: cs:Unconfigured 30: cs:Unconfigured 31: cs:Unconfigured scl01v21:~ # drbdsetup /dev/nb0 show Lower device: 58:01 (lvm(58,1)) Meta device: 58:02 (lvm(58,2)) Meta index: 0 Disk options: Local address: 192.168.85.2:14000 Remote address: 192.168.85.1:14000 Wire protocol: C Net options: timeout = 6.0 sec (default) connect-int = 10 sec (default) ping-int = 10 sec (default) max-epoch-size = 2048 (default) max-buffers = 2048 (default) sndbuf-size = 131070 (default) ko-count = 0 (default) Syncer options: rate = 600 KB/sec group = 1 al-extents = 257 scl01v21:~ # lvscan lvscan -- ACTIVE "/dev/data/lv1" [1000 MB] lvscan -- ACTIVE "/dev/data/lvt01" [200 MB] lvscan -- ACTIVE "/dev/data/meta01" [152 MB] lvscan -- 3 logical volumes with 1.32 GB total in 1 volume group lvscan -- 3 active logical volumes scl01v21:~ # scl01v21:~ # scl01v21:~ # cat /etc/drbd.conf # # drbd.conf example # # parameters you _need_ to change are the hostname, device, disk, # address and port in the "on <hostname> {}" sections, as well as # the disk-size. # # you ought to know about the protocol, inittimeout, # skip-wait and load-only; and the fsckcmd. # # you probably want to set the sync-min/-max, and maybe -nice. # # Common Trouble: # increase the tl-size if you encounter "tl-size too small!!". # # increase timeout and maybe ping-int in net{}, if you see # problems with "connection lost/connection enabled" # (or change your setup to reduce network latency; make sure full # duplex behaves as such; check average roundtrip times while # network is saturated ...) # global { # use this if you want to define more resources later # without reloading the module. # by default we load the module with exactly as many devices # as configured mentioned in this file. # minor_count=5 # this is for people who set up a drbd device via the # loopback network interface or between two VMs on the same # box, for testing/simulating/presentation # otherwise it could trigger a run_tasq_queue deadlock. # I'm not sure whether this deadlock can happen with two # nodes, but it seems at least extremly unlikely; and since # the io_hints boost performance, keep them enabled. # disable_io_hints minor_count 32; } # # this need not be drbd#, you may use phony resource names, # like "resource web" or "resource mail", too # resource drbd0 { protocol C; startup { wfc-timeout 5; degr-wfc-timeout 120; } syncer { rate 600k; group 1; al-extents 257; } on scl01v20 { device /dev/nb0; disk /dev/data/lvt01; meta-disk /dev/data/meta01[0]; address 192.168.85.1:14000; } on scl01v21 { device /dev/nb0; disk /dev/data/lvt01; meta-disk /dev/data/meta01[0]; address 192.168.85.2:14000; } } scl01v21:~ # ifconfig eth0 Link encap:Ethernet HWaddr 00:50:56:45:02:BB inet addr:172.16.20.121 Bcast:172.16.255.255 Mask:255.255.0.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:2919 errors:0 dropped:0 overruns:0 frame:0 TX packets:1215 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:100 RX bytes:254695 (248.7 Kb) TX bytes:194970 (190.4 Kb) Interrupt:9 Base address:0x10c0 eth1 Link encap:Ethernet HWaddr 00:50:56:45:02:BC inet addr:192.168.85.2 Bcast:192.168.85.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:5360 errors:0 dropped:0 overruns:0 frame:0 TX packets:5060 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:100 RX bytes:7036208 (6.7 Mb) TX bytes:463992 (453.1 Kb) Interrupt:9 Base address:0x10e0 eth2 Link encap:Ethernet HWaddr 00:50:56:45:02:BD inet addr:192.168.86.2 Bcast:192.168.86.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:100 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) Interrupt:11 Base address:0x1400 lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:2 errors:0 dropped:0 overruns:0 frame:0 TX packets:2 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:110 (110.0 b) TX bytes:110 (110.0 b) scl01v21:~ # --------------------- ------ OOPS ------- --------------------- scl01v21:~ # tail -f /var/log/messages|ksymoops ksymoops 2.4.5 on i686 2.4.21-215-default. Options used -V (default) -k /proc/ksyms (default) -l /proc/modules (default) -o /lib/modules/2.4.21-215-default/ (default) -m /boot/System.map-2.4.21-215-default (default) Warning: You did not tell me where to find symbol information. I will assume that the log matches the kernel and modules that are running right now and I'll use the default options above for symbol resolution. If the current kernel and/or modules do not match the log, you can get more accurate output by telling me the kernel version and where to find map, modules, ksyms etc. ksymoops -h explains the options. Jun 28 18:52:21 scl01v21 kernel: Unable to handle kernel NULL pointer dereference at virtual address 00000004 Jun 28 18:52:21 scl01v21 kernel: df5a81cf Jun 28 18:52:21 scl01v21 kernel: *pde = 00000000 Jun 28 18:52:21 scl01v21 kernel: Oops: 0002 2.4.21-215-default #1 Tue Apr 27 16:17:49 UTC 2004 Jun 28 18:52:21 scl01v21 kernel: CPU: 0 Jun 28 18:52:21 scl01v21 kernel: EIP: 0010:[drbd:finish_wait+31/48] Not tainted Jun 28 18:52:21 scl01v21 kernel: EIP: 0010:[<df5a81cf>] Not tainted Using defaults from ksymoops -t elf32-i386 -a i386 Jun 28 18:52:21 scl01v21 kernel: EFLAGS: 00000086 Jun 28 18:52:21 scl01v21 kernel: eax: d4e47f38 ebx: d4e47f30 ecx: 00000000 edx: 00000000 Jun 28 18:52:21 scl01v21 kernel: esi: 00000086 edi: c6370428 ebp: d4e47f30 esp: d4e47ef4 Jun 28 18:52:21 scl01v21 kernel: ds: 0018 es: 0018 ss: 0018 Jun 28 18:52:21 scl01v21 kernel: Process drbd0_receiver (pid: 1751, stackpage=d4e47000) Jun 28 18:52:21 scl01v21 kernel: Stack: c6370000 c6370468 df5a832a c6370468 d4e47f30 d4e46000 d4e47f18 00000000 Jun 28 18:52:21 scl01v21 kernel: d4e46000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 Jun 28 18:52:21 scl01v21 kernel: d4e46000 00000000 00000000 00000000 c0000000 df5a8976 c9b46508 00001000 Jun 28 18:52:21 scl01v21 kernel: Call Trace: [drbd:drbd_get_ee+330/464] (76) [drbd:drbd_recv+134/448] (24) [drbd:read_in_block+19/336] (24) Jun 28 18:52:21 scl01v21 kernel: Call Trace: [<df5a832a>] (76) [<df5a8976>] (24) [<df5a9303>] (24) Jun 28 18:52:21 scl01v21 kernel: [<df5a9783>] (28) [<df5a9cc9>] (32) [<df5ab983>] (20) [<df5ac13f>] (20) Jun 28 18:52:21 scl01v21 kernel: [<df5b1994>] (20) [<c0107486>] (08) [<df5b1920>] (04) Jun 28 18:52:21 scl01v21 kernel: Code: 89 4a 04 89 11 89 40 04 89 43 08 56 9d 5b 5e c3 90 55 57 56 >>EIP; df5a81cf <END_OF_CODE+179b169c/????> <===== >>eax; d4e47f38 <END_OF_CODE+d251405/????> >>ebx; d4e47f30 <END_OF_CODE+d2513fd/????> >>edi; c6370428 <[mii].text.end+353bcc2/42538fa> >>ebp; d4e47f30 <END_OF_CODE+d2513fd/????> >>esp; d4e47ef4 <END_OF_CODE+d2513c1/????> Trace; df5a832a <END_OF_CODE+179b17f7/????> Trace; df5a8976 <END_OF_CODE+179b1e43/????> Trace; df5a9303 <END_OF_CODE+179b27d0/????> Trace; df5a9783 <END_OF_CODE+179b2c50/????> Trace; df5a9cc9 <END_OF_CODE+179b3196/????> Trace; df5ab983 <END_OF_CODE+179b4e50/????> Trace; df5ac13f <END_OF_CODE+179b560c/????> Trace; df5b1994 <END_OF_CODE+179bae61/????> Trace; c0107486 <arch_kernel_thread+26/30> Trace; df5b1920 <END_OF_CODE+179baded/????> Code; df5a81cf <END_OF_CODE+179b169c/????> 00000000 <_EIP>: Code; df5a81cf <END_OF_CODE+179b169c/????> <===== 0: 89 4a 04 mov %ecx,0x4(%edx) <===== Code; df5a81d2 <END_OF_CODE+179b169f/????> 3: 89 11 mov %edx,(%ecx) Code; df5a81d4 <END_OF_CODE+179b16a1/????> 5: 89 40 04 mov %eax,0x4(%eax) Code; df5a81d7 <END_OF_CODE+179b16a4/????> 8: 89 43 08 mov %eax,0x8(%ebx) Code; df5a81da <END_OF_CODE+179b16a7/????> b: 56 push %esi Code; df5a81db <END_OF_CODE+179b16a8/????> c: 9d popf Code; df5a81dc <END_OF_CODE+179b16a9/????> d: 5b pop %ebx Code; df5a81dd <END_OF_CODE+179b16aa/????> e: 5e pop %esi Code; df5a81de <END_OF_CODE+179b16ab/????> f: c3 ret Code; df5a81df <END_OF_CODE+179b16ac/????> 10: 90 nop Code; df5a81e0 <END_OF_CODE+179b16ad/????> 11: 55 push %ebp Code; df5a81e1 <END_OF_CODE+179b16ae/????> 12: 57 push %edi Code; df5a81e2 <END_OF_CODE+179b16af/????> 13: 56 push %esi