[DRBD-user] Kernel 3.7.2: error when unloading drdb module

Urban Loesch bind at enas.net
Thu Jan 31 15:47:07 CET 2013

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


Hi,

I have compiled a 3.7.2 kernel with linux-vserver patch version "vs2.3.5.5" and drbd module 8.3.13.

When I try to unload the module from kernel with rmmod it takes about 3 seconds and in the kernel log I
get the error below:

Unlading the module: rmmod drbd:
Jan 31 15:28:27 dbhost03 kernel: [514590.307852] =============================================================================
Jan 31 15:28:27 dbhost03 kernel: [514590.317186] BUG kmalloc-96 (Not tainted): Objects remaining in kmalloc-96 on kmem_cache_close()
Jan 31 15:28:27 dbhost03 kernel: [514590.327073] -----------------------------------------------------------------------------
Jan 31 15:28:27 dbhost03 kernel: [514590.327073]
Jan 31 15:28:27 dbhost03 kernel: [514590.338145] Disabling lock debugging due to kernel taint
Jan 31 15:28:27 dbhost03 kernel: [514590.344228] INFO: Slab 0xffffea00200e3f80 objects=42 used=3 fp=0xffff8808038fef00 flags=0x200000000000080
Jan 31 15:28:27 dbhost03 kernel: [514590.355092] Pid: 8102, comm: rmmod Tainted: G    B        3.7.2-vs2.3.5.5-rol-em64t #3
Jan 31 15:28:27 dbhost03 kernel: [514590.364096] Call Trace:
Jan 31 15:28:27 dbhost03 kernel: [514590.366973]  [<ffffffff8117c24f>] slab_err+0xaf/0xd0
Jan 31 15:28:27 dbhost03 kernel: [514590.372664]  [<ffffffff810c0029>] ? sys_futex+0x139/0x190
Jan 31 15:28:27 dbhost03 kernel: [514590.378825]  [<ffffffff8117d8d0>] ? unfreeze_partials+0x190/0x190
Jan 31 15:28:27 dbhost03 kernel: [514590.385765]  [<ffffffff811807f9>] ? __kmem_cache_shutdown+0x139/0x310
Jan 31 15:28:27 dbhost03 kernel: [514590.393108]  [<ffffffff8118081d>] __kmem_cache_shutdown+0x15d/0x310
Jan 31 15:28:27 dbhost03 kernel: [514590.400250]  [<ffffffff8115365b>] kmem_cache_destroy+0x5b/0x100
Jan 31 15:28:27 dbhost03 kernel: [514590.407004]  [<ffffffffa040f7c2>] drbd_destroy_mempools+0x92/0x120 [drbd]
Jan 31 15:28:27 dbhost03 kernel: [514590.414730]  [<ffffffffa0411ea5>] drbd_cleanup+0x305/0x340 [drbd]
Jan 31 15:28:27 dbhost03 kernel: [514590.421676]  [<ffffffff810c5a02>] sys_delete_module+0x152/0x280
Jan 31 15:28:27 dbhost03 kernel: [514590.428425]  [<ffffffff816ac72e>] ? do_page_fault+0xe/0x10
Jan 31 15:28:27 dbhost03 kernel: [514590.434704]  [<ffffffff816b0e19>] system_call_fastpath+0x16/0x1b
Jan 31 15:28:27 dbhost03 kernel: [514590.441564] INFO: Object 0xffff8808038fe1e0 @offset=480
Jan 31 15:28:27 dbhost03 kernel: [514590.447530] INFO: Object 0xffff8808038fe720 @offset=1824
Jan 31 15:28:27 dbhost03 kernel: [514590.453608] INFO: Object 0xffff8808038feb40 @offset=2880
Jan 31 15:28:27 dbhost03 kernel: [514590.459671] =============================================================================
Jan 31 15:28:27 dbhost03 kernel: [514590.468956] BUG kmalloc-96 (Tainted: G    B       ): Objects remaining in kmalloc-96 on kmem_cache_close()
Jan 31 15:28:27 dbhost03 kernel: [514590.479903] -----------------------------------------------------------------------------
Jan 31 15:28:27 dbhost03 kernel: [514590.479903]
Jan 31 15:28:27 dbhost03 kernel: [514590.490969] INFO: Slab 0xffffea0020106fc0 objects=42 used=41 fp=0xffff8808041bfde0 flags=0x200000000000080
Jan 31 15:28:27 dbhost03 kernel: [514590.501911] Pid: 8102, comm: rmmod Tainted: G    B        3.7.2-vs2.3.5.5-rol-em64t #3
Jan 31 15:28:27 dbhost03 kernel: [514590.510914] Call Trace:
Jan 31 15:28:27 dbhost03 kernel: [514590.513780]  [<ffffffff8117c24f>] slab_err+0xaf/0xd0
Jan 31 15:28:27 dbhost03 kernel: [514590.519468]  [<ffffffff8169f0b9>] ? printk+0x61/0x63
Jan 31 15:28:27 dbhost03 kernel: [514590.525146]  [<ffffffff811807f9>] ? __kmem_cache_shutdown+0x139/0x310
Jan 31 15:28:27 dbhost03 kernel: [514590.532478]  [<ffffffff8118081d>] __kmem_cache_shutdown+0x15d/0x310
Jan 31 15:28:27 dbhost03 kernel: [514590.539617]  [<ffffffff8115365b>] kmem_cache_destroy+0x5b/0x100
Jan 31 15:28:27 dbhost03 kernel: [514590.546372]  [<ffffffffa040f7c2>] drbd_destroy_mempools+0x92/0x120 [drbd]
Jan 31 15:28:27 dbhost03 kernel: [514590.554098]  [<ffffffffa0411ea5>] drbd_cleanup+0x305/0x340 [drbd]
Jan 31 15:28:27 dbhost03 kernel: [514590.561046]  [<ffffffff810c5a02>] sys_delete_module+0x152/0x280
Jan 31 15:28:27 dbhost03 kernel: [514590.567792]  [<ffffffff816ac72e>] ? do_page_fault+0xe/0x10
Jan 31 15:28:27 dbhost03 kernel: [514590.574061]  [<ffffffff816b0e19>] system_call_fastpath+0x16/0x1b
Jan 31 15:28:27 dbhost03 kernel: [514590.580908] INFO: Object 0xffff8808041bf000 @offset=0
Jan 31 15:28:27 dbhost03 kernel: [514590.586682] INFO: Object 0xffff8808041bf060 @offset=96
Jan 31 15:28:27 dbhost03 kernel: [514590.592560] INFO: Object 0xffff8808041bf0c0 @offset=192
Jan 31 15:28:27 dbhost03 kernel: [514590.598533] INFO: Object 0xffff8808041bf120 @offset=288
Jan 31 15:28:27 dbhost03 kernel: [514590.604499] INFO: Object 0xffff8808041bf180 @offset=384
Jan 31 15:28:27 dbhost03 kernel: [514590.610461] INFO: Object 0xffff8808041bf1e0 @offset=480
Jan 31 15:28:27 dbhost03 kernel: [514590.616426] INFO: Object 0xffff8808041bf240 @offset=576
Jan 31 15:28:27 dbhost03 kernel: [514590.622389] INFO: Object 0xffff8808041bf2a0 @offset=672
Jan 31 15:28:27 dbhost03 kernel: [514590.628365] INFO: Object 0xffff8808041bf300 @offset=768
Jan 31 15:28:27 dbhost03 kernel: [514590.634339] INFO: Object 0xffff8808041bf360 @offset=864
Jan 31 15:28:27 dbhost03 kernel: [514590.640310] INFO: Object 0xffff8808041bf3c0 @offset=960
Jan 31 15:28:27 dbhost03 kernel: [514590.646283] INFO: Object 0xffff8808041bf420 @offset=1056
Jan 31 15:28:27 dbhost03 kernel: [514590.652352] INFO: Object 0xffff8808041bf480 @offset=1152
Jan 31 15:28:27 dbhost03 kernel: [514590.658424] INFO: Object 0xffff8808041bf4e0 @offset=1248
Jan 31 15:28:27 dbhost03 kernel: [514590.664486] INFO: Object 0xffff8808041bf540 @offset=1344
Jan 31 15:28:27 dbhost03 kernel: [514590.670554] INFO: Object 0xffff8808041bf5a0 @offset=1440
Jan 31 15:28:27 dbhost03 kernel: [514590.676623] INFO: Object 0xffff8808041bf600 @offset=1536
Jan 31 15:28:27 dbhost03 kernel: [514590.682692] INFO: Object 0xffff8808041bf660 @offset=1632
Jan 31 15:28:27 dbhost03 kernel: [514590.688760] INFO: Object 0xffff8808041bf6c0 @offset=1728
Jan 31 15:28:27 dbhost03 kernel: [514590.694824] INFO: Object 0xffff8808041bf720 @offset=1824
Jan 31 15:28:27 dbhost03 kernel: [514590.700897] INFO: Object 0xffff8808041bf780 @offset=1920
Jan 31 15:28:27 dbhost03 kernel: [514590.706961] INFO: Object 0xffff8808041bf7e0 @offset=2016
Jan 31 15:28:27 dbhost03 kernel: [514590.713030] INFO: Object 0xffff8808041bf840 @offset=2112
Jan 31 15:28:27 dbhost03 kernel: [514590.719109] INFO: Object 0xffff8808041bf8a0 @offset=2208
Jan 31 15:28:27 dbhost03 kernel: [514590.725172] INFO: Object 0xffff8808041bf900 @offset=2304
Jan 31 15:28:27 dbhost03 kernel: [514590.731241] INFO: Object 0xffff8808041bf960 @offset=2400
Jan 31 15:28:27 dbhost03 kernel: [514590.737309] INFO: Object 0xffff8808041bf9c0 @offset=2496
Jan 31 15:28:27 dbhost03 kernel: [514590.743429] INFO: Object 0xffff8808041bfa20 @offset=2592
Jan 31 15:28:27 dbhost03 kernel: [514590.749500] INFO: Object 0xffff8808041bfa80 @offset=2688
Jan 31 15:28:27 dbhost03 kernel: [514590.755564] INFO: Object 0xffff8808041bfae0 @offset=2784
Jan 31 15:28:27 dbhost03 kernel: [514590.761632] INFO: Object 0xffff8808041bfb40 @offset=2880
Jan 31 15:28:27 dbhost03 kernel: [514590.767704] INFO: Object 0xffff8808041bfba0 @offset=2976
Jan 31 15:28:27 dbhost03 kernel: [514590.773772] INFO: Object 0xffff8808041bfc00 @offset=3072
Jan 31 15:28:27 dbhost03 kernel: [514590.779842] INFO: Object 0xffff8808041bfc60 @offset=3168
Jan 31 15:28:27 dbhost03 kernel: [514590.785898] INFO: Object 0xffff8808041bfcc0 @offset=3264
Jan 31 15:28:27 dbhost03 kernel: [514590.791964] INFO: Object 0xffff8808041bfd20 @offset=3360
Jan 31 15:28:27 dbhost03 kernel: [514590.798028] INFO: Object 0xffff8808041bfd80 @offset=3456
Jan 31 15:28:27 dbhost03 kernel: [514590.804098] INFO: Object 0xffff8808041bfe40 @offset=3648
Jan 31 15:28:27 dbhost03 kernel: [514590.810169] INFO: Object 0xffff8808041bfea0 @offset=3744
Jan 31 15:28:27 dbhost03 kernel: [514590.816234] INFO: Object 0xffff8808041bff00 @offset=3840
Jan 31 15:28:27 dbhost03 kernel: [514590.822308] INFO: Object 0xffff8808041bff60 @offset=3936
Jan 31 15:28:27 dbhost03 kernel: [514590.828379] =============================================================================
Jan 31 15:28:27 dbhost03 kernel: [514590.837667] BUG kmalloc-96 (Tainted: G    B       ): Objects remaining in kmalloc-96 on kmem_cache_close()
Jan 31 15:28:27 dbhost03 kernel: [514590.848609] -----------------------------------------------------------------------------
Jan 31 15:28:27 dbhost03 kernel: [514590.848609]
Jan 31 15:28:27 dbhost03 kernel: [514590.859673] INFO: Slab 0xffffea00200dd700 objects=42 used=39 fp=0xffff88080375ccc0 flags=0x200000000000080
Jan 31 15:28:28 dbhost03 kernel: [514590.870618] Pid: 8102, comm: rmmod Tainted: G    B        3.7.2-vs2.3.5.5-rol-em64t #3
Jan 31 15:28:28 dbhost03 kernel: [514590.879619] Call Trace:
Jan 31 15:28:28 dbhost03 kernel: [514590.882484]  [<ffffffff8117c24f>] slab_err+0xaf/0xd0
Jan 31 15:28:28 dbhost03 kernel: [514590.888163]  [<ffffffff8169f0b9>] ? printk+0x61/0x63
Jan 31 15:28:28 dbhost03 kernel: [514590.893841]  [<ffffffff811807f9>] ? __kmem_cache_shutdown+0x139/0x310
Jan 31 15:28:28 dbhost03 kernel: [514590.901178]  [<ffffffff8118081d>] __kmem_cache_shutdown+0x15d/0x310
Jan 31 15:28:28 dbhost03 kernel: [514590.908311]  [<ffffffff8115365b>] kmem_cache_destroy+0x5b/0x100
Jan 31 15:28:28 dbhost03 kernel: [514590.915060]  [<ffffffffa040f7c2>] drbd_destroy_mempools+0x92/0x120 [drbd]
Jan 31 15:28:28 dbhost03 kernel: [514590.922785]  [<ffffffffa0411ea5>] drbd_cleanup+0x305/0x340 [drbd]
Jan 31 15:28:28 dbhost03 kernel: [514590.929733]  [<ffffffff810c5a02>] sys_delete_module+0x152/0x280
Jan 31 15:28:28 dbhost03 kernel: [514590.936480]  [<ffffffff816ac72e>] ? do_page_fault+0xe/0x10
Jan 31 15:28:28 dbhost03 kernel: [514590.942744]  [<ffffffff816b0e19>] system_call_fastpath+0x16/0x1b
Jan 31 15:28:28 dbhost03 kernel: [514590.949598] INFO: Object 0xffff88080375c000 @offset=0
Jan 31 15:28:28 dbhost03 kernel: [514590.955371] INFO: Object 0xffff88080375c060 @offset=96
Jan 31 15:28:28 dbhost03 kernel: [514590.961265] INFO: Object 0xffff88080375c0c0 @offset=192
Jan 31 15:28:28 dbhost03 kernel: [514590.967223] INFO: Object 0xffff88080375c120 @offset=288
Jan 31 15:28:28 dbhost03 kernel: [514590.973201] INFO: Object 0xffff88080375c180 @offset=384
Jan 31 15:28:28 dbhost03 kernel: [514590.979173] INFO: Object 0xffff88080375c1e0 @offset=480
Jan 31 15:28:28 dbhost03 kernel: [514590.985146] INFO: Object 0xffff88080375c240 @offset=576
Jan 31 15:28:28 dbhost03 kernel: [514590.991126] INFO: Object 0xffff88080375c300 @offset=768
Jan 31 15:28:28 dbhost03 kernel: [514590.997099] INFO: Object 0xffff88080375c360 @offset=864
Jan 31 15:28:28 dbhost03 kernel: [514591.003070] INFO: Object 0xffff88080375c3c0 @offset=960
Jan 31 15:28:28 dbhost03 kernel: [514591.009044] INFO: Object 0xffff88080375c420 @offset=1056
Jan 31 15:28:28 dbhost03 kernel: [514591.015108] INFO: Object 0xffff88080375c480 @offset=1152
Jan 31 15:28:28 dbhost03 kernel: [514591.021186] INFO: Object 0xffff88080375c4e0 @offset=1248
Jan 31 15:28:28 dbhost03 kernel: [514591.027250] INFO: Object 0xffff88080375c540 @offset=1344
Jan 31 15:28:28 dbhost03 kernel: [514591.033319] INFO: Object 0xffff88080375c5a0 @offset=1440
Jan 31 15:28:28 dbhost03 kernel: [514591.039389] INFO: Object 0xffff88080375c600 @offset=1536
Jan 31 15:28:28 dbhost03 kernel: [514591.045459] INFO: Object 0xffff88080375c660 @offset=1632
Jan 31 15:28:28 dbhost03 kernel: [514591.051528] INFO: Object 0xffff88080375c6c0 @offset=1728
Jan 31 15:28:28 dbhost03 kernel: [514591.057590] INFO: Object 0xffff88080375c720 @offset=1824
Jan 31 15:28:28 dbhost03 kernel: [514591.063656] INFO: Object 0xffff88080375c780 @offset=1920
Jan 31 15:28:28 dbhost03 kernel: [514591.069727] INFO: Object 0xffff88080375c7e0 @offset=2016
Jan 31 15:28:28 dbhost03 kernel: [514591.075791] INFO: Object 0xffff88080375c840 @offset=2112
Jan 31 15:28:28 dbhost03 kernel: [514591.081874] INFO: Object 0xffff88080375c8a0 @offset=2208
Jan 31 15:28:28 dbhost03 kernel: [514591.087938] INFO: Object 0xffff88080375c900 @offset=2304
Jan 31 15:28:28 dbhost03 kernel: [514591.094002] INFO: Object 0xffff88080375c960 @offset=2400
Jan 31 15:28:28 dbhost03 kernel: [514591.100072] INFO: Object 0xffff88080375c9c0 @offset=2496
Jan 31 15:28:28 dbhost03 kernel: [514591.106127] INFO: Object 0xffff88080375ca20 @offset=2592
Jan 31 15:28:28 dbhost03 kernel: [514591.112203] INFO: Object 0xffff88080375ca80 @offset=2688
Jan 31 15:28:28 dbhost03 kernel: [514591.118267] INFO: Object 0xffff88080375cae0 @offset=2784
Jan 31 15:28:28 dbhost03 kernel: [514591.124332] INFO: Object 0xffff88080375cb40 @offset=2880
Jan 31 15:28:28 dbhost03 kernel: [514591.130406] INFO: Object 0xffff88080375cba0 @offset=2976
Jan 31 15:28:28 dbhost03 kernel: [514591.136466] INFO: Object 0xffff88080375cc00 @offset=3072
Jan 31 15:28:28 dbhost03 kernel: [514591.142545] INFO: Object 0xffff88080375cc60 @offset=3168
Jan 31 15:28:28 dbhost03 kernel: [514591.148600] INFO: Object 0xffff88080375cd80 @offset=3456
Jan 31 15:28:28 dbhost03 kernel: [514591.154659] INFO: Object 0xffff88080375cde0 @offset=3552
Jan 31 15:28:28 dbhost03 kernel: [514591.160721] INFO: Object 0xffff88080375ce40 @offset=3648
Jan 31 15:28:28 dbhost03 kernel: [514591.166779] INFO: Object 0xffff88080375cea0 @offset=3744
Jan 31 15:28:28 dbhost03 kernel: [514591.172845] INFO: Object 0xffff88080375cf00 @offset=3840
Jan 31 15:28:28 dbhost03 kernel: [514591.178907] INFO: Object 0xffff88080375cf60 @offset=3936
Jan 31 15:28:28 dbhost03 kernel: [514591.184967] =============================================================================
Jan 31 15:28:28 dbhost03 kernel: [514591.194255] BUG kmalloc-96 (Tainted: G    B       ): Objects remaining in kmalloc-96 on kmem_cache_close()
Jan 31 15:28:28 dbhost03 kernel: [514591.205192] -----------------------------------------------------------------------------
Jan 31 15:28:28 dbhost03 kernel: [514591.205192]
Jan 31 15:28:28 dbhost03 kernel: [514591.216246] INFO: Slab 0xffffea00200a27c0 objects=42 used=1 fp=0xffff88080289f0c0 flags=0x200000000000080
Jan 31 15:28:28 dbhost03 kernel: [514591.227086] Pid: 8102, comm: rmmod Tainted: G    B        3.7.2-vs2.3.5.5-rol-em64t #3
Jan 31 15:28:28 dbhost03 kernel: [514591.236073] Call Trace:
Jan 31 15:28:28 dbhost03 kernel: [514591.238935]  [<ffffffff8117c24f>] slab_err+0xaf/0xd0
Jan 31 15:28:28 dbhost03 kernel: [514591.244607]  [<ffffffff8169f0b9>] ? printk+0x61/0x63
Jan 31 15:28:28 dbhost03 kernel: [514591.250284]  [<ffffffff811807f9>] ? __kmem_cache_shutdown+0x139/0x310
Jan 31 15:28:28 dbhost03 kernel: [514591.259573]  [<ffffffff8118081d>] __kmem_cache_shutdown+0x15d/0x310
Jan 31 15:28:28 dbhost03 kernel: [514591.266701]  [<ffffffff8115365b>] kmem_cache_destroy+0x5b/0x100
Jan 31 15:28:28 dbhost03 kernel: [514591.273445]  [<ffffffffa040f7c2>] drbd_destroy_mempools+0x92/0x120 [drbd]
Jan 31 15:28:28 dbhost03 kernel: [514591.281161]  [<ffffffffa0411ea5>] drbd_cleanup+0x305/0x340 [drbd]
Jan 31 15:28:28 dbhost03 kernel: [514591.288088]  [<ffffffff810c5a02>] sys_delete_module+0x152/0x280
Jan 31 15:28:28 dbhost03 kernel: [514591.294828]  [<ffffffff816ac72e>] ? do_page_fault+0xe/0x10
Jan 31 15:28:28 dbhost03 kernel: [514591.301086]  [<ffffffff816b0e19>] system_call_fastpath+0x16/0x1b
Jan 31 15:28:28 dbhost03 kernel: [514591.307930] INFO: Object 0xffff88080289f360 @offset=864
Jan 31 15:28:28 dbhost03 kernel: [514591.313895] =============================================================================
Jan 31 15:28:28 dbhost03 kernel: [514591.323172] BUG kmalloc-96 (Tainted: G    B       ): Objects remaining in kmalloc-96 on kmem_cache_close()
Jan 31 15:28:28 dbhost03 kernel: [514591.334108] -----------------------------------------------------------------------------
Jan 31 15:28:28 dbhost03 kernel: [514591.334108]
Jan 31 15:28:28 dbhost03 kernel: [514591.345162] INFO: Slab 0xffffea0020085280 objects=42 used=12 fp=0xffff88080214a3c0 flags=0x200000000000080
Jan 31 15:28:28 dbhost03 kernel: [514591.356098] Pid: 8102, comm: rmmod Tainted: G    B        3.7.2-vs2.3.5.5-rol-em64t #3
Jan 31 15:28:28 dbhost03 kernel: [514591.365086] Call Trace:
Jan 31 15:28:28 dbhost03 kernel: [514591.367948]  [<ffffffff8117c24f>] slab_err+0xaf/0xd0
Jan 31 15:28:28 dbhost03 kernel: [514591.373622]  [<ffffffff8169f0b9>] ? printk+0x61/0x63
Jan 31 15:28:28 dbhost03 kernel: [514591.379297]  [<ffffffff811807f9>] ? __kmem_cache_shutdown+0x139/0x310
Jan 31 15:28:28 dbhost03 kernel: [514591.386625]  [<ffffffff8118081d>] __kmem_cache_shutdown+0x15d/0x310
Jan 31 15:28:28 dbhost03 kernel: [514591.393757]  [<ffffffff8115365b>] kmem_cache_destroy+0x5b/0x100
Jan 31 15:28:28 dbhost03 kernel: [514591.400502]  [<ffffffffa040f7c2>] drbd_destroy_mempools+0x92/0x120 [drbd]
Jan 31 15:28:28 dbhost03 kernel: [514591.408221]  [<ffffffffa0411ea5>] drbd_cleanup+0x305/0x340 [drbd]
Jan 31 15:28:28 dbhost03 kernel: [514591.415156]  [<ffffffff810c5a02>] sys_delete_module+0x152/0x280
Jan 31 15:28:28 dbhost03 kernel: [514591.421905]  [<ffffffff816ac72e>] ? do_page_fault+0xe/0x10
Jan 31 15:28:28 dbhost03 kernel: [514591.428164]  [<ffffffff816b0e19>] system_call_fastpath+0x16/0x1b
Jan 31 15:28:28 dbhost03 kernel: [514591.435006] INFO: Object 0xffff88080214a0c0 @offset=192
Jan 31 15:28:28 dbhost03 kernel: [514591.440971] INFO: Object 0xffff88080214a360 @offset=864
Jan 31 15:28:28 dbhost03 kernel: [514591.446934] INFO: Object 0xffff88080214a4e0 @offset=1248
Jan 31 15:28:28 dbhost03 kernel: [514591.452998] INFO: Object 0xffff88080214a660 @offset=1632
Jan 31 15:28:28 dbhost03 kernel: [514591.459062] INFO: Object 0xffff88080214a780 @offset=1920
Jan 31 15:28:28 dbhost03 kernel: [514591.465121] INFO: Object 0xffff88080214a7e0 @offset=2016
Jan 31 15:28:28 dbhost03 kernel: [514591.471182] INFO: Object 0xffff88080214a8a0 @offset=2208
Jan 31 15:28:28 dbhost03 kernel: [514591.477240] INFO: Object 0xffff88080214aa80 @offset=2688
Jan 31 15:28:28 dbhost03 kernel: [514591.483300] INFO: Object 0xffff88080214ac60 @offset=3168
Jan 31 15:28:28 dbhost03 kernel: [514591.489364] INFO: Object 0xffff88080214ade0 @offset=3552
Jan 31 15:28:28 dbhost03 kernel: [514591.495424] INFO: Object 0xffff88080214aea0 @offset=3744
Jan 31 15:28:28 dbhost03 kernel: [514591.501485] INFO: Object 0xffff88080214af60 @offset=3936
Jan 31 15:28:28 dbhost03 kernel: [514591.507549] =============================================================================
Jan 31 15:28:28 dbhost03 kernel: [514591.516831] BUG kmalloc-96 (Tainted: G    B       ): Objects remaining in kmalloc-96 on kmem_cache_close()
Jan 31 15:28:28 dbhost03 kernel: [514591.527772] -----------------------------------------------------------------------------
Jan 31 15:28:28 dbhost03 kernel: [514591.527772]
Jan 31 15:28:28 dbhost03 kernel: [514591.538827] INFO: Slab 0xffffea0020051c00 objects=42 used=37 fp=0xffff880801470d20 flags=0x200000000000080
Jan 31 15:28:28 dbhost03 kernel: [514591.549762] Pid: 8102, comm: rmmod Tainted: G    B        3.7.2-vs2.3.5.5-rol-em64t #3
Jan 31 15:28:28 dbhost03 kernel: [514591.558757] Call Trace:
Jan 31 15:28:28 dbhost03 kernel: [514591.561616]  [<ffffffff8117c24f>] slab_err+0xaf/0xd0
Jan 31 15:28:28 dbhost03 kernel: [514591.567289]  [<ffffffff81130029>] ? padata_reorder+0xa9/0x1d0
Jan 31 15:28:28 dbhost03 kernel: [514591.573835]  [<ffffffff8117d16d>] ? __free_slab+0xcd/0x1a0
Jan 31 15:28:28 dbhost03 kernel: [514591.580091]  [<ffffffff811807f9>] ? __kmem_cache_shutdown+0x139/0x310
Jan 31 15:28:28 dbhost03 kernel: [514591.587411]  [<ffffffff8118081d>] __kmem_cache_shutdown+0x15d/0x310
Jan 31 15:28:28 dbhost03 kernel: [514591.594539]  [<ffffffff8115365b>] kmem_cache_destroy+0x5b/0x100
Jan 31 15:28:28 dbhost03 kernel: [514591.601289]  [<ffffffffa040f7c2>] drbd_destroy_mempools+0x92/0x120 [drbd]
Jan 31 15:28:28 dbhost03 kernel: [514591.609006]  [<ffffffffa0411ea5>] drbd_cleanup+0x305/0x340 [drbd]
Jan 31 15:28:28 dbhost03 kernel: [514591.615940]  [<ffffffff810c5a02>] sys_delete_module+0x152/0x280
Jan 31 15:28:28 dbhost03 kernel: [514591.622683]  [<ffffffff816ac72e>] ? do_page_fault+0xe/0x10
Jan 31 15:28:28 dbhost03 kernel: [514591.628966]  [<ffffffff816b0e19>] system_call_fastpath+0x16/0x1b
Jan 31 15:28:28 dbhost03 kernel: [514591.635801] INFO: Object 0xffff880801470000 @offset=0
Jan 31 15:28:28 dbhost03 kernel: [514591.641579] INFO: Object 0xffff880801470060 @offset=96
Jan 31 15:28:28 dbhost03 kernel: [514591.647448] INFO: Object 0xffff8808014700c0 @offset=192
Jan 31 15:28:28 dbhost03 kernel: [514591.653411] INFO: Object 0xffff880801470120 @offset=288
Jan 31 15:28:28 dbhost03 kernel: [514591.659376] INFO: Object 0xffff880801470180 @offset=384
Jan 31 15:28:28 dbhost03 kernel: [514591.665339] INFO: Object 0xffff8808014701e0 @offset=480
Jan 31 15:28:28 dbhost03 kernel: [514591.671310] INFO: Object 0xffff8808014702a0 @offset=672
Jan 31 15:28:28 dbhost03 kernel: [514591.677271] INFO: Object 0xffff880801470300 @offset=768
Jan 31 15:28:28 dbhost03 kernel: [514591.683234] INFO: Object 0xffff880801470360 @offset=864
Jan 31 15:28:28 dbhost03 kernel: [514591.689200] INFO: Object 0xffff8808014703c0 @offset=960
Jan 31 15:28:28 dbhost03 kernel: [514591.695163] INFO: Object 0xffff880801470420 @offset=1056
Jan 31 15:28:28 dbhost03 kernel: [514591.701227] INFO: Object 0xffff880801470480 @offset=1152
Jan 31 15:28:28 dbhost03 kernel: [514591.707298] INFO: Object 0xffff8808014704e0 @offset=1248
Jan 31 15:28:28 dbhost03 kernel: [514591.713357] INFO: Object 0xffff880801470540 @offset=1344
Jan 31 15:28:28 dbhost03 kernel: [514591.719418] INFO: Object 0xffff8808014705a0 @offset=1440
Jan 31 15:28:28 dbhost03 kernel: [514591.725477] INFO: Object 0xffff880801470600 @offset=1536
Jan 31 15:28:28 dbhost03 kernel: [514591.731541] INFO: Object 0xffff880801470660 @offset=1632
Jan 31 15:28:28 dbhost03 kernel: [514591.737606] INFO: Object 0xffff8808014706c0 @offset=1728
Jan 31 15:28:28 dbhost03 kernel: [514591.743665] INFO: Object 0xffff880801470720 @offset=1824
Jan 31 15:28:28 dbhost03 kernel: [514591.749726] INFO: Object 0xffff880801470780 @offset=1920
Jan 31 15:28:28 dbhost03 kernel: [514591.755785] INFO: Object 0xffff8808014707e0 @offset=2016
Jan 31 15:28:28 dbhost03 kernel: [514591.761849] INFO: Object 0xffff880801470840 @offset=2112
Jan 31 15:28:28 dbhost03 kernel: [514591.767913] INFO: Object 0xffff8808014708a0 @offset=2208
Jan 31 15:28:28 dbhost03 kernel: [514591.773972] INFO: Object 0xffff880801470900 @offset=2304
Jan 31 15:28:28 dbhost03 kernel: [514591.780036] INFO: Object 0xffff880801470960 @offset=2400
Jan 31 15:28:28 dbhost03 kernel: [514591.786095] INFO: Object 0xffff8808014709c0 @offset=2496
Jan 31 15:28:28 dbhost03 kernel: [514591.792164] INFO: Object 0xffff880801470a20 @offset=2592
Jan 31 15:28:28 dbhost03 kernel: [514591.798228] INFO: Object 0xffff880801470a80 @offset=2688
Jan 31 15:28:28 dbhost03 kernel: [514591.804287] INFO: Object 0xffff880801470ae0 @offset=2784
Jan 31 15:28:28 dbhost03 kernel: [514591.810351] INFO: Object 0xffff880801470b40 @offset=2880
Jan 31 15:28:28 dbhost03 kernel: [514591.816409] INFO: Object 0xffff880801470ba0 @offset=2976
Jan 31 15:28:28 dbhost03 kernel: [514591.822471] INFO: Object 0xffff880801470c00 @offset=3072
Jan 31 15:28:28 dbhost03 kernel: [514591.828533] INFO: Object 0xffff880801470c60 @offset=3168
Jan 31 15:28:28 dbhost03 kernel: [514591.834592] INFO: Object 0xffff880801470cc0 @offset=3264
Jan 31 15:28:28 dbhost03 kernel: [514591.840653] INFO: Object 0xffff880801470ea0 @offset=3744
Jan 31 15:28:28 dbhost03 kernel: [514591.846702] INFO: Object 0xffff880801470f00 @offset=3840
Jan 31 15:28:28 dbhost03 kernel: [514591.852760] INFO: Object 0xffff880801470f60 @offset=3936
Jan 31 15:28:28 dbhost03 kernel: [514591.858824] =============================================================================
Jan 31 15:28:29 dbhost03 kernel: [514591.868112] BUG kmalloc-96 (Tainted: G    B       ): Objects remaining in kmalloc-96 on kmem_cache_close()
Jan 31 15:28:29 dbhost03 kernel: [514591.879049] -----------------------------------------------------------------------------
Jan 31 15:28:29 dbhost03 kernel: [514591.879049]
Jan 31 15:28:29 dbhost03 kernel: [514591.890095] INFO: Slab 0xffffea00200a8f80 objects=42 used=4 fp=0xffff880802a3ef60 flags=0x200000000000080
Jan 31 15:28:29 dbhost03 kernel: [514591.900933] Pid: 8102, comm: rmmod Tainted: G    B        3.7.2-vs2.3.5.5-rol-em64t #3
Jan 31 15:28:29 dbhost03 kernel: [514591.909929] Call Trace:
Jan 31 15:28:29 dbhost03 kernel: [514591.912788]  [<ffffffff8117c24f>] slab_err+0xaf/0xd0
Jan 31 15:28:29 dbhost03 kernel: [514591.918471]  [<ffffffff8169f0b9>] ? printk+0x61/0x63
Jan 31 15:28:29 dbhost03 kernel: [514591.924143]  [<ffffffff811807f9>] ? __kmem_cache_shutdown+0x139/0x310
Jan 31 15:28:29 dbhost03 kernel: [514591.931477]  [<ffffffff8118081d>] __kmem_cache_shutdown+0x15d/0x310
Jan 31 15:28:29 dbhost03 kernel: [514591.938608]  [<ffffffff8115365b>] kmem_cache_destroy+0x5b/0x100
Jan 31 15:28:29 dbhost03 kernel: [514591.945349]  [<ffffffffa040f7c2>] drbd_destroy_mempools+0x92/0x120 [drbd]
Jan 31 15:28:29 dbhost03 kernel: [514591.953071]  [<ffffffffa0411ea5>] drbd_cleanup+0x305/0x340 [drbd]
Jan 31 15:28:29 dbhost03 kernel: [514591.960008]  [<ffffffff810c5a02>] sys_delete_module+0x152/0x280
Jan 31 15:28:29 dbhost03 kernel: [514591.966744]  [<ffffffff816ac72e>] ? do_page_fault+0xe/0x10
Jan 31 15:28:29 dbhost03 kernel: [514591.973000]  [<ffffffff816b0e19>] system_call_fastpath+0x16/0x1b
Jan 31 15:28:29 dbhost03 kernel: [514591.979838] INFO: Object 0xffff880802a3e0c0 @offset=192
Jan 31 15:28:29 dbhost03 kernel: [514591.985801] INFO: Object 0xffff880802a3e300 @offset=768
Jan 31 15:28:29 dbhost03 kernel: [514591.991767] INFO: Object 0xffff880802a3e420 @offset=1056
Jan 31 15:28:29 dbhost03 kernel: [514591.997832] INFO: Object 0xffff880802a3e540 @offset=1344
Jan 31 15:28:29 dbhost03 kernel: [514592.003892] =============================================================================
Jan 31 15:28:29 dbhost03 kernel: [514592.013179] BUG kmalloc-96 (Tainted: G    B       ): Objects remaining in kmalloc-96 on kmem_cache_close()
Jan 31 15:28:29 dbhost03 kernel: [514592.024115] -----------------------------------------------------------------------------
Jan 31 15:28:29 dbhost03 kernel: [514592.024115]
Jan 31 15:28:29 dbhost03 kernel: [514592.035171] INFO: Slab 0xffffea00200a6bc0 objects=42 used=4 fp=0xffff8808029af9c0 flags=0x200000000000080
Jan 31 15:28:29 dbhost03 kernel: [514592.046011] Pid: 8102, comm: rmmod Tainted: G    B        3.7.2-vs2.3.5.5-rol-em64t #3
Jan 31 15:28:29 dbhost03 kernel: [514592.054997] Call Trace:
Jan 31 15:28:29 dbhost03 kernel: [514592.057858]  [<ffffffff8117c24f>] slab_err+0xaf/0xd0
Jan 31 15:28:29 dbhost03 kernel: [514592.063530]  [<ffffffff8169f0b9>] ? printk+0x61/0x63
Jan 31 15:28:29 dbhost03 kernel: [514592.069207]  [<ffffffff811807f9>] ? __kmem_cache_shutdown+0x139/0x310
Jan 31 15:28:29 dbhost03 kernel: [514592.076526]  [<ffffffff8118081d>] __kmem_cache_shutdown+0x15d/0x310
Jan 31 15:28:29 dbhost03 kernel: [514592.083652]  [<ffffffff8115365b>] kmem_cache_destroy+0x5b/0x100
Jan 31 15:28:29 dbhost03 kernel: [514592.090388]  [<ffffffffa040f7c2>] drbd_destroy_mempools+0x92/0x120 [drbd]
Jan 31 15:28:29 dbhost03 kernel: [514592.098102]  [<ffffffffa0411ea5>] drbd_cleanup+0x305/0x340 [drbd]
Jan 31 15:28:29 dbhost03 kernel: [514592.105037]  [<ffffffff810c5a02>] sys_delete_module+0x152/0x280
Jan 31 15:28:29 dbhost03 kernel: [514592.111779]  [<ffffffff816ac72e>] ? do_page_fault+0xe/0x10
Jan 31 15:28:29 dbhost03 kernel: [514592.118038]  [<ffffffff816b0e19>] system_call_fastpath+0x16/0x1b
Jan 31 15:28:29 dbhost03 kernel: [514592.124872] INFO: Object 0xffff8808029af660 @offset=1632
Jan 31 15:28:29 dbhost03 kernel: [514592.130941] INFO: Object 0xffff8808029af6c0 @offset=1728
Jan 31 15:28:29 dbhost03 kernel: [514592.137005] INFO: Object 0xffff8808029afba0 @offset=2976
Jan 31 15:28:29 dbhost03 kernel: [514592.143064] INFO: Object 0xffff8808029afc00 @offset=3072
Jan 31 15:28:29 dbhost03 kernel: [514592.149126] =============================================================================
Jan 31 15:28:29 dbhost03 kernel: [514592.158412] BUG kmalloc-96 (Tainted: G    B       ): Objects remaining in kmalloc-96 on kmem_cache_close()
Jan 31 15:28:29 dbhost03 kernel: [514592.169348] -----------------------------------------------------------------------------
Jan 31 15:28:29 dbhost03 kernel: [514592.169348]
Jan 31 15:28:29 dbhost03 kernel: [514592.180402] INFO: Slab 0xffffea0020108cc0 objects=42 used=7 fp=0xffff880804233d80 flags=0x200000000000080
Jan 31 15:28:29 dbhost03 kernel: [514592.191243] Pid: 8102, comm: rmmod Tainted: G    B        3.7.2-vs2.3.5.5-rol-em64t #3
Jan 31 15:28:29 dbhost03 kernel: [514592.200238] Call Trace:
Jan 31 15:28:29 dbhost03 kernel: [514592.203098]  [<ffffffff8117c24f>] slab_err+0xaf/0xd0
Jan 31 15:28:29 dbhost03 kernel: [514592.208774]  [<ffffffff8169f0b9>] ? printk+0x61/0x63
Jan 31 15:28:29 dbhost03 kernel: [514592.214448]  [<ffffffff811807f9>] ? __kmem_cache_shutdown+0x139/0x310
Jan 31 15:28:29 dbhost03 kernel: [514592.221843]  [<ffffffff8118081d>] __kmem_cache_shutdown+0x15d/0x310
Jan 31 15:28:29 dbhost03 kernel: [514592.228974]  [<ffffffff8115365b>] kmem_cache_destroy+0x5b/0x100
Jan 31 15:28:29 dbhost03 kernel: [514592.235716]  [<ffffffffa040f7c2>] drbd_destroy_mempools+0x92/0x120 [drbd]
Jan 31 15:28:29 dbhost03 kernel: [514592.243429]  [<ffffffffa0411ea5>] drbd_cleanup+0x305/0x340 [drbd]
Jan 31 15:28:29 dbhost03 kernel: [514592.250368]  [<ffffffff810c5a02>] sys_delete_module+0x152/0x280
Jan 31 15:28:29 dbhost03 kernel: [514592.257113]  [<ffffffff816ac72e>] ? do_page_fault+0xe/0x10
Jan 31 15:28:29 dbhost03 kernel: [514592.263369]  [<ffffffff816b0e19>] system_call_fastpath+0x16/0x1b
Jan 31 15:28:29 dbhost03 kernel: [514592.270200] INFO: Object 0xffff880804233000 @offset=0
Jan 31 15:28:29 dbhost03 kernel: [514592.275973] INFO: Object 0xffff880804233060 @offset=96
Jan 31 15:28:29 dbhost03 kernel: [514592.281837] INFO: Object 0xffff8808042330c0 @offset=192
Jan 31 15:28:29 dbhost03 kernel: [514592.287804] INFO: Object 0xffff880804233de0 @offset=3552
Jan 31 15:28:29 dbhost03 kernel: [514592.295817] INFO: Object 0xffff880804233e40 @offset=3648
Jan 31 15:28:29 dbhost03 kernel: [514592.301884] INFO: Object 0xffff880804233f00 @offset=3840
Jan 31 15:28:29 dbhost03 kernel: [514592.307947] INFO: Object 0xffff880804233f60 @offset=3936
Jan 31 15:28:29 dbhost03 kernel: [514592.314006] =============================================================================
Jan 31 15:28:29 dbhost03 kernel: [514592.323294] BUG kmalloc-96 (Tainted: G    B       ): Objects remaining in kmalloc-96 on kmem_cache_close()
Jan 31 15:28:29 dbhost03 kernel: [514592.334231] -----------------------------------------------------------------------------
Jan 31 15:28:29 dbhost03 kernel: [514592.334231]
Jan 31 15:28:29 dbhost03 kernel: [514592.345285] INFO: Slab 0xffffea00200a1080 objects=42 used=2 fp=0xffff880802842f60 flags=0x200000000000080
Jan 31 15:28:29 dbhost03 kernel: [514592.356116] Pid: 8102, comm: rmmod Tainted: G    B        3.7.2-vs2.3.5.5-rol-em64t #3
Jan 31 15:28:29 dbhost03 kernel: [514592.365098] Call Trace:
Jan 31 15:28:29 dbhost03 kernel: [514592.367961]  [<ffffffff8117c24f>] slab_err+0xaf/0xd0
Jan 31 15:28:29 dbhost03 kernel: [514592.373635]  [<ffffffff8169f0b9>] ? printk+0x61/0x63
Jan 31 15:28:29 dbhost03 kernel: [514592.379318]  [<ffffffff811807f9>] ? __kmem_cache_shutdown+0x139/0x310
Jan 31 15:28:29 dbhost03 kernel: [514592.386645]  [<ffffffff8118081d>] __kmem_cache_shutdown+0x15d/0x310
Jan 31 15:28:29 dbhost03 kernel: [514592.393772]  [<ffffffff8115365b>] kmem_cache_destroy+0x5b/0x100
Jan 31 15:28:29 dbhost03 kernel: [514592.400508]  [<ffffffffa040f7c2>] drbd_destroy_mempools+0x92/0x120 [drbd]
Jan 31 15:28:29 dbhost03 kernel: [514592.408229]  [<ffffffffa0411ea5>] drbd_cleanup+0x305/0x340 [drbd]
Jan 31 15:28:29 dbhost03 kernel: [514592.415163]  [<ffffffff810c5a02>] sys_delete_module+0x152/0x280
Jan 31 15:28:29 dbhost03 kernel: [514592.421906]  [<ffffffff816ac72e>] ? do_page_fault+0xe/0x10
Jan 31 15:28:29 dbhost03 kernel: [514592.428164]  [<ffffffff816b0e19>] system_call_fastpath+0x16/0x1b
Jan 31 15:28:29 dbhost03 kernel: [514592.435073] INFO: Object 0xffff8808028420c0 @offset=192
Jan 31 15:28:29 dbhost03 kernel: [514592.441044] INFO: Object 0xffff880802842300 @offset=768
Jan 31 15:28:29 dbhost03 kernel: [514592.447012] =============================================================================
Jan 31 15:28:29 dbhost03 kernel: [514592.456300] BUG kmalloc-96 (Tainted: G    B       ): Objects remaining in kmalloc-96 on kmem_cache_close()
Jan 31 15:28:29 dbhost03 kernel: [514592.467235] -----------------------------------------------------------------------------
Jan 31 15:28:29 dbhost03 kernel: [514592.467235]
Jan 31 15:28:29 dbhost03 kernel: [514592.478293] INFO: Slab 0xffffea0020107dc0 objects=42 used=17 fp=0xffff8808041f7c60 flags=0x200000000000080
Jan 31 15:28:29 dbhost03 kernel: [514592.489231] Pid: 8102, comm: rmmod Tainted: G    B        3.7.2-vs2.3.5.5-rol-em64t #3
Jan 31 15:28:29 dbhost03 kernel: [514592.498226] Call Trace:
Jan 31 15:28:29 dbhost03 kernel: [514592.501085]  [<ffffffff8117c24f>] slab_err+0xaf/0xd0
Jan 31 15:28:29 dbhost03 kernel: [514592.506761]  [<ffffffff8169f0b9>] ? printk+0x61/0x63
Jan 31 15:28:29 dbhost03 kernel: [514592.512435]  [<ffffffff811807f9>] ? __kmem_cache_shutdown+0x139/0x310
Jan 31 15:28:29 dbhost03 kernel: [514592.519769]  [<ffffffff8118081d>] __kmem_cache_shutdown+0x15d/0x310
Jan 31 15:28:29 dbhost03 kernel: [514592.526899]  [<ffffffff8115365b>] kmem_cache_destroy+0x5b/0x100
Jan 31 15:28:29 dbhost03 kernel: [514592.533640]  [<ffffffffa040f7c2>] drbd_destroy_mempools+0x92/0x120 [drbd]
Jan 31 15:28:29 dbhost03 kernel: [514592.541361]  [<ffffffffa0411ea5>] drbd_cleanup+0x305/0x340 [drbd]
Jan 31 15:28:29 dbhost03 kernel: [514592.548300]  [<ffffffff810c5a02>] sys_delete_module+0x152/0x280
Jan 31 15:28:29 dbhost03 kernel: [514592.555041]  [<ffffffff816ac72e>] ? do_page_fault+0xe/0x10
Jan 31 15:28:29 dbhost03 kernel: [514592.561298]  [<ffffffff816b0e19>] system_call_fastpath+0x16/0x1b
Jan 31 15:28:29 dbhost03 kernel: [514592.568141] INFO: Object 0xffff8808041f7000 @offset=0
Jan 31 15:28:29 dbhost03 kernel: [514592.573909] INFO: Object 0xffff8808041f7060 @offset=96
Jan 31 15:28:29 dbhost03 kernel: [514592.579778] INFO: Object 0xffff8808041f70c0 @offset=192
Jan 31 15:28:29 dbhost03 kernel: [514592.585739] INFO: Object 0xffff8808041f7120 @offset=288
Jan 31 15:28:29 dbhost03 kernel: [514592.591701] INFO: Object 0xffff8808041f7180 @offset=384
Jan 31 15:28:29 dbhost03 kernel: [514592.597667] INFO: Object 0xffff8808041f71e0 @offset=480
Jan 31 15:28:29 dbhost03 kernel: [514592.603631] INFO: Object 0xffff8808041f7240 @offset=576
Jan 31 15:28:29 dbhost03 kernel: [514592.609596] INFO: Object 0xffff8808041f72a0 @offset=672
Jan 31 15:28:29 dbhost03 kernel: [514592.615556] INFO: Object 0xffff8808041f7300 @offset=768
Jan 31 15:28:29 dbhost03 kernel: [514592.621520] INFO: Object 0xffff8808041f73c0 @offset=960
Jan 31 15:28:29 dbhost03 kernel: [514592.627486] INFO: Object 0xffff8808041f7480 @offset=1152
Jan 31 15:28:29 dbhost03 kernel: [514592.633545] INFO: Object 0xffff8808041f7540 @offset=1344
Jan 31 15:28:29 dbhost03 kernel: [514592.639609] INFO: Object 0xffff8808041f75a0 @offset=1440
Jan 31 15:28:29 dbhost03 kernel: [514592.645669] INFO: Object 0xffff8808041f7660 @offset=1632
Jan 31 15:28:29 dbhost03 kernel: [514592.651729] INFO: Object 0xffff8808041f76c0 @offset=1728
Jan 31 15:28:29 dbhost03 kernel: [514592.657790] INFO: Object 0xffff8808041f77e0 @offset=2016
Jan 31 15:28:29 dbhost03 kernel: [514592.663841] INFO: Object 0xffff8808041f7ba0 @offset=2976
Jan 31 15:28:29 dbhost03 kernel: [514592.669907] =============================================================================
Jan 31 15:28:29 dbhost03 kernel: [514592.679194] BUG kmalloc-96 (Tainted: G    B       ): Objects remaining in kmalloc-96 on kmem_cache_close()
Jan 31 15:28:29 dbhost03 kernel: [514592.690130] -----------------------------------------------------------------------------
Jan 31 15:28:29 dbhost03 kernel: [514592.690130]
Jan 31 15:28:29 dbhost03 kernel: [514592.701184] INFO: Slab 0xffffea0020055700 objects=42 used=41 fp=0xffff88080155cea0 flags=0x200000000000080
Jan 31 15:28:29 dbhost03 kernel: [514592.712120] Pid: 8102, comm: rmmod Tainted: G    B        3.7.2-vs2.3.5.5-rol-em64t #3
Jan 31 15:28:29 dbhost03 kernel: [514592.721116] Call Trace:
Jan 31 15:28:29 dbhost03 kernel: [514592.723974]  [<ffffffff8117c24f>] slab_err+0xaf/0xd0
Jan 31 15:28:29 dbhost03 kernel: [514592.729651]  [<ffffffff8169f0b9>] ? printk+0x61/0x63
Jan 31 15:28:29 dbhost03 kernel: [514592.735324]  [<ffffffff811807f9>] ? __kmem_cache_shutdown+0x139/0x310
Jan 31 15:28:29 dbhost03 kernel: [514592.742646]  [<ffffffff8118081d>] __kmem_cache_shutdown+0x15d/0x310
Jan 31 15:28:29 dbhost03 kernel: [514592.749777]  [<ffffffff8115365b>] kmem_cache_destroy+0x5b/0x100
Jan 31 15:28:29 dbhost03 kernel: [514592.756522]  [<ffffffffa040f7c2>] drbd_destroy_mempools+0x92/0x120 [drbd]
Jan 31 15:28:29 dbhost03 kernel: [514592.764232]  [<ffffffffa0411ea5>] drbd_cleanup+0x305/0x340 [drbd]
Jan 31 15:28:29 dbhost03 kernel: [514592.771175]  [<ffffffff810c5a02>] sys_delete_module+0x152/0x280
Jan 31 15:28:29 dbhost03 kernel: [514592.777920]  [<ffffffff816ac72e>] ? do_page_fault+0xe/0x10
Jan 31 15:28:29 dbhost03 kernel: [514592.784175]  [<ffffffff816b0e19>] system_call_fastpath+0x16/0x1b
Jan 31 15:28:29 dbhost03 kernel: [514592.791005] INFO: Object 0xffff88080155c000 @offset=0
Jan 31 15:28:29 dbhost03 kernel: [514592.796778] INFO: Object 0xffff88080155c060 @offset=96
Jan 31 15:28:29 dbhost03 kernel: [514592.802643] INFO: Object 0xffff88080155c0c0 @offset=192
Jan 31 15:28:29 dbhost03 kernel: [514592.808608] INFO: Object 0xffff88080155c120 @offset=288
Jan 31 15:28:29 dbhost03 kernel: [514592.814571] INFO: Object 0xffff88080155c180 @offset=384
Jan 31 15:28:29 dbhost03 kernel: [514592.820537] INFO: Object 0xffff88080155c1e0 @offset=480
Jan 31 15:28:29 dbhost03 kernel: [514592.826504] INFO: Object 0xffff88080155c240 @offset=576
Jan 31 15:28:29 dbhost03 kernel: [514592.832466] INFO: Object 0xffff88080155c2a0 @offset=672
Jan 31 15:28:29 dbhost03 kernel: [514592.838431] INFO: Object 0xffff88080155c300 @offset=768
Jan 31 15:28:29 dbhost03 kernel: [514592.844393] INFO: Object 0xffff88080155c360 @offset=864
Jan 31 15:28:29 dbhost03 kernel: [514592.850359] INFO: Object 0xffff88080155c3c0 @offset=960
Jan 31 15:28:29 dbhost03 kernel: [514592.856324] INFO: Object 0xffff88080155c420 @offset=1056
Jan 31 15:28:30 dbhost03 kernel: [514592.862383] INFO: Object 0xffff88080155c480 @offset=1152
Jan 31 15:28:30 dbhost03 kernel: [514592.868445] INFO: Object 0xffff88080155c4e0 @offset=1248
Jan 31 15:28:30 dbhost03 kernel: [514592.874504] INFO: Object 0xffff88080155c540 @offset=1344
Jan 31 15:28:30 dbhost03 kernel: [514592.880566] INFO: Object 0xffff88080155c5a0 @offset=1440
Jan 31 15:28:30 dbhost03 kernel: [514592.886619] INFO: Object 0xffff88080155c600 @offset=1536
Jan 31 15:28:30 dbhost03 kernel: [514592.892679] INFO: Object 0xffff88080155c660 @offset=1632
Jan 31 15:28:30 dbhost03 kernel: [514592.898743] INFO: Object 0xffff88080155c6c0 @offset=1728
Jan 31 15:28:30 dbhost03 kernel: [514592.904802] INFO: Object 0xffff88080155c720 @offset=1824
Jan 31 15:28:30 dbhost03 kernel: [514592.910871] INFO: Object 0xffff88080155c780 @offset=1920
Jan 31 15:28:30 dbhost03 kernel: [514592.916934] INFO: Object 0xffff88080155c7e0 @offset=2016
Jan 31 15:28:30 dbhost03 kernel: [514592.922994] INFO: Object 0xffff88080155c840 @offset=2112
Jan 31 15:28:30 dbhost03 kernel: [514592.929058] INFO: Object 0xffff88080155c8a0 @offset=2208
Jan 31 15:28:30 dbhost03 kernel: [514592.935114] INFO: Object 0xffff88080155c900 @offset=2304
Jan 31 15:28:30 dbhost03 kernel: [514592.941174] INFO: Object 0xffff88080155c960 @offset=2400
Jan 31 15:28:30 dbhost03 kernel: [514592.947236] INFO: Object 0xffff88080155c9c0 @offset=2496
Jan 31 15:28:30 dbhost03 kernel: [514592.953294] INFO: Object 0xffff88080155ca20 @offset=2592
Jan 31 15:28:30 dbhost03 kernel: [514592.959356] INFO: Object 0xffff88080155ca80 @offset=2688
Jan 31 15:28:30 dbhost03 kernel: [514592.965411] INFO: Object 0xffff88080155cae0 @offset=2784
Jan 31 15:28:30 dbhost03 kernel: [514592.971470] INFO: Object 0xffff88080155cb40 @offset=2880
Jan 31 15:28:30 dbhost03 kernel: [514592.977533] INFO: Object 0xffff88080155cba0 @offset=2976
Jan 31 15:28:30 dbhost03 kernel: [514592.983592] INFO: Object 0xffff88080155cc00 @offset=3072
Jan 31 15:28:30 dbhost03 kernel: [514592.989654] INFO: Object 0xffff88080155cc60 @offset=3168
Jan 31 15:28:30 dbhost03 kernel: [514592.995709] INFO: Object 0xffff88080155ccc0 @offset=3264
Jan 31 15:28:30 dbhost03 kernel: [514593.001769] INFO: Object 0xffff88080155cd20 @offset=3360
Jan 31 15:28:30 dbhost03 kernel: [514593.007830] INFO: Object 0xffff88080155cd80 @offset=3456
Jan 31 15:28:30 dbhost03 kernel: [514593.013881] INFO: Object 0xffff88080155cde0 @offset=3552
Jan 31 15:28:30 dbhost03 kernel: [514593.019946] INFO: Object 0xffff88080155ce40 @offset=3648
Jan 31 15:28:30 dbhost03 kernel: [514593.026008] INFO: Object 0xffff88080155cf00 @offset=3840
Jan 31 15:28:30 dbhost03 kernel: [514593.032116] INFO: Object 0xffff88080155cf60 @offset=3936
Jan 31 15:28:30 dbhost03 kernel: [514593.038179] =============================================================================
Jan 31 15:28:30 dbhost03 kernel: [514593.047466] BUG kmalloc-96 (Tainted: G    B       ): Objects remaining in kmalloc-96 on kmem_cache_close()
Jan 31 15:28:30 dbhost03 kernel: [514593.058401] -----------------------------------------------------------------------------
Jan 31 15:28:30 dbhost03 kernel: [514593.058401]
Jan 31 15:28:30 dbhost03 kernel: [514593.069456] INFO: Slab 0xffffea002005dbc0 objects=42 used=37 fp=0xffff88080176f360 flags=0x200000000000080
Jan 31 15:28:30 dbhost03 kernel: [514593.080393] Pid: 8102, comm: rmmod Tainted: G    B        3.7.2-vs2.3.5.5-rol-em64t #3
Jan 31 15:28:30 dbhost03 kernel: [514593.089388] Call Trace:
Jan 31 15:28:30 dbhost03 kernel: [514593.092246]  [<ffffffff8117c24f>] slab_err+0xaf/0xd0
Jan 31 15:28:30 dbhost03 kernel: [514593.097930]  [<ffffffff8169f0b9>] ? printk+0x61/0x63
Jan 31 15:28:30 dbhost03 kernel: [514593.103601]  [<ffffffff811807f9>] ? __kmem_cache_shutdown+0x139/0x310
Jan 31 15:28:30 dbhost03 kernel: [514593.110936]  [<ffffffff8118081d>] __kmem_cache_shutdown+0x15d/0x310
Jan 31 15:28:30 dbhost03 kernel: [514593.118068]  [<ffffffff8115365b>] kmem_cache_destroy+0x5b/0x100
Jan 31 15:28:30 dbhost03 kernel: [514593.124808]  [<ffffffffa040f7c2>] drbd_destroy_mempools+0x92/0x120 [drbd]
Jan 31 15:28:30 dbhost03 kernel: [514593.132509]  [<ffffffffa0411ea5>] drbd_cleanup+0x305/0x340 [drbd]
Jan 31 15:28:30 dbhost03 kernel: [514593.139447]  [<ffffffff810c5a02>] sys_delete_module+0x152/0x280
Jan 31 15:28:30 dbhost03 kernel: [514593.146189]  [<ffffffff816ac72e>] ? do_page_fault+0xe/0x10
Jan 31 15:28:30 dbhost03 kernel: [514593.152444]  [<ffffffff816b0e19>] system_call_fastpath+0x16/0x1b
Jan 31 15:28:30 dbhost03 kernel: [514593.159284] INFO: Object 0xffff88080176f000 @offset=0
Jan 31 15:28:30 dbhost03 kernel: [514593.165050] INFO: Object 0xffff88080176f060 @offset=96
Jan 31 15:28:30 dbhost03 kernel: [514593.170915] INFO: Object 0xffff88080176f0c0 @offset=192
Jan 31 15:28:30 dbhost03 kernel: [514593.176881] INFO: Object 0xffff88080176f120 @offset=288
Jan 31 15:28:30 dbhost03 kernel: [514593.182845] INFO: Object 0xffff88080176f180 @offset=384
Jan 31 15:28:30 dbhost03 kernel: [514593.188810] INFO: Object 0xffff88080176f1e0 @offset=480
Jan 31 15:28:30 dbhost03 kernel: [514593.194770] INFO: Object 0xffff88080176f240 @offset=576
Jan 31 15:28:30 dbhost03 kernel: [514593.200734] INFO: Object 0xffff88080176f2a0 @offset=672
Jan 31 15:28:30 dbhost03 kernel: [514593.206700] INFO: Object 0xffff88080176f3c0 @offset=960
Jan 31 15:28:30 dbhost03 kernel: [514593.212662] INFO: Object 0xffff88080176f420 @offset=1056
Jan 31 15:28:30 dbhost03 kernel: [514593.218730] INFO: Object 0xffff88080176f4e0 @offset=1248
Jan 31 15:28:30 dbhost03 kernel: [514593.224799] INFO: Object 0xffff88080176f540 @offset=1344
Jan 31 15:28:30 dbhost03 kernel: [514593.230858] INFO: Object 0xffff88080176f5a0 @offset=1440
Jan 31 15:28:30 dbhost03 kernel: [514593.236922] INFO: Object 0xffff88080176f600 @offset=1536
Jan 31 15:28:30 dbhost03 kernel: [514593.242981] INFO: Object 0xffff88080176f660 @offset=1632
Jan 31 15:28:30 dbhost03 kernel: [514593.249042] INFO: Object 0xffff88080176f6c0 @offset=1728
Jan 31 15:28:30 dbhost03 kernel: [514593.255111] INFO: Object 0xffff88080176f720 @offset=1824
Jan 31 15:28:30 dbhost03 kernel: [514593.261170] INFO: Object 0xffff88080176f780 @offset=1920
Jan 31 15:28:30 dbhost03 kernel: [514593.267234] INFO: Object 0xffff88080176f7e0 @offset=2016
Jan 31 15:28:30 dbhost03 kernel: [514593.273294] INFO: Object 0xffff88080176f840 @offset=2112
Jan 31 15:28:30 dbhost03 kernel: [514593.279355] INFO: Object 0xffff88080176f8a0 @offset=2208
Jan 31 15:28:30 dbhost03 kernel: [514593.285417] INFO: Object 0xffff88080176f900 @offset=2304
Jan 31 15:28:30 dbhost03 kernel: [514593.291477] INFO: Object 0xffff88080176f960 @offset=2400
Jan 31 15:28:30 dbhost03 kernel: [514593.297543] INFO: Object 0xffff88080176f9c0 @offset=2496
Jan 31 15:28:30 dbhost03 kernel: [514593.303602] INFO: Object 0xffff88080176fa20 @offset=2592
Jan 31 15:28:30 dbhost03 kernel: [514593.309666] INFO: Object 0xffff88080176fa80 @offset=2688
Jan 31 15:28:30 dbhost03 kernel: [514593.315729] INFO: Object 0xffff88080176fae0 @offset=2784
Jan 31 15:28:30 dbhost03 kernel: [514593.321788] INFO: Object 0xffff88080176fb40 @offset=2880
Jan 31 15:28:30 dbhost03 kernel: [514593.327853] INFO: Object 0xffff88080176fba0 @offset=2976
Jan 31 15:28:30 dbhost03 kernel: [514593.335873] INFO: Object 0xffff88080176fc00 @offset=3072
Jan 31 15:28:30 dbhost03 kernel: [514593.341932] INFO: Object 0xffff88080176fc60 @offset=3168
Jan 31 15:28:30 dbhost03 kernel: [514593.347996] INFO: Object 0xffff88080176fd80 @offset=3456
Jan 31 15:28:30 dbhost03 kernel: [514593.354054] INFO: Object 0xffff88080176fde0 @offset=3552
Jan 31 15:28:30 dbhost03 kernel: [514593.360115] INFO: Object 0xffff88080176fe40 @offset=3648
Jan 31 15:28:30 dbhost03 kernel: [514593.366178] INFO: Object 0xffff88080176fea0 @offset=3744
Jan 31 15:28:30 dbhost03 kernel: [514593.372238] INFO: Object 0xffff88080176ff00 @offset=3840
Jan 31 15:28:30 dbhost03 kernel: [514593.378302] INFO: Object 0xffff88080176ff60 @offset=3936
Jan 31 15:28:30 dbhost03 kernel: [514593.384359] kmem_cache_destroy kmalloc-96: Slab cache still has objects
Jan 31 15:28:30 dbhost03 kernel: [514593.391874] Pid: 8102, comm: rmmod Tainted: G    B        3.7.2-vs2.3.5.5-rol-em64t #3
Jan 31 15:28:30 dbhost03 kernel: [514593.400868] Call Trace:
Jan 31 15:28:30 dbhost03 kernel: [514593.403726]  [<ffffffff811536fd>] kmem_cache_destroy+0xfd/0x100
Jan 31 15:28:30 dbhost03 kernel: [514593.410471]  [<ffffffffa040f7c2>] drbd_destroy_mempools+0x92/0x120 [drbd]
Jan 31 15:28:30 dbhost03 kernel: [514593.418186]  [<ffffffffa0411ea5>] drbd_cleanup+0x305/0x340 [drbd]
Jan 31 15:28:30 dbhost03 kernel: [514593.425125]  [<ffffffff810c5a02>] sys_delete_module+0x152/0x280
Jan 31 15:28:30 dbhost03 kernel: [514593.431865]  [<ffffffff816ac72e>] ? do_page_fault+0xe/0x10
Jan 31 15:28:30 dbhost03 kernel: [514593.438129]  [<ffffffff816b0e19>] system_call_fastpath+0x16/0x1b
Jan 31 15:28:30 dbhost03 kernel: [514593.444971] drbd: module cleanup done.

Inserting mith modprobe seems OK:
Jan 31 15:28:21 dbhost03 kernel: [514584.100147] drbd: initialized. Version: 8.3.13 (api:88/proto:86-96)
Jan 31 15:28:21 dbhost03 kernel: [514584.107300] drbd: srcversion: ECB278A2285B40525B8362B
Jan 31 15:28:21 dbhost03 kernel: [514584.113182] drbd: registered as block device major 147
Jan 31 15:28:21 dbhost03 kernel: [514584.119067] drbd: minor_table @ 0xffff881002c0fe00

I have no idea if this is kernel or drbd related. Can you give me any hint?

many thanks
Urban




More information about the drbd-user mailing list