Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.
Hi, I'm running 2.6.22.1 with 8.0.4 (also tried 8.0.5) on a Testsystem. The drbd itself is located on lvm. Since using 2.6.22.1 some problems with DRBD appeared: under several conditions I can lead an operation on a drbd-device to 'hang' in D state. It is best triggered by disconnecting the secondary node of a running drbd-'cluster' via drbdadm disconnect|down <device> and running I/O operations on primary node (like rm or even a recovery mount of xfs). Trying to reconnect at this time isnt possible (secondary is starting until WFBitMapT, primary ends in WFReportParams with drbd_receive in 'D' state too (see trace at end of mail). On the same cluster running 2.6.20.2 (and earlier) I never had similar problems (and they arent reproducable as on .22). Some traces (doing an rm -r on xfs on drbd) (only process in D state, (I can provide full trace if needed). Though this seems to be kernel-related I prefer to post it here rather then on lkml for easier track down. Thanks Jens Beyer ==================================================================================================== Aug 21 11:14:20 boxfe02 kernel: [ 1477.079000] xfsbufd D 000001208fb9b9ad 0 14878 2 (L-TLB) Aug 21 11:14:20 boxfe02 kernel: [ 1477.079017] ffff81010bb75c00 0000000000000046 0000000000000000 ffff81011b74f7d0 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079038] ffff81010bb75be0 ffffffff804b6080 ffffffff80551100 000000010001509c Aug 21 11:14:20 boxfe02 kernel: [ 1477.079058] 000000000bb75b90 ffff81011b71c9a8 0000000000000171 ffffffff804b6080 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079078] Call Trace: Aug 21 11:14:20 boxfe02 kernel: [ 1477.079100] [<ffffffff88144e8e>] :drbd:lc_find+0x1e/0x60 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079120] [<ffffffff881435d7>] :drbd:drbd_al_begin_io+0x267/0x320 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079131] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079139] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079150] [<ffffffff802ad1ac>] __bio_clone+0x9c/0xc0 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079170] [<ffffffff88140803>] :drbd:drbd_make_request_common+0x5b3/0xb90 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079179] [<ffffffff80302130>] elv_rb_add+0x70/0x80 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079188] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079196] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079207] [<ffffffff80304014>] generic_make_request+0x1c4/0x260 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079216] [<ffffffff8030410e>] submit_bio+0x5e/0xf0 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079224] [<ffffffff802ad01b>] __bio_add_page+0x1ab/0x220 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079259] [<ffffffff88296870>] :xfs:_xfs_buf_ioapply+0x230/0x2e0 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079292] [<ffffffff88297659>] :xfs:xfs_buf_iorequest+0x29/0x70 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079324] [<ffffffff8829bda5>] :xfs:xfs_bdstrat_cb+0x35/0x50 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079355] [<ffffffff88297902>] :xfs:xfsbufd+0x92/0x150 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079387] [<ffffffff88297870>] :xfs:xfsbufd+0x0/0x150 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079394] [<ffffffff8024294c>] kthread+0x6c/0xa0 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079403] [<ffffffff8020ac78>] child_rip+0xa/0x12 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079412] [<ffffffff802428e0>] kthread+0x0/0xa0 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079419] [<ffffffff8020ac6e>] child_rip+0x0/0x12 Aug 21 11:14:20 boxfe02 kernel: [ 1477.079424] Aug 21 11:14:20 boxfe02 kernel: [ 1477.082992] Aug 21 11:14:20 boxfe02 kernel: [ 1477.082997] rm D 0000011a7687dbb8 0 15156 13547 (NOTLB) Aug 21 11:14:20 boxfe02 kernel: [ 1477.083014] ffff8101191af7e8 0000000000000082 0000000000000000 ffff8101191af87c Aug 21 11:14:20 boxfe02 kernel: [ 1477.083034] ffff8101191af880 ffffffff8825359b 0000000100000246 0000000100014656 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083059] 0000000308cd8080 ffff81004f9e8a68 000000000002c3ae ffff81011be057d0 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083078] Call Trace: Aug 21 11:14:20 boxfe02 kernel: [ 1477.083109] [<ffffffff8825359b>] :xfs:xfs_bmap_search_multi_extents+0x10b/0x120 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083121] [<ffffffff804041b1>] wait_for_completion+0xa1/0x100 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083131] [<ffffffff80228f70>] default_wake_function+0x0/0x10 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083142] [<ffffffff80228f70>] default_wake_function+0x0/0x10 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083163] [<ffffffff88143938>] :drbd:_drbd_md_sync_page_io+0xc8/0x130 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083186] [<ffffffff881442fc>] :drbd:drbd_md_sync_page_io+0x29c/0x4f0 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083204] [<ffffffff881317a0>] :drbd:drbd_bm_get_lel+0x130/0x220 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083223] [<ffffffff88132a58>] :drbd:drbd_bm_write_sect+0xc8/0x220 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083243] [<ffffffff8814353d>] :drbd:drbd_al_begin_io+0x1cd/0x320 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083252] [<ffffffff80264f99>] mempool_alloc+0x39/0x110 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083262] [<ffffffff80264f99>] mempool_alloc+0x39/0x110 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083271] [<ffffffff80281d99>] cache_alloc_refill+0x199/0x500 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083280] [<ffffffff802ad1ac>] __bio_clone+0x9c/0xc0 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083298] [<ffffffff88140803>] :drbd:drbd_make_request_common+0x5b3/0xb90 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083309] [<ffffffff80302130>] elv_rb_add+0x70/0x80 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083317] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083326] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083337] [<ffffffff80304014>] generic_make_request+0x1c4/0x260 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083346] [<ffffffff8030410e>] submit_bio+0x5e/0xf0 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083354] [<ffffffff802ad01b>] __bio_add_page+0x1ab/0x220 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083390] [<ffffffff88296870>] :xfs:_xfs_buf_ioapply+0x230/0x2e0 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083422] [<ffffffff88297659>] :xfs:xfs_buf_iorequest+0x29/0x70 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083454] [<ffffffff8829bda5>] :xfs:xfs_bdstrat_cb+0x35/0x50 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083486] [<ffffffff88297a04>] :xfs:xfs_buf_iostart+0x44/0xa0 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083522] [<ffffffff88287ed8>] :xfs:xfs_trans_push_ail+0x1f8/0x280 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083556] [<ffffffff8827d374>] :xfs:xfs_log_reserve+0x74/0xf0 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083591] [<ffffffff882874cf>] :xfs:xfs_trans_reserve+0xaf/0x200 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083624] [<ffffffff88293ae2>] :xfs:kmem_zone_zalloc+0x32/0x50 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083659] [<ffffffff882743a1>] :xfs:xfs_itruncate_finish+0x121/0x310 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083694] [<ffffffff8828dbeb>] :xfs:xfs_inactive+0x3fb/0x4e0 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083727] [<ffffffff8829d97c>] :xfs:xfs_fs_clear_inode+0xec/0x120 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083737] [<ffffffff8029b126>] clear_inode+0x116/0x150 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083747] [<ffffffff8029b76b>] generic_delete_inode+0x11b/0x150 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083757] [<ffffffff8029a557>] iput+0x67/0x80 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083765] [<ffffffff80291391>] do_unlinkat+0x101/0x180 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083775] [<ffffffff802931fb>] sys_getdents+0xbb/0xe0 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083785] [<ffffffff80209e5e>] system_call+0x7e/0x83 Aug 21 11:14:20 boxfe02 kernel: [ 1477.083793] ==================================================================================================== Aug 21 11:45:07 boxfe02 kernel: [ 1259.302531] xfsbufd D 0000011711d5b23b 0 15166 2 (L-TLB) Aug 21 11:45:07 boxfe02 kernel: [ 1259.302549] ffff81010f7f1c00 0000000000000046 0000000000000000 0000000000000001 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302570] 0000000000000003 ffffffff804b6080 ffffffff804c4ed8 000000010001389c Aug 21 11:45:07 boxfe02 kernel: [ 1259.302593] 0000000000000000 ffff81011be819e8 000000000000015f ffffffff804b6080 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302609] Call Trace: Aug 21 11:45:07 boxfe02 kernel: [ 1259.302630] [<ffffffff88144fee>] :drbd:lc_find+0x1e/0x60 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302648] [<ffffffff881437a7>] :drbd:drbd_al_begin_io+0x267/0x320 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302657] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302667] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302677] [<ffffffff802ad1ac>] __bio_clone+0x9c/0xc0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302697] [<ffffffff881407e0>] :drbd:drbd_make_request_common+0x5d0/0xbb0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302706] [<ffffffff80302130>] elv_rb_add+0x70/0x80 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302716] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302725] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302734] [<ffffffff80304014>] generic_make_request+0x1c4/0x260 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302743] [<ffffffff8030410e>] submit_bio+0x5e/0xf0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302751] [<ffffffff802ad01b>] __bio_add_page+0x1ab/0x220 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302784] [<ffffffff88296870>] :xfs:_xfs_buf_ioapply+0x230/0x2e0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302816] [<ffffffff88297659>] :xfs:xfs_buf_iorequest+0x29/0x70 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302849] [<ffffffff8829bda5>] :xfs:xfs_bdstrat_cb+0x35/0x50 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302881] [<ffffffff88297902>] :xfs:xfsbufd+0x92/0x150 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302913] [<ffffffff88297870>] :xfs:xfsbufd+0x0/0x150 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302920] [<ffffffff8024294c>] kthread+0x6c/0xa0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302929] [<ffffffff8020ac78>] child_rip+0xa/0x12 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302938] [<ffffffff802428e0>] kthread+0x0/0xa0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302946] [<ffffffff8020ac6e>] child_rip+0x0/0x12 Aug 21 11:45:07 boxfe02 kernel: [ 1259.302951] Aug 21 11:45:07 boxfe02 kernel: [ 1259.303206] rm D 000001105baa2609 0 15184 15247 (NOTLB) Aug 21 11:45:07 boxfe02 kernel: [ 1259.303223] ffff81011651f7a8 0000000000000082 0000000000000000 000000000000017c Aug 21 11:45:07 boxfe02 kernel: [ 1259.303245] 000000000000017c ffffffff88144fee 0000000000000246 0000000100012d55 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303266] 000000000003a2ed ffff8101177c9298 0000000000005bc0 ffffffff804b6080 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303283] Call Trace: Aug 21 11:45:07 boxfe02 kernel: [ 1259.303304] [<ffffffff88144fee>] :drbd:lc_find+0x1e/0x60 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303325] [<ffffffff88144fee>] :drbd:lc_find+0x1e/0x60 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303334] [<ffffffff804041b1>] wait_for_completion+0xa1/0x100 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303343] [<ffffffff80228f70>] default_wake_function+0x0/0x10 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303351] [<ffffffff80228f70>] default_wake_function+0x0/0x10 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303372] [<ffffffff88143b1d>] :drbd:_drbd_md_sync_page_io+0xcd/0x130 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303391] [<ffffffff88144468>] :drbd:drbd_md_sync_page_io+0x298/0x4e0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303408] [<ffffffff881317a0>] :drbd:drbd_bm_get_lel+0x130/0x220 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303427] [<ffffffff88132958>] :drbd:drbd_bm_write_sect+0xc8/0x220 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303447] [<ffffffff8814370d>] :drbd:drbd_al_begin_io+0x1cd/0x320 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303456] [<ffffffff80264f99>] mempool_alloc+0x39/0x110 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303465] [<ffffffff802ad1ac>] __bio_clone+0x9c/0xc0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303484] [<ffffffff881407e0>] :drbd:drbd_make_request_common+0x5d0/0xbb0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303492] [<ffffffff80301ba9>] elv_next_request+0x49/0x1a0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303501] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303509] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303520] [<ffffffff80304014>] generic_make_request+0x1c4/0x260 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303529] [<ffffffff8030410e>] submit_bio+0x5e/0xf0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303538] [<ffffffff802ad01b>] __bio_add_page+0x1ab/0x220 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303571] [<ffffffff88296870>] :xfs:_xfs_buf_ioapply+0x230/0x2e0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303603] [<ffffffff88297659>] :xfs:xfs_buf_iorequest+0x29/0x70 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303635] [<ffffffff8829bda5>] :xfs:xfs_bdstrat_cb+0x35/0x50 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303666] [<ffffffff88297a04>] :xfs:xfs_buf_iostart+0x44/0xa0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303700] [<ffffffff88287ed8>] :xfs:xfs_trans_push_ail+0x1f8/0x280 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303735] [<ffffffff8827d374>] :xfs:xfs_log_reserve+0x74/0xf0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303769] [<ffffffff882874cf>] :xfs:xfs_trans_reserve+0xaf/0x200 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303800] [<ffffffff88293ae2>] :xfs:kmem_zone_zalloc+0x32/0x50 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303832] [<ffffffff882522c3>] :xfs:xfs_bmap_finish+0xe3/0x1a0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303866] [<ffffffff8827447c>] :xfs:xfs_itruncate_finish+0x1fc/0x310 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303904] [<ffffffff8828dbeb>] :xfs:xfs_inactive+0x3fb/0x4e0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303936] [<ffffffff8829d97c>] :xfs:xfs_fs_clear_inode+0xec/0x120 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303945] [<ffffffff8029b126>] clear_inode+0x116/0x150 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303952] [<ffffffff8029b76b>] generic_delete_inode+0x11b/0x150 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303960] [<ffffffff8029a557>] iput+0x67/0x80 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303969] [<ffffffff80291391>] do_unlinkat+0x101/0x180 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303977] [<ffffffff802931fb>] sys_getdents+0xbb/0xe0 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303988] [<ffffffff80209e5e>] system_call+0x7e/0x83 Aug 21 11:45:07 boxfe02 kernel: [ 1259.303995] ==================================================================================================== Aug 23 10:28:05 boxfe02 kernel: [ 1385.706135] mount D 000000fd9a44800b 0 13848 13807 (NOTLB) Aug 23 10:28:05 boxfe02 kernel: [ 1385.706202] ffff8101159cd4a8 0000000000000086 0000000000000000 ffffffff802254ad Aug 23 10:28:05 boxfe02 kernel: [ 1385.706242] ffff810005737598 0000000000000001 0000000000011200 0000000100010aae Aug 23 10:28:05 boxfe02 kernel: [ 1385.706309] 0000000200000000 ffff8101173c7968 0000000000000f4f ffff81011bf05750 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706376] Call Trace: Aug 23 10:28:05 boxfe02 kernel: [ 1385.706437] [<ffffffff802254ad>] find_busiest_group+0x19d/0x810 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706449] [<ffffffff804041b1>] wait_for_completion+0xa1/0x100 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706484] [<ffffffff80228f70>] default_wake_function+0x0/0x10 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706493] [<ffffffff80228f70>] default_wake_function+0x0/0x10 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706518] [<ffffffff88143938>] :drbd:_drbd_md_sync_page_io+0xc8/0x130 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706544] [<ffffffff881442fc>] :drbd:drbd_md_sync_page_io+0x29c/0x4f0 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706565] [<ffffffff881317a0>] :drbd:drbd_bm_get_lel+0x130/0x220 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706665] [<ffffffff88132a58>] :drbd:drbd_bm_write_sect+0xc8/0x220 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706742] [<ffffffff8814353d>] :drbd:drbd_al_begin_io+0x1cd/0x320 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706752] [<ffffffff80264f99>] mempool_alloc+0x39/0x110 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706787] [<ffffffff80264f99>] mempool_alloc+0x39/0x110 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706834] [<ffffffff88297a3b>] :xfs:xfs_buf_iostart+0x7b/0xa0 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706872] [<ffffffff802ad1ac>] __bio_clone+0x9c/0xc0 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706897] [<ffffffff88140803>] :drbd:drbd_make_request_common+0x5b3/0xb90 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706907] [<ffffffff80302130>] elv_rb_add+0x70/0x80 Aug 23 10:28:05 boxfe02 kernel: [ 1385.706969] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707004] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707014] [<ffffffff80304014>] generic_make_request+0x1c4/0x260 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707023] [<ffffffff803155e6>] vsnprintf+0x366/0x650 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707032] [<ffffffff8030410e>] submit_bio+0x5e/0xf0 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707041] [<ffffffff802ad01b>] __bio_add_page+0x1ab/0x220 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707111] [<ffffffff88296870>] :xfs:_xfs_buf_ioapply+0x230/0x2e0 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707154] [<ffffffff88297659>] :xfs:xfs_buf_iorequest+0x29/0x70 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707224] [<ffffffff8829bda5>] :xfs:xfs_bdstrat_cb+0x35/0x50 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707265] [<ffffffff88297712>] :xfs:xfs_flush_buftarg+0x72/0x170 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707336] [<ffffffff882811a9>] :xfs:xlog_do_recover+0x49/0x170 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707379] [<ffffffff88282452>] :xfs:xlog_recover+0x82/0xa0 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707421] [<ffffffff8827c91c>] :xfs:xfs_log_mount+0x8c/0x120 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707464] [<ffffffff88284661>] :xfs:xfs_mountfs+0x621/0xa00 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707502] [<ffffffff8031026e>] _atomic_dec_and_lock+0x4e/0x70 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707571] [<ffffffff88295f3d>] :xfs:xfs_setsize_buftarg_flags+0x3d/0xc0 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707615] [<ffffffff8828b102>] :xfs:xfs_mount+0x3c2/0x770 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707658] [<ffffffff8829e9d3>] :xfs:vfs_mount+0x33/0x40 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707700] [<ffffffff8829de5c>] :xfs:xfs_fs_fill_super+0x9c/0x200 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707710] [<ffffffff804052b6>] __down_write_nested+0x96/0xa0 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707719] [<ffffffff8031452e>] strlcpy+0x4e/0x80 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707753] [<ffffffff8029cd12>] get_filesystem+0x12/0x40 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707789] [<ffffffff8028722b>] sget+0x32b/0x380 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707798] [<ffffffff80287d5d>] get_sb_bdev+0x12d/0x180 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707839] [<ffffffff8829ddc0>] :xfs:xfs_fs_fill_super+0x0/0x200 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707875] [<ffffffff80282497>] kmem_cache_zalloc+0x57/0x80 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707885] [<ffffffff80287912>] vfs_kern_mount+0x62/0xc0 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707894] [<ffffffff802879cd>] do_kern_mount+0x4d/0x110 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707903] [<ffffffff8029f51c>] do_mount+0x44c/0x740 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707912] [<ffffffff80270334>] __handle_mm_fault+0x404/0xae0 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707949] [<ffffffff80405959>] _spin_lock_irqsave+0x9/0x10 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707983] [<ffffffff80313dd1>] __up_read+0x21/0xc0 Aug 23 10:28:05 boxfe02 kernel: [ 1385.707993] [<ffffffff80407a62>] do_page_fault+0x1d2/0x800 Aug 23 10:28:05 boxfe02 kernel: [ 1385.708003] [<ffffffff802902bf>] do_path_lookup+0xdf/0x260 Aug 23 10:28:05 boxfe02 kernel: [ 1385.708012] [<ffffffff80291935>] __user_walk_fd+0x55/0x80 Aug 23 10:28:05 boxfe02 kernel: [ 1385.708024] [<ffffffff802674fb>] __alloc_pages+0x5b/0x320 Aug 23 10:28:05 boxfe02 kernel: [ 1385.708060] [<ffffffff80267865>] __get_free_pages+0x35/0x70 Aug 23 10:28:05 boxfe02 kernel: [ 1385.708069] [<ffffffff8029f8ac>] sys_mount+0x9c/0xf0 Aug 23 10:28:05 boxfe02 kernel: [ 1385.708079] [<ffffffff80209e5e>] system_call+0x7e/0x83 Aug 23 10:28:05 boxfe02 kernel: [ 1385.708087] =============================================================================================== Hanging drbd_receive on reconnect: [ 573.851871] drbd0_receive D 000000799a830b07 0 7175 2 (L-TLB) [ 573.851910] ffff81010caa7df0 0000000000000046 0000000000000000 ffffffff00000001 [ 573.851951] 0000000000000000 ffffffff00000001 0000000000000000 0000000100002d18 [ 573.852017] 0000000300000000 ffff8101172c12d8 000000000000055f ffff81011be057d0 [ 573.852056] Call Trace: [ 573.852079] [<ffffffff8814fd29>] :drbd:drbd_determin_dev_size+0x99/0x360 [ 573.852089] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 [ 573.852111] [<ffffffff88138f18>] :drbd:drbd_recv+0x98/0x140 [ 573.852119] [<ffffffff80242cf0>] autoremove_wake_function+0x0/0x30 [ 573.852142] [<ffffffff88139bc3>] :drbd:receive_sizes+0x393/0x650 [ 573.852164] [<ffffffff8813af59>] :drbd:drbdd+0x79/0x1a0 [ 573.852185] [<ffffffff8813c395>] :drbd:drbdd_init+0xc5/0x1f0 [ 573.852260] [<ffffffff88148994>] :drbd:drbd_thread_setup+0x84/0xf0 [ 573.852269] [<ffffffff8020ac78>] child_rip+0xa/0x12 [ 573.852291] [<ffffffff88148910>] :drbd:drbd_thread_setup+0x0/0xf0 [ 573.852299] [<ffffffff8020ac6e>] child_rip+0x0/0x12 [ 573.852331] -- Dr. Jens Beyer IT-Systemarchitekt 1&1 Internet AG IT-Portal Brauerstrasse 48 - D-76135 Karlsruhe Tel. +49-721-91374-4245 jens.beyer at 1und1.de - http://1und1.de