Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.
I built a two node cluster using drbd. After several drbdadm primary/secondary operations, the drbd status turn to Unconnected and drbdadm disconnect operation hangup and the following message occurs in dmesg. Oct 20 11:32:26 cgsl42 kernel: INFO: task cqueue:3267 blocked for more than 120 seconds. Oct 20 11:32:26 cgsl42 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Oct 20 11:32:26 cgsl42 kernel: cqueue D 0000000000000007 0 3267 2 0x00000080 Oct 20 11:32:26 cgsl42 kernel: ffff88046c02da20 0000000000000046 0000000000000000 ffff880400000000 Oct 20 11:32:26 cgsl42 kernel: ffff88046c02d980 ffff88046c02d980 ffff88046c02d9c0 ffffffff81064d74 Oct 20 11:32:26 cgsl42 kernel: ffff880471e7f078 ffff88046c02dfd8 000000000000f4e8 ffff880471e7f078 Oct 20 11:32:26 cgsl42 kernel: Call Trace: Oct 20 11:32:26 cgsl42 kernel: [<ffffffff81064d74>] ? enqueue_task_fair+0x64/0x100 Oct 20 11:32:26 cgsl42 kernel: [<ffffffffa04793b5>] _drbd_request_state+0xb5/0x130 [drbd] Oct 20 11:32:26 cgsl42 kernel: [<ffffffff81091570>] ? autoremove_wake_function+0x0/0x40 Oct 20 11:32:26 cgsl42 kernel: [<ffffffffa047f156>] drbd_nl_disconnect+0x176/0x5c0 [drbd] Oct 20 11:32:26 cgsl42 kernel: [<ffffffff81064d74>] ? enqueue_task_fair+0x64/0x100 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff81059507>] ? enqueue_task+0x77/0x90 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff8105f1da>] ? try_to_wake_up+0xca/0x420 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff81271849>] ? cpumask_next_and+0x29/0x50 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff81054754>] ? find_busiest_group+0x244/0xb20 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff81190396>] ? pollwake+0x56/0x60 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff81055c83>] ? perf_event_task_sched_out+0x33/0x80 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff810096f0>] ? __switch_to+0xd0/0x320 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff814f6085>] ? thread_return+0x53/0x7be Oct 20 11:32:26 cgsl42 kernel: [<ffffffff8116400c>] ? __kmalloc+0x20c/0x220 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff8133f441>] ? cn_queue_wrapper+0x31/0x50 Oct 20 11:32:26 cgsl42 kernel: [<ffffffffa048049f>] drbd_connector_callback+0x13f/0x2b0 [drbd] Oct 20 11:32:26 cgsl42 kernel: [<ffffffff8133f410>] ? cn_queue_wrapper+0x0/0x50 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff8133f438>] cn_queue_wrapper+0x28/0x50 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff8108bb90>] worker_thread+0x170/0x2b0 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff81091570>] ? autoremove_wake_function+0x0/0x40 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff8108ba20>] ? worker_thread+0x0/0x2b0 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff81091206>] kthread+0x96/0xa0 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff8100c14a>] child_rip+0xa/0x20 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff81091170>] ? kthread+0x0/0xa0 Oct 20 11:32:26 cgsl42 kernel: [<ffffffff8100c140>] ? child_rip+0x0/0x20