Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.
Hi, This happen when I was trying to stop a resource on the Secondary. I'm using Centos 5, drbd 8.3.10 and Infiniband for replication. It this that ofed bug, in centos 5 packages? block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967295 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967294 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967293 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967292 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967291 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967290 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967289 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967288 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967287 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967286 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967285 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967284 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967283 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967282 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967281 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967280 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967279 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967278 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967277 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967276 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967275 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967274 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967273 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967272 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967271 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967270 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967269 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967268 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967267 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967266 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967265 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967264 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967263 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967262 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967261 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967260 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967259 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967258 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967257 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967256 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967255 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967254 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967253 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967252 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967251 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967250 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967249 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967248 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967247 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967246 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967245 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967244 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967243 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967242 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967241 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967240 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967239 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967238 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967237 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967236 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967235 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967234 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967233 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967232 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967231 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967230 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967229 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967228 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967227 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967226 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967225 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967224 INFO: task cqueue/9:494 blocked for more than 120 seconds. "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. cqueue/9 D ffffffff80154697 0 494 267 495 493 (L-TLB) ffff81063f4d3cf0 0000000000000046 0000000000000001 0000000000000001 ffff81063f9bb860 000000000000000a ffff81033f9e1820 ffff81063f729100 00049c4c680435e9 0000000000000ba9 ffff81033f9e1a08 0000000900000000 Call Trace: [<ffffffff80154697>] __next_cpu+0x19/0x28 [<ffffffff8008d349>] find_busiest_group+0x20d/0x621 [<ffffffff80063c53>] __mutex_lock_slowpath+0x60/0x9b [<ffffffff80063c9d>] .text.lock.mutex+0xf/0x14 [<ffffffff8002dfd7>] __wake_up+0x38/0x4f [<ffffffff887b7682>] :drbd:drbd_set_role+0x51/0x50f [<ffffffff8005bd8c>] cache_alloc_refill+0x108/0x188 [<ffffffff887b7b50>] :drbd:drbd_nl_secondary+0x10/0x17 [<ffffffff887b8b21>] :drbd:drbd_connector_callback+0xf1/0x1b1 [<ffffffff801c3d18>] cn_queue_wrapper+0x0/0x23 [<ffffffff801c3d23>] cn_queue_wrapper+0xb/0x23 [<ffffffff8004d311>] run_workqueue+0x9e/0xfb [<ffffffff80049b20>] worker_thread+0x0/0x122 [<ffffffff800a2be5>] keventd_create_kthread+0x0/0xc4 [<ffffffff80049c10>] worker_thread+0xf0/0x122 [<ffffffff8008e7f7>] default_wake_function+0x0/0xe [<ffffffff800a2be5>] keventd_create_kthread+0x0/0xc4 [<ffffffff80032722>] kthread+0xfe/0x132 [<ffffffff8009f808>] request_module+0x0/0x14d [<ffffffff8005dfb1>] child_rip+0xa/0x11 [<ffffffff800a2be5>] keventd_create_kthread+0x0/0xc4 [<ffffffff80032624>] kthread+0x0/0x132 [<ffffffff8005dfa7>] child_rip+0x0/0x11 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967223 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967222 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967221 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967220 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967219 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967218 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967217 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967216 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967215 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967214 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967213 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967212 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967211 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967210 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967209 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967208 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967207 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967206 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967205 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967204 INFO: task cqueue/9:494 blocked for more than 120 seconds. "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. cqueue/9 D ffffffff80154697 0 494 267 495 493 (L-TLB) ffff81063f4d3cf0 0000000000000046 0000000000000001 0000000000000001 ffff81063f9bb860 000000000000000a ffff81033f9e1820 ffff81063f729100 00049c4c680435e9 0000000000000ba9 ffff81033f9e1a08 0000000900000000 Call Trace: [<ffffffff80154697>] __next_cpu+0x19/0x28 [<ffffffff8008d349>] find_busiest_group+0x20d/0x621 [<ffffffff80063c53>] __mutex_lock_slowpath+0x60/0x9b [<ffffffff80063c9d>] .text.lock.mutex+0xf/0x14 [<ffffffff8002dfd7>] __wake_up+0x38/0x4f [<ffffffff887b7682>] :drbd:drbd_set_role+0x51/0x50f [<ffffffff8005bd8c>] cache_alloc_refill+0x108/0x188 [<ffffffff887b7b50>] :drbd:drbd_nl_secondary+0x10/0x17 [<ffffffff887b8b21>] :drbd:drbd_connector_callback+0xf1/0x1b1 [<ffffffff801c3d18>] cn_queue_wrapper+0x0/0x23 [<ffffffff801c3d23>] cn_queue_wrapper+0xb/0x23 [<ffffffff8004d311>] run_workqueue+0x9e/0xfb [<ffffffff80049b20>] worker_thread+0x0/0x122 [<ffffffff800a2be5>] keventd_create_kthread+0x0/0xc4 [<ffffffff80049c10>] worker_thread+0xf0/0x122 [<ffffffff8008e7f7>] default_wake_function+0x0/0xe [<ffffffff800a2be5>] keventd_create_kthread+0x0/0xc4 [<ffffffff80032722>] kthread+0xfe/0x132 [<ffffffff8009f808>] request_module+0x0/0x14d [<ffffffff8005dfb1>] child_rip+0xa/0x11 [<ffffffff800a2be5>] keventd_create_kthread+0x0/0xc4 [<ffffffff80032624>] kthread+0x0/0x132 [<ffffffff8005dfa7>] child_rip+0x0/0x11 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967203 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967202 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967201 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967200 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967199 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967198 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967197 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967196 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967195 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967194 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967193 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967192 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967191 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967190 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967189 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967188 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967187 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967186 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967185 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967184 INFO: task cqueue/9:494 blocked for more than 120 seconds. "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. cqueue/9 D ffffffff80154697 0 494 267 495 493 (L-TLB) ffff81063f4d3cf0 0000000000000046 0000000000000001 0000000000000001 ffff81063f9bb860 000000000000000a ffff81033f9e1820 ffff81063f729100 00049c4c680435e9 0000000000000ba9 ffff81033f9e1a08 0000000900000000 Call Trace: [<ffffffff80154697>] __next_cpu+0x19/0x28 [<ffffffff8008d349>] find_busiest_group+0x20d/0x621 [<ffffffff80063c53>] __mutex_lock_slowpath+0x60/0x9b [<ffffffff80063c9d>] .text.lock.mutex+0xf/0x14 [<ffffffff8002dfd7>] __wake_up+0x38/0x4f [<ffffffff887b7682>] :drbd:drbd_set_role+0x51/0x50f [<ffffffff8005bd8c>] cache_alloc_refill+0x108/0x188 [<ffffffff887b7b50>] :drbd:drbd_nl_secondary+0x10/0x17 [<ffffffff887b8b21>] :drbd:drbd_connector_callback+0xf1/0x1b1 [<ffffffff801c3d18>] cn_queue_wrapper+0x0/0x23 [<ffffffff801c3d23>] cn_queue_wrapper+0xb/0x23 [<ffffffff8004d311>] run_workqueue+0x9e/0xfb [<ffffffff80049b20>] worker_thread+0x0/0x122 [<ffffffff800a2be5>] keventd_create_kthread+0x0/0xc4 [<ffffffff80049c10>] worker_thread+0xf0/0x122 [<ffffffff8008e7f7>] default_wake_function+0x0/0xe [<ffffffff800a2be5>] keventd_create_kthread+0x0/0xc4 [<ffffffff80032722>] kthread+0xfe/0x132 [<ffffffff8009f808>] request_module+0x0/0x14d [<ffffffff8005dfb1>] child_rip+0xa/0x11 [<ffffffff800a2be5>] keventd_create_kthread+0x0/0xc4 [<ffffffff80032624>] kthread+0x0/0x132 [<ffffffff8005dfa7>] child_rip+0x0/0x11 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967183 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967182 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967181 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967180 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967179 block drbd0: [cqueue/14/499] sock_sendmsg time expired, ko = 4294967178 Cheers, -- Igor Neves<igor.neves at 3gnt.net> 3GNTW - Tecnologias de Informação, Lda SIP: igor at 3gnt.net MSN: igor at 3gnt.net JID: igor at 3gnt.net PSTN: 00351 252377120 -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.linbit.com/pipermail/drbd-user/attachments/20111006/9da816ce/attachment.htm>