[DRBD-user] Frequent crashes with DRBD 8.4.x

Tim Evers it at niemail.de
Sun Feb 7 12:08:19 CET 2016

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


Hi,

we are seeing multiple kernel crashes on one debian jessie cluster, both
with an older backports kernel (4.2) and a present one (4.3).

Systems are farily new E5-2620 v3 Supermicro, running as Xen dom0 (4.4.1).

Any idea what might be happening here?

Thanks for any help

Tim

(Sorry for the weird formatting, I obtained the messages through the
serial net console)

Incident 1, Host xen1:

Feb  5 08:52:16 10.15.19.1 [1540674.252834] general protection fault:
0000 [#1]
Feb  5 08:52:16 SMP
Feb  5 08:52:16 10.15.19.1
Feb  5 08:52:16 10.15.19.1 [1540674.253657] Modules linked in:
Feb  5 08:52:16 10.15.19.1  binfmt_misc
Feb  5 08:52:16 10.15.19.1  netconsole
Feb  5 08:52:16 10.15.19.1  configfs
Feb  5 08:52:16 10.15.19.1  xt_physdev
Feb  5 08:52:16 10.15.19.1  br_netfilter
Feb  5 08:52:16 10.15.19.1  iptable_filter
Feb  5 08:52:16 10.15.19.1  ip_tables
Feb  5 08:52:16 10.15.19.1  x_tables
Feb  5 08:52:16 10.15.19.1  xen_netback
Feb  5 08:52:16 10.15.19.1  tun
Feb  5 08:52:16 10.15.19.1  xen_blkback
Feb  5 08:52:16 10.15.19.1  xen_gntdev
Feb  5 08:52:16 10.15.19.1  xen_evtchn
Feb  5 08:52:16 10.15.19.1  xenfs
Feb  5 08:52:16 10.15.19.1  xen_privcmd
Feb  5 08:52:16 10.15.19.1  nfsd
Feb  5 08:52:16 10.15.19.1  auth_rpcgss
Feb  5 08:52:16 10.15.19.1  oid_registry
Feb  5 08:52:16 10.15.19.1  nfs_acl
Feb  5 08:52:16 10.15.19.1  nfs
Feb  5 08:52:16 10.15.19.1  lockd
Feb  5 08:52:16 10.15.19.1  grace
Feb  5 08:52:16 10.15.19.1  fscache
Feb  5 08:52:16 10.15.19.1  sunrpc
Feb  5 08:52:16 10.15.19.1  8021q
Feb  5 08:52:16 10.15.19.1  garp
Feb  5 08:52:16 10.15.19.1  mrp
Feb  5 08:52:16 10.15.19.1  bridge
Feb  5 08:52:16 10.15.19.1  stp
Feb  5 08:52:16 10.15.19.1  llc
Feb  5 08:52:16 10.15.19.1  dm_cache_smq
Feb  5 08:52:16 10.15.19.1  dm_cache
Feb  5 08:52:16 10.15.19.1  dm_persistent_data
Feb  5 08:52:16 10.15.19.1  dm_bio_prison
Feb  5 08:52:16 10.15.19.1  dm_bufio
Feb  5 08:52:16 10.15.19.1  x86_pkg_temp_thermal
Feb  5 08:52:16 10.15.19.1  intel_powerclamp
Feb  5 08:52:16 10.15.19.1  intel_rapl
Feb  5 08:52:16 10.15.19.1  iosf_mbi
Feb  5 08:52:16 10.15.19.1  iTCO_wdt
Feb  5 08:52:16 10.15.19.1  iTCO_vendor_support
Feb  5 08:52:16 10.15.19.1  coretemp
Feb  5 08:52:16 10.15.19.1  crct10dif_pclmul
Feb  5 08:52:16 10.15.19.1  crc32_pclmul
Feb  5 08:52:16 10.15.19.1  cryptd
Feb  5 08:52:16 10.15.19.1  pcspkr
Feb  5 08:52:16 10.15.19.1  ast
Feb  5 08:52:16 10.15.19.1  ttm
Feb  5 08:52:16 10.15.19.1  drm_kms_helper
Feb  5 08:52:16 10.15.19.1  sb_edac
Feb  5 08:52:16 10.15.19.1  mei_me
Feb  5 08:52:16 10.15.19.1  mei
Feb  5 08:52:16 10.15.19.1  evdev
Feb  5 08:52:16 10.15.19.1  joydev
Feb  5 08:52:16 10.15.19.1  drm
Feb  5 08:52:16 10.15.19.1  edac_core
Feb  5 08:52:16 10.15.19.1  lpc_ich
Feb  5 08:52:16 10.15.19.1  i2c_i801
Feb  5 08:52:16 10.15.19.1  mfd_core
Feb  5 08:52:16 10.15.19.1  ioatdma
Feb  5 08:52:16 10.15.19.1  shpchp
Feb  5 08:52:16 10.15.19.1  tpm_tis
Feb  5 08:52:16 10.15.19.1  tpm
Feb  5 08:52:16 10.15.19.1  wmi
Feb  5 08:52:16 10.15.19.1  ipmi_si
Feb  5 08:52:16 10.15.19.1  ipmi_msghandler
Feb  5 08:52:16 10.15.19.1  8250_fintek
Feb  5 08:52:16 10.15.19.1  processor
Feb  5 08:52:16 10.15.19.1  button
Feb  5 08:52:16 10.15.19.1  thermal_sys
Feb  5 08:52:16 10.15.19.1  acpi_power_meter
Feb  5 08:52:16 10.15.19.1  drbd
Feb  5 08:52:16 10.15.19.1  lru_cache
Feb  5 08:52:16 10.15.19.1  libcrc32c
Feb  5 08:52:16 10.15.19.1  autofs4
Feb  5 08:52:16 10.15.19.1  ext4
Feb  5 08:52:16 10.15.19.1  crc16
Feb  5 08:52:16 10.15.19.1  mbcache
Feb  5 08:52:16 10.15.19.1  jbd2
Feb  5 08:52:16 10.15.19.1  btrfs
Feb  5 08:52:16 10.15.19.1  xor
Feb  5 08:52:16 10.15.19.1  raid6_pq
Feb  5 08:52:16 10.15.19.1  dm_mod
Feb  5 08:52:16 10.15.19.1  mlx4_en
Feb  5 08:52:16 10.15.19.1  vxlan
Feb  5 08:52:16 10.15.19.1  ip6_udp_tunnel
Feb  5 08:52:16 10.15.19.1  udp_tunnel
Feb  5 08:52:16 10.15.19.1  sg
Feb  5 08:52:16 10.15.19.1  sd_mod
Feb  5 08:52:16 10.15.19.1  hid_generic
Feb  5 08:52:16 10.15.19.1  usbhid
Feb  5 08:52:16 10.15.19.1  hid
Feb  5 08:52:16 10.15.19.1  crc32c_intel
Feb  5 08:52:16 10.15.19.1  igb
Feb  5 08:52:16 10.15.19.1  i2c_algo_bit
Feb  5 08:52:16 10.15.19.1  xhci_pci
Feb  5 08:52:16 10.15.19.1  ehci_pci
Feb  5 08:52:16 10.15.19.1  ehci_hcd
Feb  5 08:52:16 10.15.19.1  xhci_hcd
Feb  5 08:52:16 10.15.19.1  dca
Feb  5 08:52:16 10.15.19.1  ptp
Feb  5 08:52:16 10.15.19.1  pps_core
Feb  5 08:52:16 10.15.19.1  usbcore
Feb  5 08:52:16 10.15.19.1  usb_common
Feb  5 08:52:16 10.15.19.1  ahci
Feb  5 08:52:16 10.15.19.1  libahci
Feb  5 08:52:16 10.15.19.1  libata
Feb  5 08:52:16 10.15.19.1  mlx4_core
Feb  5 08:52:16 10.15.19.1  3w_sas
Feb  5 08:52:16 10.15.19.1  scsi_mod
Feb  5 08:52:16 10.15.19.1
Feb  5 08:52:16 10.15.19.1 [1540674.259851] CPU: 0 PID: 30746 Comm:
drbd_r_mst19 Not tainted 4.2.0-0.bpo.1-amd64 #1 Debian 4.2.6-3~bpo8+2
Feb  5 08:52:16 10.15.19.1 [1540674.260659] Hardware name: Supermicro
X10DRL-i/X10DRL-i, BIOS 1.1 04/09/2015
Feb  5 08:52:16 10.15.19.1 [1540674.261464] task: ffff880057b885c0 ti:
ffff880072bb4000 task.ti: ffff880072bb4000
Feb  5 08:52:16 10.15.19.1 [1540674.262273] RIP: e030:[<ffffffff81163085>]
Feb  5 08:52:16 10.15.19.1  [<ffffffff81163085>] put_page+0x5/0x30
Feb  5 08:52:16 10.15.19.1 [1540674.263094] RSP: e02b:ffff880072bb7a00
EFLAGS: 00010206
Feb  5 08:52:16 10.15.19.1 [1540674.263901] RAX: 0000000000000030 RBX:
0000000000000001 RCX: 0000000000000038
Feb  5 08:52:16 10.15.19.1 [1540674.264713] RDX: ffff880057597da2 RSI:
ffff88006a60a000 RDI: 56e0e597b4d852f6
Feb  5 08:52:16 10.15.19.1 [1540674.265524] RBP: ffff880057597ec0 R08:
00000000d18eabf3 R09: 0000000000000000
Feb  5 08:52:16 10.15.19.1 [1540674.266346] R10: 00000000000003e0 R11:
0000000000000004 R12: ffff88006a60a000
Feb  5 08:52:16 10.15.19.1 [1540674.267159] R13: ffff88006b0760b8 R14:
0000000000001000 R15: ffff88006b0765d8
Feb  5 08:52:16 10.15.19.1 [1540674.267972] FS:  0000000000000000(0000)
GS:ffff880146600000(0000) knlGS:ffff880146600000
Feb  5 08:52:16 10.15.19.1 [1540674.268788] CS:  e033 DS: 0000 ES: 0000
CR0: 0000000080050033
Feb  5 08:52:16 10.15.19.1 [1540674.269599] CR2: 00007fa84ea0d000 CR3:
000000006abd9000 CR4: 0000000000042660
Feb  5 08:52:16 10.15.19.1 [1540674.270418] Stack:
Feb  5 08:52:16 10.15.19.1 [1540674.271231]  ffffffff81450eae
Feb  5 08:52:16 10.15.19.1  ffff88006a60a000
Feb  5 08:52:16 10.15.19.1  ffff88006a60a000
Feb  5 08:52:16 10.15.19.1  ffff880057597da2
Feb  5 08:52:16 10.15.19.1
Feb  5 08:52:16 10.15.19.1 [1540674.272069]  ffffffff81450d8e
Feb  5 08:52:16 10.15.19.1  ffff88006b076040
Feb  5 08:52:16 10.15.19.1  ffffffff814b5b62
Feb  5 08:52:16 10.15.19.1  ffff88013fa510f0
Feb  5 08:52:16 10.15.19.1
Feb  5 08:52:16 10.15.19.1 [1540674.272901]  ffff880004994400
Feb  5 08:52:16 10.15.19.1  0000000000000000
Feb  5 08:52:16 10.15.19.1  ffffffff812db9fd
Feb  5 08:52:16 10.15.19.1  00000000000007d0
Feb  5 08:52:16 10.15.19.1
Feb  5 08:52:16 10.15.19.1 [1540674.273732] Call Trace:
Feb  5 08:52:16 10.15.19.1 [1540674.274554]  [<ffffffff81450eae>] ?
skb_release_data+0x6e/0xd0
Feb  5 08:52:16 10.15.19.1 [1540674.275380]  [<ffffffff81450d8e>] ?
__kfree_skb+0xe/0x20
Feb  5 08:52:16 10.15.19.1 [1540674.276218]  [<ffffffff814b5b62>] ?
tcp_rcv_established+0x82/0x6d0
Feb  5 08:52:16 10.15.19.1 [1540674.277035]  [<ffffffff812db9fd>] ?
copy_page_to_iter+0x23d/0x3c0
Feb  5 08:52:16 10.15.19.1 [1540674.277847]  [<ffffffff814c0353>] ?
tcp_v4_do_rcv+0x153/0x3d0
Feb  5 08:52:16 10.15.19.1 [1540674.278653]  [<ffffffff810b0841>] ?
__raw_callee_save___pv_queued_spin_unlock+0x11/0x20
Feb  5 08:52:16 10.15.19.1 [1540674.279466]  [<ffffffff8144e225>] ?
release_sock+0x95/0x160
Feb  5 08:52:16 10.15.19.1 [1540674.280277]  [<ffffffff814ab2ef>] ?
tcp_recvmsg+0x37f/0xb80
Feb  5 08:52:16 10.15.19.1 [1540674.281091]  [<ffffffff814d68c0>] ?
inet_recvmsg+0x70/0x90
Feb  5 08:52:16 10.15.19.1 [1540674.281900]  [<ffffffff81449d9c>] ?
kernel_recvmsg+0x5c/0x80
Feb  5 08:52:16 10.15.19.1 [1540674.282711]  [<ffffffffa0462517>] ?
drbd_recv_short+0x57/0x60 [drbd]
Feb  5 08:52:16 10.15.19.1 [1540674.283538]  [<ffffffffa0462695>] ?
drbd_recv+0x25/0x180 [drbd]
Feb  5 08:52:16 10.15.19.1 [1540674.284338]  [<ffffffffa046ad07>] ?
drbd_alloc_peer_req+0x87/0x150 [drbd]
Feb  5 08:52:16 10.15.19.1 [1540674.285139]  [<ffffffffa04633a6>] ?
drbd_recv_all_warn+0x16/0x60 [drbd]
Feb  5 08:52:16 10.15.19.1 [1540674.285936]  [<ffffffffa046b0df>] ?
read_in_block.isra.45+0x25f/0x360 [drbd]
Feb  5 08:52:16 10.15.19.1 [1540674.286750]  [<ffffffffa046b67b>] ?
receive_Data+0xeb/0xd80 [drbd]
Feb  5 08:52:16 10.15.19.1 [1540674.287544]  [<ffffffffa0462695>] ?
drbd_recv+0x25/0x180 [drbd]
Feb  5 08:52:16 10.15.19.1 [1540674.288332]  [<ffffffffa046b590>] ?
receive_RSDataReply+0x3b0/0x3b0 [drbd]
Feb  5 08:52:16 10.15.19.1 [1540674.289120]  [<ffffffffa046f46b>] ?
drbd_receiver+0x17b/0x290 [drbd]
Feb  5 08:52:16 10.15.19.1 [1540674.289917]  [<ffffffff8100a3e9>] ?
xen_force_evtchn_callback+0x9/0x10
Feb  5 08:52:16 10.15.19.1 [1540674.290724]  [<ffffffffa0477efa>] ?
drbd_thread_setup+0x4a/0x120 [drbd]
Feb  5 08:52:16 10.15.19.1 [1540674.291527]  [<ffffffffa0477eb0>] ?
drbd_destroy_connection+0xf0/0xf0 [drbd]
Feb  5 08:52:16 10.15.19.1 [1540674.292315]  [<ffffffff8108c593>] ?
kthread+0xd3/0xf0
Feb  5 08:52:16 10.15.19.1 [1540674.293077]  [<ffffffff8108c4c0>] ?
kthread_create_on_node+0x170/0x170
Feb  5 08:52:16 10.15.19.1 [1540674.293822]  [<ffffffff8155a19f>] ?
ret_from_fork+0x3f/0x70
Feb  5 08:52:16 10.15.19.1 [1540674.294545]  [<ffffffff8108c4c0>] ?
kthread_create_on_node+0x170/0x170
Feb  5 08:52:16 10.15.19.1 [1540674.295248] Code:
Feb  5 08:52:16 5d
Feb  5 08:52:16 e9
Feb  5 08:52:16 00
Feb  5 08:52:16 fa
Feb  5 08:52:16 ff
Feb  5 08:52:16 ff
Feb  5 08:52:16 f0
Feb  5 08:52:16 80
Feb  5 08:52:16 65
Feb  5 08:52:16 03
Feb  5 08:52:16 fe
Feb  5 08:52:16 ff
Feb  5 08:52:16 14
Feb  5 08:52:16 25
Feb  5 08:52:16 08
Feb  5 08:52:16 cc
Feb  5 08:52:16 a2
Feb  5 08:52:16 81
Feb  5 08:52:16 f0
Feb  5 08:52:16 ff
Feb  5 08:52:16 0e
Feb  5 08:52:16 74
Feb  5 08:52:16 c5
Feb  5 08:52:16 eb
Feb  5 08:52:16 d4
Feb  5 08:52:16 48
Feb  5 08:52:16 89
Feb  5 08:52:16 ef
Feb  5 08:52:16 e8
Feb  5 08:52:16 e5
Feb  5 08:52:16 f9
Feb  5 08:52:16 ff
Feb  5 08:52:16 ff
Feb  5 08:52:16 eb
Feb  5 08:52:16 ca
Feb  5 08:52:16 0f
Feb  5 08:52:16 1f
Feb  5 08:52:16 00
Feb  5 08:52:16 0f
Feb  5 08:52:16 1f
Feb  5 08:52:16 44
Feb  5 08:52:16 00
Feb  5 08:52:16 00
Feb  5 08:52:16 10.15.19.1
Feb  5 08:52:16 f7
Feb  5 08:52:16 07
Feb  5 08:52:16 00
Feb  5 08:52:16 c0
Feb  5 08:52:16 00
Feb  5 08:52:16 00
Feb  5 08:52:16 75
Feb  5 08:52:16 1b
Feb  5 08:52:16 f0
Feb  5 08:52:16 ff
Feb  5 08:52:16 4f
Feb  5 08:52:16 1c
Feb  5 08:52:16 74
Feb  5 08:52:16 01
Feb  5 08:52:16 c3
Feb  5 08:52:16 53
Feb  5 08:52:16 48
Feb  5 08:52:16 89
Feb  5 08:52:16 fb
Feb  5 08:52:16 e8
Feb  5 08:52:16 10.15.19.1
Feb  5 08:52:16 10.15.19.1 [1540674.296818] RIP
Feb  5 08:52:16 10.15.19.1  [<ffffffff81163085>] put_page+0x5/0x30
Feb  5 08:52:16 10.15.19.1 [1540674.297502]  RSP <ffff880072bb7a00>
Feb  5 08:52:16 10.15.19.1 [1540674.298184] ---[ end trace
c707a4137e150aa1 ]---
Feb  5 08:52:17 10.15.19.1 [1540674.418632] Kernel panic - not syncing:
Fatal exception in interrupt
Feb  5 08:52:17 10.15.19.1 [1540674.419383] Kernel Offset: disabled
Feb  5 08:52:17 10.15.19.1 [1540674.420017] drm_kms_helper: panic
occurred, switching back to text console

Incident 2, Host xen2:

Feb  6 13:54:56 10.15.19.2 [78561.160182] BUG: unable to handle kernel
Feb  6 13:54:56 paging request
Feb  6 13:54:56 10.15.19.2  at 000000000b356000
Feb  6 13:54:56 10.15.19.2 [78561.160958] IP:
Feb  6 13:54:56 10.15.19.2  [<ffffffff81450e2b>] kfree_skb_list+0xb/0x20
Feb  6 13:54:56 10.15.19.2 [78561.161624] PGD 0
Feb  6 13:54:56 10.15.19.2
Feb  6 13:54:56 10.15.19.2 [78561.162210] Oops: 0000 [#1]
Feb  6 13:54:56 SMP
Feb  6 13:54:56 10.15.19.2
Feb  6 13:54:56 10.15.19.2 [78561.162792] Modules linked in:
Feb  6 13:54:56 10.15.19.2  fuse
Feb  6 13:54:56 10.15.19.2  ufs
Feb  6 13:54:56 10.15.19.2  qnx4
Feb  6 13:54:56 10.15.19.2  hfsplus
Feb  6 13:54:56 10.15.19.2  hfs
Feb  6 13:54:56 10.15.19.2  minix
Feb  6 13:54:56 10.15.19.2  ntfs
Feb  6 13:54:56 10.15.19.2  vfat
Feb  6 13:54:56 10.15.19.2  msdos
Feb  6 13:54:56 10.15.19.2  fat
Feb  6 13:54:56 10.15.19.2  jfs
Feb  6 13:54:56 10.15.19.2  xfs
Feb  6 13:54:56 10.15.19.2  xt_physdev
Feb  6 13:54:56 10.15.19.2  br_netfilter
Feb  6 13:54:56 10.15.19.2  iptable_filter
Feb  6 13:54:56 10.15.19.2  ip_tables
Feb  6 13:54:56 10.15.19.2  x_tables
Feb  6 13:54:56 10.15.19.2  xen_netback
Feb  6 13:54:56 10.15.19.2  tun
Feb  6 13:54:56 10.15.19.2  xen_blkback
Feb  6 13:54:56 10.15.19.2  xen_gntdev
Feb  6 13:54:56 10.15.19.2  binfmt_misc
Feb  6 13:54:56 10.15.19.2  xen_evtchn
Feb  6 13:54:56 10.15.19.2  xenfs
Feb  6 13:54:56 10.15.19.2  xen_privcmd
Feb  6 13:54:56 10.15.19.2  nfsd
Feb  6 13:54:56 10.15.19.2  auth_rpcgss
Feb  6 13:54:56 10.15.19.2  oid_registry
Feb  6 13:54:56 10.15.19.2  nfs_acl
Feb  6 13:54:56 10.15.19.2  nfs
Feb  6 13:54:56 10.15.19.2  lockd
Feb  6 13:54:56 10.15.19.2  grace
Feb  6 13:54:56 10.15.19.2  fscache
Feb  6 13:54:56 10.15.19.2  sunrpc
Feb  6 13:54:56 10.15.19.2  8021q
Feb  6 13:54:56 10.15.19.2  garp
Feb  6 13:54:56 10.15.19.2  mrp
Feb  6 13:54:56 10.15.19.2  bridge
Feb  6 13:54:56 10.15.19.2  stp
Feb  6 13:54:56 10.15.19.2  llc
Feb  6 13:54:56 10.15.19.2  x86_pkg_temp_thermal
Feb  6 13:54:56 10.15.19.2  intel_rapl
Feb  6 13:54:56 10.15.19.2  iosf_mbi
Feb  6 13:54:56 10.15.19.2  coretemp
Feb  6 13:54:56 10.15.19.2  crct10dif_pclmul
Feb  6 13:54:56 10.15.19.2  crc32_pclmul
Feb  6 13:54:56 10.15.19.2  cryptd
Feb  6 13:54:56 10.15.19.2  iTCO_wdt
Feb  6 13:54:56 10.15.19.2  iTCO_vendor_support
Feb  6 13:54:56 10.15.19.2  pcspkr
Feb  6 13:54:56 10.15.19.2  ast
Feb  6 13:54:56 10.15.19.2  joydev
Feb  6 13:54:56 10.15.19.2  sb_edac
Feb  6 13:54:56 10.15.19.2  ttm
Feb  6 13:54:56 10.15.19.2  lpc_ich
Feb  6 13:54:56 10.15.19.2  mfd_core
Feb  6 13:54:56 10.15.19.2  i2c_i801
Feb  6 13:54:56 10.15.19.2  edac_core
Feb  6 13:54:56 10.15.19.2  evdev
Feb  6 13:54:56 10.15.19.2  drm_kms_helper
Feb  6 13:54:56 10.15.19.2  drm
Feb  6 13:54:56 10.15.19.2  mei_me
Feb  6 13:54:56 10.15.19.2  mei
Feb  6 13:54:56 10.15.19.2  shpchp
Feb  6 13:54:56 10.15.19.2  ioatdma
Feb  6 13:54:56 10.15.19.2  wmi
Feb  6 13:54:56 10.15.19.2  netconsole
Feb  6 13:54:56 10.15.19.2  configfs
Feb  6 13:54:56 10.15.19.2  tpm_tis
Feb  6 13:54:56 10.15.19.2  tpm
Feb  6 13:54:56 10.15.19.2  ipmi_watchdog
Feb  6 13:54:56 10.15.19.2  8250_fintek
Feb  6 13:54:56 10.15.19.2  dm_cache_smq
Feb  6 13:54:56 10.15.19.2  dm_cache_mq
Feb  6 13:54:56 10.15.19.2  dm_cache
Feb  6 13:54:56 10.15.19.2  dm_persistent_data
Feb  6 13:54:56 10.15.19.2  dm_bio_prison
Feb  6 13:54:56 10.15.19.2  dm_bufio
Feb  6 13:54:56 10.15.19.2  processor
Feb  6 13:54:56 10.15.19.2  thermal_sys
Feb  6 13:54:56 10.15.19.2  acpi_power_meter
Feb  6 13:54:56 10.15.19.2  button
Feb  6 13:54:56 10.15.19.2  ipmi_si
Feb  6 13:54:56 10.15.19.2  ipmi_poweroff
Feb  6 13:54:56 10.15.19.2  ipmi_devintf
Feb  6 13:54:56 10.15.19.2  ipmi_msghandler
Feb  6 13:54:56 10.15.19.2  drbd
Feb  6 13:54:56 10.15.19.2  lru_cache
Feb  6 13:54:56 10.15.19.2  libcrc32c
Feb  6 13:54:56 10.15.19.2  autofs4
Feb  6 13:54:56 10.15.19.2  ext4
Feb  6 13:54:56 10.15.19.2  crc16
Feb  6 13:54:56 10.15.19.2  mbcache
Feb  6 13:54:56 10.15.19.2  jbd2
Feb  6 13:54:56 10.15.19.2  btrfs
Feb  6 13:54:56 10.15.19.2  xor
Feb  6 13:54:56 10.15.19.2  raid6_pq
Feb  6 13:54:56 10.15.19.2  dm_mod
Feb  6 13:54:56 10.15.19.2  mlx4_en
Feb  6 13:54:56 10.15.19.2  vxlan
Feb  6 13:54:56 10.15.19.2  ip6_udp_tunnel
Feb  6 13:54:56 10.15.19.2  udp_tunnel
Feb  6 13:54:56 10.15.19.2  sg
Feb  6 13:54:56 10.15.19.2  sd_mod
Feb  6 13:54:56 10.15.19.2  hid_generic
Feb  6 13:54:56 10.15.19.2  usbhid
Feb  6 13:54:56 10.15.19.2  hid
Feb  6 13:54:56 10.15.19.2  crc32c_intel
Feb  6 13:54:56 10.15.19.2  igb
Feb  6 13:54:56 10.15.19.2  i2c_algo_bit
Feb  6 13:54:56 10.15.19.2  dca
Feb  6 13:54:56 10.15.19.2  ptp
Feb  6 13:54:56 10.15.19.2  pps_core
Feb  6 13:54:56 10.15.19.2  xhci_pci
Feb  6 13:54:56 10.15.19.2  xhci_hcd
Feb  6 13:54:56 10.15.19.2  ehci_pci
Feb  6 13:54:56 10.15.19.2  ahci
Feb  6 13:54:56 10.15.19.2  ehci_hcd
Feb  6 13:54:56 10.15.19.2  libahci
Feb  6 13:54:56 10.15.19.2  usbcore
Feb  6 13:54:56 10.15.19.2  libata
Feb  6 13:54:56 10.15.19.2  usb_common
Feb  6 13:54:56 10.15.19.2  mlx4_core
Feb  6 13:54:56 10.15.19.2  3w_sas
Feb  6 13:54:56 10.15.19.2  scsi_mod
Feb  6 13:54:56 10.15.19.2
Feb  6 13:54:56 10.15.19.2 [78561.169193] CPU: 0 PID: 2845 Comm:
drbd_a_mst19 Not tainted 4.2.0-0.bpo.1-amd64 #1 Debian 4.2.6-3~bpo8+2
Feb  6 13:54:56 10.15.19.2 [78561.169941] Hardware name: Supermicro
X10DRL-i/X10DRL-i, BIOS 1.1 04/09/2015
Feb  6 13:54:56 10.15.19.2 [78561.170691] task: ffff88017d4f6480 ti:
ffff8801661e4000 task.ti: ffff8801661e4000
Feb  6 13:54:56 10.15.19.2 [78561.171445] RIP: e030:[<ffffffff81450e2b>]
Feb  6 13:54:56 10.15.19.2  [<ffffffff81450e2b>] kfree_skb_list+0xb/0x20
Feb  6 13:54:56 10.15.19.2 [78561.172228] RSP: e02b:ffff8801661e7b38
EFLAGS: 00010206
Feb  6 13:54:56 10.15.19.2 [78561.173008] RAX: 0000000000000020 RBX:
0000000000000000 RCX: 0000000000000038
Feb  6 13:54:56 10.15.19.2 [78561.173795] RDX: ffff880164e27da2 RSI:
ffff88017d57a800 RDI: 000000000b356000
Feb  6 13:54:56 10.15.19.2 [78561.174590] RBP: ffff880164e27ec0 R08:
ffff8801661e4000 R09: 0000000000000001
Feb  6 13:54:56 10.15.19.2 [78561.175381] R10: 0000000000007ff0 R11:
0000000000000000 R12: ffff88017d57a800
Feb  6 13:54:56 10.15.19.2 [78561.176175] R13: ffff88005cb9c800 R14:
0000000000000000 R15: ffff88005cb9cd98
Feb  6 13:54:56 10.15.19.2 [78561.176966] FS:  0000000000000000(0000)
GS:ffff880186600000(0000) knlGS:ffff880186600000
Feb  6 13:54:56 10.15.19.2 [78561.177757] CS:  e033 DS: 0000 ES: 0000
CR0: 0000000080050033
Feb  6 13:54:56 10.15.19.2 [78561.178544] CR2: 000000000b356000 CR3:
000000006ce6e000 CR4: 0000000000042660
Feb  6 13:54:56 10.15.19.2 [78561.179348] Stack:
Feb  6 13:54:56 10.15.19.2 [78561.180145]  0000000000000000
Feb  6 13:54:56 10.15.19.2  ffffffff81450edd
Feb  6 13:54:56 10.15.19.2  ffff88017d57a800
Feb  6 13:54:56 10.15.19.2  ffff88017d57a800
Feb  6 13:54:56 10.15.19.2
Feb  6 13:54:56 10.15.19.2 [78561.180965]  ffff880164e27da2
Feb  6 13:54:56 10.15.19.2  ffffffff81450d8e
Feb  6 13:54:56 10.15.19.2  ffff88005cb9c800
Feb  6 13:54:56 10.15.19.2  ffffffff814b5b62
Feb  6 13:54:56 10.15.19.2
Feb  6 13:54:56 10.15.19.2 [78561.181794]  ffffffff810b0841
Feb  6 13:54:56 10.15.19.2  0000000000000000
Feb  6 13:54:56 10.15.19.2  0000000000007ff0
Feb  6 13:54:56 10.15.19.2  0000000000000001
Feb  6 13:54:56 10.15.19.2
Feb  6 13:54:56 10.15.19.2 [78561.182624] Call Trace:
Feb  6 13:54:56 10.15.19.2 [78561.183435]  [<ffffffff81450edd>] ?
skb_release_data+0x9d/0xd0
Feb  6 13:54:56 10.15.19.2 [78561.184273]  [<ffffffff81450d8e>] ?
__kfree_skb+0xe/0x20
Feb  6 13:54:56 10.15.19.2 [78561.185109]  [<ffffffff814b5b62>] ?
tcp_rcv_established+0x82/0x6d0
Feb  6 13:54:56 10.15.19.2 [78561.185954]  [<ffffffff810b0841>] ?
__raw_callee_save___pv_queued_spin_unlock+0x11/0x20
Feb  6 13:54:56 10.15.19.2 [78561.186802]  [<ffffffff814c0353>] ?
tcp_v4_do_rcv+0x153/0x3d0
Feb  6 13:54:56 10.15.19.2 [78561.187645]  [<ffffffff8144e3ba>] ?
sk_wait_data+0xca/0xf0
Feb  6 13:54:56 10.15.19.2 [78561.188484]  [<ffffffff814aa136>] ?
tcp_prequeue_process+0x76/0xc0
Feb  6 13:54:56 10.15.19.2 [78561.189328]  [<ffffffff814ab71d>] ?
tcp_recvmsg+0x7ad/0xb80
Feb  6 13:54:56 10.15.19.2 [78561.190168]  [<ffffffff810b0841>] ?
__raw_callee_save___pv_queued_spin_unlock+0x11/0x20
Feb  6 13:54:56 10.15.19.2 [78561.191011]  [<ffffffff814d68c0>] ?
inet_recvmsg+0x70/0x90
Feb  6 13:54:56 10.15.19.2 [78561.191843]  [<ffffffff81449d9c>] ?
kernel_recvmsg+0x5c/0x80
Feb  6 13:54:56 10.15.19.2 [78561.192671]  [<ffffffffa046b517>] ?
drbd_recv_short+0x57/0x60 [drbd]
Feb  6 13:54:56 10.15.19.2 [78561.193490]  [<ffffffffa0478897>] ?
drbd_asender+0x317/0x750 [drbd]
Feb  6 13:54:56 10.15.19.2 [78561.194303]  [<ffffffffa0480eb0>] ?
drbd_destroy_connection+0xf0/0xf0 [drbd]
Feb  6 13:54:56 10.15.19.2 [78561.195126]  [<ffffffffa0480efa>] ?
drbd_thread_setup+0x4a/0x120 [drbd]
Feb  6 13:54:56 10.15.19.2 [78561.195960]  [<ffffffffa0480eb0>] ?
drbd_destroy_connection+0xf0/0xf0 [drbd]
Feb  6 13:54:56 10.15.19.2 [78561.196797]  [<ffffffff8108c593>] ?
kthread+0xd3/0xf0
Feb  6 13:54:56 10.15.19.2 [78561.197625]  [<ffffffff8108c4c0>] ?
kthread_create_on_node+0x170/0x170
Feb  6 13:54:56 10.15.19.2 [78561.198447]  [<ffffffff8155a19f>] ?
ret_from_fork+0x3f/0x70
Feb  6 13:54:56 10.15.19.2 [78561.199264]  [<ffffffff8108c4c0>] ?
kthread_create_on_node+0x170/0x170
Feb  6 13:54:56 10.15.19.2 [78561.200092] Code:
Feb  6 13:54:56 e8
Feb  6 13:54:56 eb
Feb  6 13:54:56 c3
Feb  6 13:54:56 f0
Feb  6 13:54:56 ff
Feb  6 13:54:56 8f
Feb  6 13:54:56 e4
Feb  6 13:54:56 00
Feb  6 13:54:56 00
Feb  6 13:54:56 00
Feb  6 13:54:56 74
Feb  6 13:54:56 ad
Feb  6 13:54:56 5b
Feb  6 13:54:56 5d
Feb  6 13:54:56 41
Feb  6 13:54:56 5c
Feb  6 13:54:56 c3
Feb  6 13:54:56 66
Feb  6 13:54:56 66
Feb  6 13:54:56 66
Feb  6 13:54:56 66
Feb  6 13:54:56 66
Feb  6 13:54:56 66
Feb  6 13:54:56 2e
Feb  6 13:54:56 0f
Feb  6 13:54:56 1f
Feb  6 13:54:56 84
Feb  6 13:54:56 00
Feb  6 13:54:56 00
Feb  6 13:54:56 00
Feb  6 13:54:56 00
Feb  6 13:54:56 00
Feb  6 13:54:56 0f
Feb  6 13:54:56 1f
Feb  6 13:54:56 44
Feb  6 13:54:56 00
Feb  6 13:54:56 00
Feb  6 13:54:56 48
Feb  6 13:54:56 48
Feb  6 13:54:56 85
Feb  6 13:54:56 ff
Feb  6 13:54:56 74
Feb  6 13:54:56 12
Feb  6 13:54:56 53
Feb  6 13:54:56 10.15.19.2
Feb  6 13:54:56 8b
Feb  6 13:54:56 1f
Feb  6 13:54:56 e8
Feb  6 13:54:56 6d
Feb  6 13:54:56 ff
Feb  6 13:54:56 ff
Feb  6 13:54:56 ff
Feb  6 13:54:56 48
Feb  6 13:54:56 85
Feb  6 13:54:56 db
Feb  6 13:54:56 48
Feb  6 13:54:56 89
Feb  6 13:54:56 df
Feb  6 13:54:56 75
Feb  6 13:54:56 f0
Feb  6 13:54:56 5b
Feb  6 13:54:56 f3
Feb  6 13:54:56 c3
Feb  6 13:54:56 66
Feb  6 13:54:56 90
Feb  6 13:54:56 10.15.19.2
Feb  6 13:54:56 10.15.19.2 [78561.201951] RIP
Feb  6 13:54:56 10.15.19.2  [<ffffffff81450e2b>] kfree_skb_list+0xb/0x20
Feb  6 13:54:56 10.15.19.2 [78561.202764]  RSP <ffff8801661e7b38>
Feb  6 13:54:56 10.15.19.2 [78561.203548] CR2: 000000000b356000
Feb  6 13:54:56 10.15.19.2 [78561.204314] ---[ end trace
39b2b9048f0475bb ]---
Feb  6 13:54:56 10.15.19.2 [78561.208859] Kernel panic - not syncing:
Fatal exception in interrupt
Feb  6 13:54:56 10.15.19.2 [78561.209597] Kernel Offset: disabled
Feb  6 13:54:56 10.15.19.2 [78561.210302] drm_kms_helper: panic
occurred, switching back to text console




More information about the drbd-user mailing list