[DRBD-user] DRBD trace with RHEL6.1 upgrade

David Coulson david at davidcoulson.net
Tue Aug 2 20:34:22 CEST 2011


I have a pair of systems running RHEL6 w/ DRBD, cman/pacemaker and 
clvmd. They worked happily for about 6 months on RHEL6.0. I applied 
updates to the systems today taking them to RHEL6.1 (as of about a week 
ago). They are running the 8.3.8.1 release of DRBD, both before and 
after the RHEL kernel update. Both boxes have kernel paniced since the 
update (specifically when I tried to resolve a split-brain issue in 
drbd), so I'm working on tracking down the specific issues - This seemed 
like a good place to start. My DRBD resource is attached to an LV on the 
local disk of each box.

When they boot I get the following trace:

block drbd0: Starting worker thread (from cqueue [1928])
block drbd0: disk( Diskless -> Attaching )
block drbd0: Found 4 transactions (8 active extents) in activity log.
block drbd0: Method to ensure write ordering: barrier
block drbd0: Backing device's merge_bvec_fn() = ffffffffa0002af0
block drbd0: max_segment_size ( = BIO size ) = 32768
block drbd0: drbd_bm_resize called with capacity == 41941688
block drbd0: resync bitmap: bits=5242711 words=81918
block drbd0: size = 20 GB (20970844 KB)
block drbd0: recounting of set bits took additional 0 jiffies
block drbd0: 136 MB (34816 bits) marked out-of-sync by on disk bit-map.
block drbd0: disk( Attaching -> UpToDate )
------------[ cut here ]------------
WARNING: at block/blk-core.c:1222 __make_request+0x477/0x500() (Not tainted)
Hardware name: System x3550 M2 -[7946AC1]-
block: BARRIER is deprecated, use FLUSH/FUA instead
Modules linked in: drbd(U) cpufreq_ondemand acpi_cpufreq freq_table 
bonding ipv6 xfs exportfs vfat fat dm_mirror dm_region_hash dm_log sg 
bnx2 e1000e microcode cdc_ether usbnet mii serio_raw i2c_i801 i2c_core 
iTCO_wdt iTCO_vendor_support ioatdma dca i7core_edac edac_core shpchp 
ext4 mbcache jbd2 sd_mod crc_t10dif megaraid_sas ata_generic pata_acpi 
ata_piix dm_mod [last unloaded: scsi_wait_scan]
Pid: 1928, comm: cqueue Not tainted 2.6.32-131.4.1.el6.x86_64 #1
Call Trace:
  [<ffffffff810670f7>] ? warn_slowpath_common+0x87/0xc0
  [<ffffffff810671e6>] ? warn_slowpath_fmt+0x46/0x50
  [<ffffffff8124a857>] ? __make_request+0x477/0x500
  [<ffffffff81248dbe>] ? generic_make_request+0x21e/0x5b0
  [<ffffffffa0002bb1>] ? dm_merge_bvec+0xc1/0x140 [dm_mod]
  [<ffffffff812491df>] ? submit_bio+0x8f/0x120
  [<ffffffffa03abdb2>] ? _drbd_md_sync_page_io+0x102/0x220 [drbd]
  [<ffffffffa03ac254>] ? drbd_md_sync_page_io+0xe4/0x6b0 [drbd]
  [<ffffffff8107966c>] ? lock_timer_base+0x3c/0x70
  [<ffffffffa03b8fdd>] ? drbd_md_sync+0x1fd/0x580 [drbd]
  [<ffffffffa03c1434>] ? drbd_nl_disk_conf+0xbb4/0xd50 [drbd]
  [<ffffffff812511ba>] ? add_disk+0xca/0x160
  [<ffffffffa03be735>] ? drbd_connector_callback+0x135/0x2b0 [drbd]
  [<ffffffff8132c540>] ? cn_queue_wrapper+0x0/0x50
  [<ffffffff8132c568>] ? cn_queue_wrapper+0x28/0x50
  [<ffffffff810887d0>] ? worker_thread+0x170/0x2a0
  [<ffffffff8108e100>] ? autoremove_wake_function+0x0/0x40
  [<ffffffff81088660>] ? worker_thread+0x0/0x2a0
  [<ffffffff8108dd96>] ? kthread+0x96/0xa0
  [<ffffffff8100c1ca>] ? child_rip+0xa/0x20
  [<ffffffff8108dd00>] ? kthread+0x0/0xa0
  [<ffffffff8100c1c0>] ? child_rip+0x0/0x20
---[ end trace 18e5bb6cb35239c9 ]---
block drbd0: Barriers not supported on meta data device - disabling
block drbd0: conn( StandAlone -> Unconnected )
block drbd0: Starting receiver thread (from drbd0_worker [1936])
block drbd0: receiver (re)started
block drbd0: conn( Unconnected -> WFConnection )

modinfo is below:

[root at rhesproddns02 ~]# !modinfo
modinfo drbd
filename:       
/lib/modules/2.6.32-131.4.1.el6.x86_64/updates/drivers/block/drbd.ko
alias:          block-major-147-*
license:        GPL
version:        8.3.8.1
description:    drbd - Distributed Replicated Block Device v8.3.8.1
author:         Philipp Reisner <phil at linbit.com>, Lars Ellenberg 
<lars at linbit.com>
srcversion:     5DDABBD9052032BE7DC0745
depends:
vermagic:       2.6.32-131.4.1.el6.x86_64 SMP mod_unload modversions
parm:           minor_count:Maximum number of drbd devices (1-255) (uint)
parm:           disable_sendpage:bool
parm:           allow_oos:DONT USE! (bool)
parm:           cn_idx:uint
parm:           proc_details:int
parm:           enable_faults:int
parm:           fault_rate:int
parm:           fault_count:int
parm:           fault_devs:int
parm:           usermode_helper:string




More information about the drbd-user mailing list