<div dir="ltr">Hi,<div><br></div><div><div><div style=""><div style="margin:0px;padding:0px"><font color="#333333" face="Arial, sans-serif"><span style="font-size:14px;line-height:20px">WFBitMapS status is not ended and mount command is hung.</span></font><br></div><div style="margin:0px;padding:0px"><font color="#333333" face="Arial, sans-serif"><span style="font-size:14px;line-height:20px"><br></span></font></div></div><div style="font-size:14px;margin:0px;padding:0px;color:rgb(51,51,51);font-family:Arial,sans-serif;line-height:20px"><div style="color:rgb(34,34,34);font-family:arial,sans-serif;line-height:normal">1. Test version</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;line-height:normal"> - CentOS-7 Linux 3.10.0-229.7.2.el7.x86_64</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;line-height:normal"> - Engine: V9.0.1-1</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;line-height:normal"> -- GIT-hash: f57acfc22d29a95697e683fb6bbacd9a1ad4348e build by root@drbd9-02, 2016-02-09 09:46:20</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;line-height:normal"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;line-height:normal"><br></div></div><span style="font-size:14px">2. Test scenario</span></div><div><br></div><div>1) status</div><div><br></div><div>[root@drbd9-01 ~]# drbdadm status r0<br>r0 role:Secondary<br> disk:Outdated<br> drbd9-02 role:Secondary<br> peer-disk:Outdated<br><br>2) try mount</div><div><br>[root@drbd9-01 ~]# mount /dev/drbd1 /mnt<br>mount: /dev/drbd1 is write-protected, mounting read-only<br>mount: mount /dev/drbd1 on /mnt failed: 잘못된 미디어 종류</div><div><br>[root@drbd9-01 ~]# df<br>Filesystem 1K-blocks Used Available Use% Mounted on<br>/dev/mapper/centos-root 18307072 8820096 9486976 49% /<br>devtmpfs 491892 0 491892 0% /dev<br>tmpfs 501580 140 501440 1% /dev/shm<br>tmpfs 501580 7156 494424 2% /run<br>tmpfs 501580 0 501580 0% /sys/fs/cgroup<br>/dev/sda1 508588 134148 374440 27% /boot</div><div><br></div><div>3) promote</div><div><br>[root@drbd9-01 ~]# drbdadm primary r0<br>r0: State change failed: (-2) Need access to UpToDate data<br>Command 'drbdsetup primary r0' terminated with exit code 17</div><div><br>[root@drbd9-01 ~]# drbdadm primary --force r0</div><div><br></div><div><br></div><div>4) try mount again</div><div><br>[root@drbd9-01 ~]# mount /dev/drbd1 /mnt<br><br></div><div> <b> -- mount command is pending.!!!!</b></div><div><br></div><div>5) check status at another command terminal. </div><div> primary is WFBitMapS and secondary is UpToDate normal.</div><div><br></div><div>[root@drbd9-01 ~]# drbdadm status r0<br>r0 role:Primary<br> disk:UpToDate<br> drbd9-02 role:Secondary<br> replication:WFBitMapS peer-disk:Consistent<br></div><div><br></div><div><br></div><div><br></div>3. Logs<div><div style="font-size:14px"><br></div><div style="font-size:14px">1) node1(primary)<br><br clear="all">Feb 9 14:19:10 drbd9-01 kernel: drbd r0: Failed: role( Secondary -> Primary )<br>Feb 9 14:19:10 drbd9-01 kernel: drbd r0: Auto-promote failed: Need access to UpToDate data<br>Feb 9 14:19:27 drbd9-01 kernel: drbd r0: State change failed: Need access to UpToDate data<br>Feb 9 14:19:27 drbd9-01 kernel: drbd r0: Failed: role( Secondary -> Primary )</div><div style="font-size:14px"><br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0: Preparing cluster-wide state change 2512721173 (0->-1 7683/4609)<br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0: State change 2512721173: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC<br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0: Committing cluster-wide state change 2512721173 (2ms)<br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0: role( Secondary -> Primary )<br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0/0 drbd1: disk( Outdated -> UpToDate )<br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0: Forced to consider local data as UpToDate!<br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0/0 drbd1: new current UUID: B89DA2131EDE0311 weak: FFFFFFFFFFFFFFFE<br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: drbd_sync_handshake:<br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: self B89DA2131EDE0311:C223F7CE3C9D7358:C223F7CE3C9D7358:3D7DF30CF04727A4 bits:0 flags:0<br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: peer C223F7CE3C9D7358:0000000000000000:C223F7CE3C9D7358:3D7DF30CF04727A4 bits:0 flags:120<br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: uuid_compare()=2 by rule 70<br><b><font color="#ff0000">Feb 9 14:19:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( Outdated -> Consistent ) repl( Established -> WFBitMapS )</font></b><br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 21(1), total 21; compression: 100.0%<br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: unexpected<br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: In UUIDs from node 1 found equal UUID (3D7DF30CF04727A4) for nodes 2 3<br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: I have C223F7CE3C9D7358 for node_id=2<br>Feb 9 14:19:31 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: I have C223F7CE3C9D7358 for node_id=3</div><div style="font-size:14px"><br>Feb 9 14:19:35 drbd9-01 kernel: EXT4-fs (drbd1): mounting ext3 file system using the ext4 subsystem<br>Feb 9 14:20:01 drbd9-01 systemd: Starting Session 13 of user root.<br>Feb 9 14:20:01 drbd9-01 systemd: Started Session 13 of user root.</div><div style="font-size:14px"><br>Feb 9 14:21:49 drbd9-01 kernel: INFO: task mount:4758 blocked for more than 120 seconds.<br>Feb 9 14:21:49 drbd9-01 kernel: "echo 0 > /proc/sys/<b><font color="#ff0000">kernel/hung_task_timeout_secs</font></b>" disables this message.<br>Feb 9 14:21:49 drbd9-01 kernel: mount D ffff88003d613680 0 4758 4685 0x00000080<br>Feb 9 14:21:49 drbd9-01 kernel: ffff88003aa93b38 0000000000000086 ffff88001bf5db00 ffff88003aa93fd8<br>Feb 9 14:21:49 drbd9-01 kernel: ffff88003aa93fd8 ffff88003aa93fd8 ffff88001bf5db00 ffff88003d613f48<br>Feb 9 14:21:49 drbd9-01 kernel: ffff88003ffaaa18 0000000000000002 ffffffff811f8500 ffff88003aa93bb0<br>Feb 9 14:21:49 drbd9-01 kernel: Call Trace:<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff811f8500>] ? generic_block_bmap+0x70/0x70<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff816099ad>] io_schedule+0x9d/0x130<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff811f850e>] sleep_on_buffer+0xe/0x20<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff81607780>] __wait_on_bit+0x60/0x90<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff811f8500>] ? generic_block_bmap+0x70/0x70<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff81607837>] out_of_line_wait_on_bit+0x87/0xb0<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff81098270>] ? autoremove_wake_function+0x40/0x40<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff811f99d0>] ? _submit_bh+0x160/0x210<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff811fa628>] __sync_dirty_buffer+0xb8/0xe0<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff811fa663>] sync_dirty_buffer+0x13/0x20<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffffa050cdf0>] ext4_commit_super+0x1b0/0x240 [ext4]<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffffa050f500>] ext4_setup_super+0x120/0x190 [ext4]<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffffa0512163>] ext4_fill_super+0x1d53/0x2970 [ext4]<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff811c9ce0>] mount_bdev+0x1b0/0x1f0<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffffa0510410>] ? ext4_calculate_overhead+0x3d0/0x3d0 [ext4]<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffffa0505d35>] ext4_mount+0x15/0x20 [ext4]<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff811ca619>] mount_fs+0x39/0x1b0<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff811784b0>] ? __alloc_percpu+0x10/0x20<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff811e5c5f>] vfs_kern_mount+0x5f/0xf0<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff811e81ae>] do_mount+0x24e/0xa40<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff8117320b>] ? strndup_user+0x4b/0xf0<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff811e8a36>] SyS_mount+0x96/0xf0<br>Feb 9 14:21:49 drbd9-01 kernel: [<ffffffff81614209>] system_call_fastpath+0x16/0x1b</div><div style="font-size:14px"><br>Feb 9 14:22:56 drbd9-01 gnome-session: (gnome-settings-daemon:2063): color-plugin-WARNING **: unable to get EDID for xrandr-Virtual1: unable to get EDID for output<br>Feb 9 14:22:56 drbd9-01 gnome-session: (gnome-settings-daemon:2063): color-plugin-WARNING **: unable to get EDID for xrandr-Virtual1: unable to get EDID for output<br>Feb 9 14:22:56 drbd9-01 gnome-session: (gnome-settings-daemon:2063): color-plugin-WARNING **: unable to get EDID for xrandr-Virtual1: unable to get EDID for output<br>Feb 9 14:23:08 drbd9-01 gnome-session: console.error:<br>Feb 9 14:23:08 drbd9-01 gnome-session: [CustomizableUI]<br>Feb 9 14:23:08 drbd9-01 gnome-session: Custom widget with id loop-button does not return a valid node<br>Feb 9 14:23:09 drbd9-01 gnome-session: console.error:<br>Feb 9 14:23:09 drbd9-01 gnome-session: [CustomizableUI]<br>Feb 9 14:23:09 drbd9-01 gnome-session: Custom widget with id loop-button does not return a valid node<br>Feb 9 14:23:49 drbd9-01 kernel: INFO: task mount:4758 blocked for more than 120 seconds.<br>Feb 9 14:23:49 drbd9-01 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.<br>Feb 9 14:23:49 drbd9-01 kernel: mount D ffff88003d613680 0 4758 4685 0x00000080<br>Feb 9 14:23:49 drbd9-01 kernel: ffff88003aa93b38 0000000000000086 ffff88001bf5db00 ffff88003aa93fd8<br>Feb 9 14:23:49 drbd9-01 kernel: ffff88003aa93fd8 ffff88003aa93fd8 ffff88001bf5db00 ffff88003d613f48<br>Feb 9 14:23:49 drbd9-01 kernel: ffff88003ffaaa18 0000000000000002 ffffffff811f8500 ffff88003aa93bb0<br>Feb 9 14:23:49 drbd9-01 kernel: Call Trace:<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff811f8500>] ? generic_block_bmap+0x70/0x70<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff816099ad>] io_schedule+0x9d/0x130<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff811f850e>] sleep_on_buffer+0xe/0x20<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff81607780>] __wait_on_bit+0x60/0x90<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff811f8500>] ? generic_block_bmap+0x70/0x70<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff81607837>] out_of_line_wait_on_bit+0x87/0xb0<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff81098270>] ? autoremove_wake_function+0x40/0x40<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff811f99d0>] ? _submit_bh+0x160/0x210<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff811fa628>] __sync_dirty_buffer+0xb8/0xe0<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff811fa663>] sync_dirty_buffer+0x13/0x20<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffffa050cdf0>] ext4_commit_super+0x1b0/0x240 [ext4]<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffffa050f500>] ext4_setup_super+0x120/0x190 [ext4]<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffffa0512163>] ext4_fill_super+0x1d53/0x2970 [ext4]<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff811c9ce0>] mount_bdev+0x1b0/0x1f0<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffffa0510410>] ? ext4_calculate_overhead+0x3d0/0x3d0 [ext4]<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffffa0505d35>] ext4_mount+0x15/0x20 [ext4]<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff811ca619>] mount_fs+0x39/0x1b0<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff811784b0>] ? __alloc_percpu+0x10/0x20<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff811e5c5f>] vfs_kern_mount+0x5f/0xf0<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff811e81ae>] do_mount+0x24e/0xa40<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff8117320b>] ? strndup_user+0x4b/0xf0<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff811e8a36>] SyS_mount+0x96/0xf0<br>Feb 9 14:23:49 drbd9-01 kernel: [<ffffffff81614209>] system_call_fastpath+0x16/0x1b<br>Feb 9 14:24:10 drbd9-01 gnome-session: ** (firefox:4868): CRITICAL **: gst_app_src_set_size: assertion 'GST_IS_APP_SRC (appsrc)' failed<br>Feb 9 14:24:10 drbd9-01 gnome-session: ** (firefox:4868): CRITICAL **: gst_app_src_set_size: assertion 'GST_IS_APP_SRC (appsrc)' failed<br>Feb 9 14:24:10 drbd9-01 gnome-session: ** (firefox:4868): CRITICAL **: gst_app_src_set_size: assertion 'GST_IS_APP_SRC (appsrc)' failed<br><br><br>4. Question</div><div style="font-size:14px"><font color="#000000"> - Why does the WFBitMapS status pend?</font></div><div style="font-size:14px"><font color="#000000"> - Why does the mount command hang?<br></font><br></div><div style="font-size:14px">Thanks.</div></div><div><br></div>
</div></div>