Mar 17 00:52:13 offine-stand-stor-0 [ 1514.655925] WARNING: chroot access! Mar 17 00:52:13 offine-stand-stor-0 [ 1565.945292] fastvps_test Mar 17 00:52:21 offine-stand-stor-0 [ 1573.831247] eth0: renamed from tmp61bdb Mar 17 00:52:21 offine-stand-stor-0 [ 1573.860757] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 00:52:21 offine-stand-stor-0 [ 1573.863514] IPv6: ADDRCONF(NETDEV_CHANGE): lxc1f5f5e8e5bc3: link becomes ready Mar 17 00:52:21 offine-stand-stor-0 [ 1574.402709] WARNING: chroot access! Mar 17 00:53:21 offine-stand-stor-0 [ 1574.499235] WARNING: chroot access! Mar 17 00:53:21 offine-stand-stor-0 [ 1633.991190] eth0: renamed from tmp09d2a Mar 17 00:53:21 offine-stand-stor-0 [ 1634.026224] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 00:53:21 offine-stand-stor-0 [ 1634.026955] IPv6: ADDRCONF(NETDEV_CHANGE): lxc89b295e5c1ac: link becomes ready Mar 17 00:53:21 offine-stand-stor-0 [ 1634.459152] WARNING: chroot access! Mar 17 00:54:21 offine-stand-stor-0 [ 1634.548493] WARNING: chroot access! Mar 17 00:54:21 offine-stand-stor-0 [ 1693.867355] eth0: renamed from tmp83aba Mar 17 00:54:21 offine-stand-stor-0 [ 1693.931373] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 00:54:21 offine-stand-stor-0 [ 1693.933742] IPv6: ADDRCONF(NETDEV_CHANGE): lxc456c40fc3483: link becomes ready Mar 17 00:54:22 offine-stand-stor-0 [ 1694.536630] WARNING: chroot access! Mar 17 00:55:21 offine-stand-stor-0 [ 1694.636287] WARNING: chroot access! Mar 17 00:55:21 offine-stand-stor-0 [ 1753.858402] eth0: renamed from tmpaa3f0 Mar 17 00:55:21 offine-stand-stor-0 [ 1753.902996] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 00:55:21 offine-stand-stor-0 [ 1753.904675] IPv6: ADDRCONF(NETDEV_CHANGE): lxc2ca44c7be148: link becomes ready Mar 17 00:55:21 offine-stand-stor-0 [ 1754.302872] WARNING: chroot access! Mar 17 00:56:21 offine-stand-stor-0 [ 1754.384754] WARNING: chroot access! Mar 17 00:56:21 offine-stand-stor-0 [ 1814.027271] eth0: renamed from tmp0903b Mar 17 00:56:21 offine-stand-stor-0 [ 1814.067293] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 00:56:21 offine-stand-stor-0 [ 1814.069396] IPv6: ADDRCONF(NETDEV_CHANGE): lxc087752b1b52a: link becomes ready Mar 17 00:56:22 offine-stand-stor-0 [ 1814.511382] WARNING: chroot access! Mar 17 00:57:20 offine-stand-stor-0 [ 1814.603656] WARNING: chroot access! Mar 17 00:57:20 offine-stand-stor-0 [ 1873.161996] eth0: renamed from tmpf3fe7 Mar 17 00:57:20 offine-stand-stor-0 [ 1873.209146] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 00:57:20 offine-stand-stor-0 [ 1873.211214] IPv6: ADDRCONF(NETDEV_CHANGE): lxca8acb9ac194a: link becomes ready Mar 17 00:57:21 offine-stand-stor-0 [ 1873.768542] WARNING: chroot access! Mar 17 00:58:21 offine-stand-stor-0 [ 1873.894659] WARNING: chroot access! Mar 17 00:58:21 offine-stand-stor-0 [ 1934.014064] eth0: renamed from tmp522ee Mar 17 00:58:21 offine-stand-stor-0 [ 1934.052521] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 00:58:21 offine-stand-stor-0 [ 1934.054794] IPv6: ADDRCONF(NETDEV_CHANGE): lxc2410ed23cba5: link becomes ready Mar 17 00:58:22 offine-stand-stor-0 [ 1934.543252] WARNING: chroot access! Mar 17 00:59:20 offine-stand-stor-0 [ 1934.600572] WARNING: chroot access! Mar 17 00:59:20 offine-stand-stor-0 [ 1993.206211] eth0: renamed from tmpe6e40 Mar 17 00:59:20 offine-stand-stor-0 [ 1993.258652] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 00:59:20 offine-stand-stor-0 [ 1993.259434] IPv6: ADDRCONF(NETDEV_CHANGE): lxc761f07d71aa9: link becomes ready Mar 17 00:59:21 offine-stand-stor-0 [ 1993.772640] WARNING: chroot access! Mar 17 01:00:21 offine-stand-stor-0 [ 1993.838981] WARNING: chroot access! Mar 17 01:00:21 offine-stand-stor-0 [ 2053.622210] eth0: renamed from tmp3c765 Mar 17 01:00:21 offine-stand-stor-0 [ 2053.655478] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:00:21 offine-stand-stor-0 [ 2053.658053] IPv6: ADDRCONF(NETDEV_CHANGE): lxcdd044eeed86c: link becomes ready Mar 17 01:00:21 offine-stand-stor-0 [ 2054.178089] WARNING: chroot access! Mar 17 01:00:59 offine-stand-stor-0 [ 2054.237461] WARNING: chroot access! Mar 17 01:01:21 offine-stand-stor-0 [ 2091.817190] WARNING: chroot access! Mar 17 01:01:21 offine-stand-stor-0 [ 2113.618210] eth0: renamed from tmp5838f Mar 17 01:01:21 offine-stand-stor-0 [ 2113.657128] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:01:21 offine-stand-stor-0 [ 2113.660207] IPv6: ADDRCONF(NETDEV_CHANGE): lxc049549693f56: link becomes ready Mar 17 01:01:21 offine-stand-stor-0 [ 2114.234656] WARNING: chroot access! Mar 17 01:02:21 offine-stand-stor-0 [ 2114.346136] WARNING: chroot access! Mar 17 01:02:21 offine-stand-stor-0 [ 2174.082233] eth0: renamed from tmpe4b06 Mar 17 01:02:21 offine-stand-stor-0 [ 2174.134548] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:02:21 offine-stand-stor-0 [ 2174.135192] IPv6: ADDRCONF(NETDEV_CHANGE): lxc1db7c9f5c84b: link becomes ready Mar 17 01:02:22 offine-stand-stor-0 [ 2174.570868] WARNING: chroot access! Mar 17 01:03:21 offine-stand-stor-0 [ 2174.663625] WARNING: chroot access! Mar 17 01:03:21 offine-stand-stor-0 [ 2234.030200] eth0: renamed from tmp89f21 Mar 17 01:03:21 offine-stand-stor-0 [ 2234.074677] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:03:21 offine-stand-stor-0 [ 2234.075386] IPv6: ADDRCONF(NETDEV_CHANGE): lxc822c447e065d: link becomes ready Mar 17 01:03:21 offine-stand-stor-0 [ 2234.455873] WARNING: chroot access! Mar 17 01:04:21 offine-stand-stor-0 [ 2234.518418] WARNING: chroot access! Mar 17 01:04:21 offine-stand-stor-0 [ 2293.831627] eth0: renamed from tmp45a2e Mar 17 01:04:21 offine-stand-stor-0 [ 2293.873148] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:04:21 offine-stand-stor-0 [ 2293.875078] IPv6: ADDRCONF(NETDEV_CHANGE): lxc8a9248d05a3d: link becomes ready Mar 17 01:04:21 offine-stand-stor-0 [ 2294.346410] WARNING: chroot access! Mar 17 01:05:20 offine-stand-stor-0 [ 2294.427403] WARNING: chroot access! Mar 17 01:05:20 offine-stand-stor-0 [ 2353.267442] eth0: renamed from tmp0b149 Mar 17 01:05:20 offine-stand-stor-0 [ 2353.295912] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:05:20 offine-stand-stor-0 [ 2353.298733] IPv6: ADDRCONF(NETDEV_CHANGE): lxc59f16a29e66c: link becomes ready Mar 17 01:05:21 offine-stand-stor-0 [ 2353.800675] WARNING: chroot access! Mar 17 01:06:20 offine-stand-stor-0 [ 2353.879492] WARNING: chroot access! Mar 17 01:06:20 offine-stand-stor-0 [ 2413.287387] eth0: renamed from tmp7b5d2 Mar 17 01:06:20 offine-stand-stor-0 [ 2413.336158] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:06:20 offine-stand-stor-0 [ 2413.338708] IPv6: ADDRCONF(NETDEV_CHANGE): lxcb568934805b1: link becomes ready Mar 17 01:06:21 offine-stand-stor-0 [ 2413.879573] WARNING: chroot access! Mar 17 01:07:21 offine-stand-stor-0 [ 2413.959280] WARNING: chroot access! Mar 17 01:07:21 offine-stand-stor-0 [ 2474.131642] eth0: renamed from tmp7f5e2 Mar 17 01:07:21 offine-stand-stor-0 [ 2474.171955] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:07:21 offine-stand-stor-0 [ 2474.175241] IPv6: ADDRCONF(NETDEV_CHANGE): lxc0ac32348a99a: link becomes ready Mar 17 01:07:22 offine-stand-stor-0 [ 2474.711978] WARNING: chroot access! Mar 17 01:08:21 offine-stand-stor-0 [ 2474.817333] WARNING: chroot access! Mar 17 01:08:21 offine-stand-stor-0 [ 2534.075648] eth0: renamed from tmp323f9 Mar 17 01:08:21 offine-stand-stor-0 [ 2534.117684] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:08:21 offine-stand-stor-0 [ 2534.120667] IPv6: ADDRCONF(NETDEV_CHANGE): lxc4cff073e6d95: link becomes ready Mar 17 01:08:22 offine-stand-stor-0 [ 2534.630542] WARNING: chroot access! Mar 17 01:09:20 offine-stand-stor-0 [ 2534.745732] WARNING: chroot access! Mar 17 01:09:20 offine-stand-stor-0 [ 2593.378282] eth0: renamed from tmp25781 Mar 17 01:09:20 offine-stand-stor-0 [ 2593.402291] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:09:20 offine-stand-stor-0 [ 2593.402697] IPv6: ADDRCONF(NETDEV_CHANGE): lxc07be685600fc: link becomes ready Mar 17 01:09:21 offine-stand-stor-0 [ 2593.893348] WARNING: chroot access! Mar 17 01:10:21 offine-stand-stor-0 [ 2593.985686] WARNING: chroot access! Mar 17 01:10:21 offine-stand-stor-0 [ 2654.059633] eth0: renamed from tmpd27ce Mar 17 01:10:21 offine-stand-stor-0 [ 2654.099695] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:10:21 offine-stand-stor-0 [ 2654.101686] IPv6: ADDRCONF(NETDEV_CHANGE): lxc3abb8a582a24: link becomes ready Mar 17 01:10:22 offine-stand-stor-0 [ 2654.580271] WARNING: chroot access! Mar 17 01:11:10 offine-stand-stor-0 [ 2654.676192] WARNING: chroot access! Mar 17 01:11:21 offine-stand-stor-0 [ 2702.919241] WARNING: chroot access! Mar 17 01:11:21 offine-stand-stor-0 [ 2714.055556] eth0: renamed from tmp19026 Mar 17 01:11:21 offine-stand-stor-0 [ 2714.099926] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:11:21 offine-stand-stor-0 [ 2714.102400] IPv6: ADDRCONF(NETDEV_CHANGE): lxc48754d6cbdfa: link becomes ready Mar 17 01:11:22 offine-stand-stor-0 [ 2714.610858] WARNING: chroot access! Mar 17 01:12:21 offine-stand-stor-0 [ 2714.726358] WARNING: chroot access! Mar 17 01:12:21 offine-stand-stor-0 [ 2774.095731] eth0: renamed from tmpfa511 Mar 17 01:12:21 offine-stand-stor-0 [ 2774.145690] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:12:21 offine-stand-stor-0 [ 2774.148875] IPv6: ADDRCONF(NETDEV_CHANGE): lxceaa82c841c54: link becomes ready Mar 17 01:12:22 offine-stand-stor-0 [ 2774.629677] WARNING: chroot access! Mar 17 01:13:21 offine-stand-stor-0 [ 2774.740432] WARNING: chroot access! Mar 17 01:13:21 offine-stand-stor-0 [ 2833.862531] eth0: renamed from tmpd041c Mar 17 01:13:21 offine-stand-stor-0 [ 2833.886956] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:13:21 offine-stand-stor-0 [ 2833.887506] IPv6: ADDRCONF(NETDEV_CHANGE): lxc411bdd4d0a1a: link becomes ready Mar 17 01:13:21 offine-stand-stor-0 [ 2834.362539] WARNING: chroot access! Mar 17 01:14:20 offine-stand-stor-0 [ 2834.451406] WARNING: chroot access! Mar 17 01:14:20 offine-stand-stor-0 [ 2893.507548] eth0: renamed from tmp0e8a6 Mar 17 01:14:20 offine-stand-stor-0 [ 2893.539636] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:14:20 offine-stand-stor-0 [ 2893.541478] IPv6: ADDRCONF(NETDEV_CHANGE): lxcc048b7631c01: link becomes ready Mar 17 01:14:21 offine-stand-stor-0 [ 2894.066785] WARNING: chroot access! Mar 17 01:15:21 offine-stand-stor-0 [ 2894.133743] WARNING: chroot access! Mar 17 01:15:21 offine-stand-stor-0 [ 2954.055841] eth0: renamed from tmp3b5dd Mar 17 01:15:21 offine-stand-stor-0 [ 2954.084865] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:15:21 offine-stand-stor-0 [ 2954.087580] IPv6: ADDRCONF(NETDEV_CHANGE): lxc5e3399433533: link becomes ready Mar 17 01:15:22 offine-stand-stor-0 [ 2954.620548] WARNING: chroot access! Mar 17 01:16:21 offine-stand-stor-0 [ 2954.708017] WARNING: chroot access! Mar 17 01:16:21 offine-stand-stor-0 [ 3014.014498] eth0: renamed from tmpbca1f Mar 17 01:16:21 offine-stand-stor-0 [ 3014.042477] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:16:21 offine-stand-stor-0 [ 3014.042977] IPv6: ADDRCONF(NETDEV_CHANGE): lxcabc7828a144c: link becomes ready Mar 17 01:16:22 offine-stand-stor-0 [ 3014.559411] WARNING: chroot access! Mar 17 01:17:21 offine-stand-stor-0 [ 3014.694450] WARNING: chroot access! Mar 17 01:17:21 offine-stand-stor-0 [ 3074.063304] eth0: renamed from tmpc9c90 Mar 17 01:17:21 offine-stand-stor-0 [ 3074.092871] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:17:21 offine-stand-stor-0 [ 3074.094839] IPv6: ADDRCONF(NETDEV_CHANGE): lxc81ed3b823de3: link becomes ready Mar 17 01:17:21 offine-stand-stor-0 [ 3074.524474] WARNING: chroot access! Mar 17 01:18:21 offine-stand-stor-0 [ 3074.610376] WARNING: chroot access! Mar 17 01:18:21 offine-stand-stor-0 [ 3133.688861] WARNING: chroot access! Mar 17 01:18:21 offine-stand-stor-0 [ 3134.011482] eth0: renamed from tmp3d138 Mar 17 01:18:21 offine-stand-stor-0 [ 3134.046769] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:18:21 offine-stand-stor-0 [ 3134.047537] IPv6: ADDRCONF(NETDEV_CHANGE): lxc41e44863abf5: link becomes ready Mar 17 01:18:21 offine-stand-stor-0 [ 3134.463350] WARNING: chroot access! Mar 17 01:19:21 offine-stand-stor-0 [ 3134.543139] WARNING: chroot access! Mar 17 01:19:21 offine-stand-stor-0 [ 3193.678349] eth0: renamed from tmpd2267 Mar 17 01:19:21 offine-stand-stor-0 [ 3193.715935] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:19:21 offine-stand-stor-0 [ 3193.716603] IPv6: ADDRCONF(NETDEV_CHANGE): lxc9ee57bd575da: link becomes ready Mar 17 01:19:21 offine-stand-stor-0 [ 3194.164518] WARNING: chroot access! Mar 17 01:20:21 offine-stand-stor-0 [ 3194.278782] WARNING: chroot access! Mar 17 01:20:21 offine-stand-stor-0 [ 3253.787828] eth0: renamed from tmp0347f Mar 17 01:20:21 offine-stand-stor-0 [ 3253.815842] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:20:21 offine-stand-stor-0 [ 3253.817717] IPv6: ADDRCONF(NETDEV_CHANGE): lxc3517f4466172: link becomes ready Mar 17 01:20:21 offine-stand-stor-0 [ 3254.364459] WARNING: chroot access! Mar 17 01:21:21 offine-stand-stor-0 [ 3254.474230] WARNING: chroot access! Mar 17 01:21:21 offine-stand-stor-0 [ 3314.343929] eth0: renamed from tmpeb0c5 Mar 17 01:21:21 offine-stand-stor-0 [ 3314.383974] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:21:21 offine-stand-stor-0 [ 3314.386529] IPv6: ADDRCONF(NETDEV_CHANGE): lxc0b6f5375c8a2: link becomes ready Mar 17 01:21:22 offine-stand-stor-0 [ 3314.951320] WARNING: chroot access! Mar 17 01:22:21 offine-stand-stor-0 [ 3315.069241] WARNING: chroot access! Mar 17 01:22:21 offine-stand-stor-0 [ 3373.810499] eth0: renamed from tmpf2f78 Mar 17 01:22:21 offine-stand-stor-0 [ 3373.871187] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:22:21 offine-stand-stor-0 [ 3373.871817] IPv6: ADDRCONF(NETDEV_CHANGE): lxcfb8f0f860831: link becomes ready Mar 17 01:22:21 offine-stand-stor-0 [ 3374.390084] WARNING: chroot access! Mar 17 01:23:21 offine-stand-stor-0 [ 3374.480195] WARNING: chroot access! Mar 17 01:23:21 offine-stand-stor-0 [ 3433.879349] eth0: renamed from tmp7a7d0 Mar 17 01:23:21 offine-stand-stor-0 [ 3433.921256] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:23:21 offine-stand-stor-0 [ 3433.922902] IPv6: ADDRCONF(NETDEV_CHANGE): lxcf7683daf2c8a: link becomes ready Mar 17 01:23:21 offine-stand-stor-0 [ 3434.461034] WARNING: chroot access! Mar 17 01:24:21 offine-stand-stor-0 [ 3434.526611] WARNING: chroot access! Mar 17 01:24:21 offine-stand-stor-0 [ 3493.659208] eth0: renamed from tmp68bc8 Mar 17 01:24:21 offine-stand-stor-0 [ 3493.687430] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:24:21 offine-stand-stor-0 [ 3493.688904] IPv6: ADDRCONF(NETDEV_CHANGE): lxc7006ed3154e7: link becomes ready Mar 17 01:24:21 offine-stand-stor-0 [ 3494.259980] WARNING: chroot access! Mar 17 01:25:21 offine-stand-stor-0 [ 3494.360380] WARNING: chroot access! Mar 17 01:25:21 offine-stand-stor-0 [ 3553.822644] eth0: renamed from tmpd1595 Mar 17 01:25:21 offine-stand-stor-0 [ 3553.858792] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:25:21 offine-stand-stor-0 [ 3553.859262] IPv6: ADDRCONF(NETDEV_CHANGE): lxc2ecc67e49748: link becomes ready Mar 17 01:25:21 offine-stand-stor-0 [ 3554.257140] WARNING: chroot access! Mar 17 01:25:42 offine-stand-stor-0 [ 3554.403529] WARNING: chroot access! Mar 17 01:26:21 offine-stand-stor-0 [ 3574.870829] WARNING: chroot access! Mar 17 01:26:21 offine-stand-stor-0 [ 3613.886797] eth0: renamed from tmp08303 Mar 17 01:26:21 offine-stand-stor-0 [ 3613.911882] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:26:21 offine-stand-stor-0 [ 3613.914035] IPv6: ADDRCONF(NETDEV_CHANGE): lxcb8af7ffa5fda: link becomes ready Mar 17 01:26:21 offine-stand-stor-0 [ 3614.361209] WARNING: chroot access! Mar 17 01:27:20 offine-stand-stor-0 [ 3614.439574] WARNING: chroot access! Mar 17 01:27:20 offine-stand-stor-0 [ 3673.466754] eth0: renamed from tmpf2932 Mar 17 01:27:20 offine-stand-stor-0 [ 3673.490796] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:27:20 offine-stand-stor-0 [ 3673.491286] IPv6: ADDRCONF(NETDEV_CHANGE): lxcc9080d4da290: link becomes ready Mar 17 01:27:21 offine-stand-stor-0 [ 3673.956519] WARNING: chroot access! Mar 17 01:28:21 offine-stand-stor-0 [ 3674.059086] WARNING: chroot access! Mar 17 01:28:21 offine-stand-stor-0 [ 3733.798759] eth0: renamed from tmp5754a Mar 17 01:28:21 offine-stand-stor-0 [ 3733.832121] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:28:21 offine-stand-stor-0 [ 3733.834395] IPv6: ADDRCONF(NETDEV_CHANGE): lxc8b9596f699ed: link becomes ready Mar 17 01:28:21 offine-stand-stor-0 [ 3734.407553] WARNING: chroot access! Mar 17 01:29:21 offine-stand-stor-0 [ 3734.515160] WARNING: chroot access! Mar 17 01:29:21 offine-stand-stor-0 [ 3793.834734] eth0: renamed from tmp46780 Mar 17 01:29:21 offine-stand-stor-0 [ 3793.859420] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:29:21 offine-stand-stor-0 [ 3793.860169] IPv6: ADDRCONF(NETDEV_CHANGE): lxcef4e6f6bc2a1: link becomes ready Mar 17 01:29:21 offine-stand-stor-0 [ 3794.324053] WARNING: chroot access! Mar 17 01:30:21 offine-stand-stor-0 [ 3794.415646] WARNING: chroot access! Mar 17 01:30:21 offine-stand-stor-0 [ 3853.790744] eth0: renamed from tmpf9d70 Mar 17 01:30:21 offine-stand-stor-0 [ 3853.819643] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:30:21 offine-stand-stor-0 [ 3853.821180] IPv6: ADDRCONF(NETDEV_CHANGE): lxc22f999aee1fb: link becomes ready Mar 17 01:30:21 offine-stand-stor-0 [ 3854.323093] WARNING: chroot access! Mar 17 01:31:21 offine-stand-stor-0 [ 3854.383273] WARNING: chroot access! Mar 17 01:31:21 offine-stand-stor-0 [ 3913.990724] eth0: renamed from tmp35a52 Mar 17 01:31:21 offine-stand-stor-0 [ 3914.015222] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:31:21 offine-stand-stor-0 [ 3914.015705] IPv6: ADDRCONF(NETDEV_CHANGE): lxcf207b38df9de: link becomes ready Mar 17 01:31:22 offine-stand-stor-0 [ 3914.511388] WARNING: chroot access! Mar 17 01:32:21 offine-stand-stor-0 [ 3914.641960] WARNING: chroot access! Mar 17 01:32:21 offine-stand-stor-0 [ 3973.842829] eth0: renamed from tmp0ee52 Mar 17 01:32:21 offine-stand-stor-0 [ 3973.862826] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:32:21 offine-stand-stor-0 [ 3973.863326] IPv6: ADDRCONF(NETDEV_CHANGE): lxc798011f164f8: link becomes ready Mar 17 01:32:21 offine-stand-stor-0 [ 3974.296026] WARNING: chroot access! Mar 17 01:33:00 offine-stand-stor-0 [ 3974.417355] WARNING: chroot access! Mar 17 01:33:00 offine-stand-stor-0 [ 4013.515258] fastvps_test Mar 17 01:33:21 offine-stand-stor-0 [ 4034.000022] eth0: renamed from tmp08eae Mar 17 01:33:21 offine-stand-stor-0 [ 4034.036459] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:33:21 offine-stand-stor-0 [ 4034.039634] IPv6: ADDRCONF(NETDEV_CHANGE): lxcb3ed8865e5b1: link becomes ready Mar 17 01:33:22 offine-stand-stor-0 [ 4034.531215] WARNING: chroot access! Mar 17 01:33:34 offine-stand-stor-0 [ 4034.641703] WARNING: chroot access! Mar 17 01:34:21 offine-stand-stor-0 [ 4046.900570] WARNING: chroot access! Mar 17 01:34:21 offine-stand-stor-0 [ 4093.662460] eth0: renamed from tmp860cd Mar 17 01:34:21 offine-stand-stor-0 [ 4093.696100] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:34:21 offine-stand-stor-0 [ 4093.698203] IPv6: ADDRCONF(NETDEV_CHANGE): lxcbed3841de943: link becomes ready Mar 17 01:34:21 offine-stand-stor-0 [ 4094.161027] WARNING: chroot access! Mar 17 01:35:21 offine-stand-stor-0 [ 4094.247381] WARNING: chroot access! Mar 17 01:35:21 offine-stand-stor-0 [ 4154.120225] eth0: renamed from tmp78e00 Mar 17 01:35:21 offine-stand-stor-0 [ 4154.148149] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:35:21 offine-stand-stor-0 [ 4154.150810] IPv6: ADDRCONF(NETDEV_CHANGE): lxced22eadfc78b: link becomes ready Mar 17 01:35:22 offine-stand-stor-0 [ 4154.670237] WARNING: chroot access! Mar 17 01:36:21 offine-stand-stor-0 [ 4154.778995] WARNING: chroot access! Mar 17 01:36:21 offine-stand-stor-0 [ 4214.320353] eth0: renamed from tmp1f97e Mar 17 01:36:21 offine-stand-stor-0 [ 4214.362230] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:36:21 offine-stand-stor-0 [ 4214.371916] IPv6: ADDRCONF(NETDEV_CHANGE): lxc7db67e13f274: link becomes ready Mar 17 01:36:22 offine-stand-stor-0 [ 4214.891402] WARNING: chroot access! Mar 17 01:37:17 offine-stand-stor-0 [ 4214.972036] WARNING: chroot access! Mar 17 01:37:17 offine-stand-stor-0 [ 4269.671613] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-1: Preparing remote state change 2089656033 Mar 17 01:37:17 offine-stand-stor-0 [ 4269.692489] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-1: Committing remote state change 2089656033 (primary_nodes=0) Mar 17 01:37:17 offine-stand-stor-0 [ 4269.694211] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:17 offine-stand-stor-0 [ 4269.913051] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-1: Preparing remote state change 2041261575 Mar 17 01:37:17 offine-stand-stor-0 [ 4269.923300] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-1: Preparing remote state change 294840365 Mar 17 01:37:17 offine-stand-stor-0 [ 4269.929367] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-1: Committing remote state change 294840365 (primary_nodes=0) Mar 17 01:37:17 offine-stand-stor-0 [ 4269.934916] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:17 offine-stand-stor-0 [ 4269.948830] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-1: Committing remote state change 2041261575 (primary_nodes=0) Mar 17 01:37:17 offine-stand-stor-0 [ 4269.950556] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:17 offine-stand-stor-0 [ 4269.993328] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-1: Preparing remote state change 1994135412 Mar 17 01:37:17 offine-stand-stor-0 [ 4270.012456] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-1: Committing remote state change 1994135412 (primary_nodes=0) Mar 17 01:37:17 offine-stand-stor-0 [ 4270.015693] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:18 offine-stand-stor-0 [ 4270.655725] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-4: Preparing remote state change 2413179173 Mar 17 01:37:18 offine-stand-stor-0 [ 4270.670260] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-1: Preparing remote state change 162596002 Mar 17 01:37:18 offine-stand-stor-0 [ 4270.681282] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-1: Committing remote state change 162596002 (primary_nodes=0) Mar 17 01:37:18 offine-stand-stor-0 [ 4270.696264] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:18 offine-stand-stor-0 [ 4270.703825] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128: Enabling local AL-updates Mar 17 01:37:18 offine-stand-stor-0 [ 4270.706780] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-4: Committing remote state change 2413179173 (primary_nodes=0) Mar 17 01:37:18 offine-stand-stor-0 [ 4270.710119] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:18 offine-stand-stor-0 [ 4270.831927] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-1: Preparing remote state change 2919926411 Mar 17 01:37:18 offine-stand-stor-0 [ 4270.833223] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-1: Preparing remote state change 414633280 Mar 17 01:37:18 offine-stand-stor-0 [ 4270.843872] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-1: Committing remote state change 414633280 (primary_nodes=0) Mar 17 01:37:18 offine-stand-stor-0 [ 4270.851091] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:18 offine-stand-stor-0 [ 4270.853172] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-1: Committing remote state change 2919926411 (primary_nodes=0) Mar 17 01:37:18 offine-stand-stor-0 [ 4270.860483] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:18 offine-stand-stor-0 [ 4271.103582] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-4: Preparing remote state change 4103482018 Mar 17 01:37:18 offine-stand-stor-0 [ 4271.124639] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-4: Committing remote state change 4103482018 (primary_nodes=0) Mar 17 01:37:18 offine-stand-stor-0 [ 4271.148416] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:18 offine-stand-stor-0 [ 4271.153180] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:18 offine-stand-stor-0 [ 4271.158188] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129: Enabling local AL-updates Mar 17 01:37:18 offine-stand-stor-0 [ 4271.169351] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-4: Preparing remote state change 2440459402 Mar 17 01:37:18 offine-stand-stor-0 [ 4271.195211] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-4: Committing remote state change 2440459402 (primary_nodes=0) Mar 17 01:37:18 offine-stand-stor-0 [ 4271.205990] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:18 offine-stand-stor-0 [ 4271.218960] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-3: Preparing remote state change 1003374164 Mar 17 01:37:18 offine-stand-stor-0 [ 4271.238740] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-3: Committing remote state change 1003374164 (primary_nodes=0) Mar 17 01:37:18 offine-stand-stor-0 [ 4271.243292] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:18 offine-stand-stor-0 [ 4271.291216] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-4: Preparing remote state change 1656701997 Mar 17 01:37:18 offine-stand-stor-0 [ 4271.308821] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-4: Committing remote state change 1656701997 (primary_nodes=0) Mar 17 01:37:18 offine-stand-stor-0 [ 4271.310273] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:18 offine-stand-stor-0 [ 4271.353687] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-4: Preparing remote state change 3884804286 Mar 17 01:37:18 offine-stand-stor-0 [ 4271.371261] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-4: Committing remote state change 3884804286 (primary_nodes=0) Mar 17 01:37:18 offine-stand-stor-0 [ 4271.372724] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:18 offine-stand-stor-0 [ 4271.424487] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-4: Preparing remote state change 3212943493 Mar 17 01:37:18 offine-stand-stor-0 [ 4271.445235] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-4: Committing remote state change 3212943493 (primary_nodes=0) Mar 17 01:37:18 offine-stand-stor-0 [ 4271.453909] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:18 offine-stand-stor-0 [ 4271.507046] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-4: Preparing remote state change 4031929381 Mar 17 01:37:18 offine-stand-stor-0 [ 4271.507944] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-3: Preparing remote state change 206140328 Mar 17 01:37:18 offine-stand-stor-0 [ 4271.518145] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-3: Committing remote state change 206140328 (primary_nodes=0) Mar 17 01:37:18 offine-stand-stor-0 [ 4271.525740] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: Preparing remote state change 566601992 Mar 17 01:37:18 offine-stand-stor-0 [ 4271.526009] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:18 offine-stand-stor-0 [ 4271.546572] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: Committing remote state change 566601992 (primary_nodes=0) Mar 17 01:37:18 offine-stand-stor-0 [ 4271.558000] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:18 offine-stand-stor-0 [ 4271.561013] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-4: Committing remote state change 4031929381 (primary_nodes=0) Mar 17 01:37:18 offine-stand-stor-0 [ 4271.568223] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4271.716429] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-1: Preparing remote state change 3452463195 Mar 17 01:37:19 offine-stand-stor-0 [ 4271.737995] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-1: Committing remote state change 3452463195 (primary_nodes=0) Mar 17 01:37:19 offine-stand-stor-0 [ 4271.746187] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4271.754977] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-1: Preparing remote state change 180223741 Mar 17 01:37:19 offine-stand-stor-0 [ 4271.764538] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-1: Committing remote state change 180223741 (primary_nodes=0) Mar 17 01:37:19 offine-stand-stor-0 [ 4271.774584] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4271.798715] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-4: Preparing remote state change 1926209530 Mar 17 01:37:19 offine-stand-stor-0 [ 4271.804823] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-4: Committing remote state change 1926209530 (primary_nodes=0) Mar 17 01:37:19 offine-stand-stor-0 [ 4271.807601] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4271.818607] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-3: Preparing remote state change 2968756161 Mar 17 01:37:19 offine-stand-stor-0 [ 4271.834914] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-3: Preparing remote state change 2999372039 Mar 17 01:37:19 offine-stand-stor-0 [ 4271.836308] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-3: Committing remote state change 2968756161 (primary_nodes=0) Mar 17 01:37:19 offine-stand-stor-0 [ 4271.838401] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4271.840617] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-3: Committing remote state change 2999372039 (primary_nodes=0) Mar 17 01:37:19 offine-stand-stor-0 [ 4271.842929] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4271.843973] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027: Enabling local AL-updates Mar 17 01:37:19 offine-stand-stor-0 [ 4271.849126] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-4: Preparing remote state change 1617556932 Mar 17 01:37:19 offine-stand-stor-0 [ 4271.884884] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-4: Committing remote state change 1617556932 (primary_nodes=0) Mar 17 01:37:19 offine-stand-stor-0 [ 4271.886314] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4271.904059] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-3: Preparing remote state change 3923638860 Mar 17 01:37:19 offine-stand-stor-0 [ 4271.921727] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-3: Committing remote state change 3923638860 (primary_nodes=0) Mar 17 01:37:19 offine-stand-stor-0 [ 4271.923302] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4271.988989] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-4: Preparing remote state change 2238491940 Mar 17 01:37:19 offine-stand-stor-0 [ 4272.009666] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-4: Committing remote state change 2238491940 (primary_nodes=0) Mar 17 01:37:19 offine-stand-stor-0 [ 4272.016991] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4272.156637] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-3: Preparing remote state change 4269209310 Mar 17 01:37:19 offine-stand-stor-0 [ 4272.207315] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-3: Committing remote state change 4269209310 (primary_nodes=0) Mar 17 01:37:19 offine-stand-stor-0 [ 4272.214248] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4272.263217] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-1: Preparing remote state change 2025631203 Mar 17 01:37:19 offine-stand-stor-0 [ 4272.284239] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-1: Committing remote state change 2025631203 (primary_nodes=0) Mar 17 01:37:19 offine-stand-stor-0 [ 4272.308106] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:19 offine-stand-stor-0 [ 4272.312632] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4272.318197] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124: Enabling local AL-updates Mar 17 01:37:19 offine-stand-stor-0 [ 4272.339562] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-3: Preparing remote state change 2167944917 Mar 17 01:37:19 offine-stand-stor-0 [ 4272.368187] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-3: Committing remote state change 2167944917 (primary_nodes=0) Mar 17 01:37:19 offine-stand-stor-0 [ 4272.370159] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4272.375347] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-4: Preparing remote state change 3837922564 Mar 17 01:37:19 offine-stand-stor-0 [ 4272.385022] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-4: Committing remote state change 3837922564 (primary_nodes=0) Mar 17 01:37:19 offine-stand-stor-0 [ 4272.387132] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4272.441237] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-3: Preparing remote state change 2729742042 Mar 17 01:37:19 offine-stand-stor-0 [ 4272.466540] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-3: Committing remote state change 2729742042 (primary_nodes=0) Mar 17 01:37:19 offine-stand-stor-0 [ 4272.468075] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4272.468841] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021: Enabling local AL-updates Mar 17 01:37:19 offine-stand-stor-0 [ 4272.486583] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-4: Preparing remote state change 1292858030 Mar 17 01:37:19 offine-stand-stor-0 [ 4272.504173] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-4: Committing remote state change 1292858030 (primary_nodes=0) Mar 17 01:37:19 offine-stand-stor-0 [ 4272.516800] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-3: Preparing remote state change 1361358755 Mar 17 01:37:19 offine-stand-stor-0 [ 4272.522326] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:19 offine-stand-stor-0 [ 4272.523395] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4272.524398] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126: Enabling local AL-updates Mar 17 01:37:19 offine-stand-stor-0 [ 4272.565040] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-3: Committing remote state change 1361358755 (primary_nodes=0) Mar 17 01:37:19 offine-stand-stor-0 [ 4272.584614] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:19 offine-stand-stor-0 [ 4272.586302] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:19 offine-stand-stor-0 [ 4272.587656] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044: Enabling local AL-updates Mar 17 01:37:20 offine-stand-stor-0 [ 4272.684110] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-3: Preparing remote state change 1380026688 Mar 17 01:37:20 offine-stand-stor-0 [ 4272.704804] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-3: Committing remote state change 1380026688 (primary_nodes=0) Mar 17 01:37:20 offine-stand-stor-0 [ 4272.709917] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:20 offine-stand-stor-0 [ 4272.736506] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-4: Preparing remote state change 2245233775 Mar 17 01:37:20 offine-stand-stor-0 [ 4272.754213] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-4: Committing remote state change 2245233775 (primary_nodes=0) Mar 17 01:37:20 offine-stand-stor-0 [ 4272.756772] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:20 offine-stand-stor-0 [ 4272.820085] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: Preparing remote state change 1805101914 Mar 17 01:37:20 offine-stand-stor-0 [ 4272.837730] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: Committing remote state change 1805101914 (primary_nodes=0) Mar 17 01:37:20 offine-stand-stor-0 [ 4272.839385] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:20 offine-stand-stor-0 [ 4272.867059] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-4: Preparing remote state change 4048378887 Mar 17 01:37:20 offine-stand-stor-0 [ 4272.884689] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-4: Committing remote state change 4048378887 (primary_nodes=0) Mar 17 01:37:20 offine-stand-stor-0 [ 4272.886005] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-4: Preparing remote state change 2466746696 Mar 17 01:37:20 offine-stand-stor-0 [ 4272.886135] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:20 offine-stand-stor-0 [ 4272.889216] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-4: Committing remote state change 2466746696 (primary_nodes=0) Mar 17 01:37:20 offine-stand-stor-0 [ 4272.891244] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:20 offine-stand-stor-0 [ 4272.960492] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-3: Preparing remote state change 2155054380 Mar 17 01:37:20 offine-stand-stor-0 [ 4272.977964] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-3: Committing remote state change 2155054380 (primary_nodes=0) Mar 17 01:37:20 offine-stand-stor-0 [ 4272.996238] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:20 offine-stand-stor-0 [ 4272.997047] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:20 offine-stand-stor-0 [ 4272.997787] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032: Enabling local AL-updates Mar 17 01:37:20 offine-stand-stor-0 [ 4273.038323] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-1: Preparing remote state change 1208152891 Mar 17 01:37:20 offine-stand-stor-0 [ 4273.056093] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-1: Committing remote state change 1208152891 (primary_nodes=0) Mar 17 01:37:20 offine-stand-stor-0 [ 4273.057534] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:20 offine-stand-stor-0 [ 4273.084242] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-2: Preparing remote state change 2342407020 Mar 17 01:37:20 offine-stand-stor-0 [ 4273.101685] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-2: Committing remote state change 2342407020 (primary_nodes=0) Mar 17 01:37:20 offine-stand-stor-0 [ 4273.120061] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:20 offine-stand-stor-0 [ 4273.120779] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:20 offine-stand-stor-0 [ 4273.121481] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034: Enabling local AL-updates Mar 17 01:37:20 offine-stand-stor-0 [ 4273.168732] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-3: Preparing remote state change 215276891 Mar 17 01:37:20 offine-stand-stor-0 [ 4273.195440] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-3: Committing remote state change 215276891 (primary_nodes=0) Mar 17 01:37:20 offine-stand-stor-0 [ 4273.196897] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:20 offine-stand-stor-0 [ 4273.239723] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-3: Preparing remote state change 3045379791 Mar 17 01:37:20 offine-stand-stor-0 [ 4273.257179] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-3: Committing remote state change 3045379791 (primary_nodes=0) Mar 17 01:37:20 offine-stand-stor-0 [ 4273.275449] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:20 offine-stand-stor-0 [ 4273.276409] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:20 offine-stand-stor-0 [ 4273.277196] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037: Enabling local AL-updates Mar 17 01:37:20 offine-stand-stor-0 [ 4273.436097] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-4: Preparing remote state change 3566900872 Mar 17 01:37:20 offine-stand-stor-0 [ 4273.486132] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-4: Committing remote state change 3566900872 (primary_nodes=0) Mar 17 01:37:20 offine-stand-stor-0 [ 4273.489526] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-3: Preparing remote state change 3692079701 Mar 17 01:37:20 offine-stand-stor-0 [ 4273.498349] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132: bitmap WRITE of 1 pages took 8 ms Mar 17 01:37:20 offine-stand-stor-0 [ 4273.501097] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:20 offine-stand-stor-0 [ 4273.503603] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132: Enabling local AL-updates Mar 17 01:37:20 offine-stand-stor-0 [ 4273.515451] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-3: Committing remote state change 3692079701 (primary_nodes=0) Mar 17 01:37:20 offine-stand-stor-0 [ 4273.519789] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:20 offine-stand-stor-0 [ 4273.521156] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136: Enabling local AL-updates Mar 17 01:37:20 offine-stand-stor-0 [ 4273.540189] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-3: Preparing remote state change 1086095980 Mar 17 01:37:20 offine-stand-stor-0 [ 4273.559045] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-3: Committing remote state change 1086095980 (primary_nodes=0) Mar 17 01:37:20 offine-stand-stor-0 [ 4273.561666] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:20 offine-stand-stor-0 [ 4273.592614] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-1: Preparing remote state change 3467357233 Mar 17 01:37:20 offine-stand-stor-0 [ 4273.616546] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-4: Preparing remote state change 2722422385 Mar 17 01:37:21 offine-stand-stor-0 [ 4273.637594] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-1: Committing remote state change 3467357233 (primary_nodes=0) Mar 17 01:37:21 offine-stand-stor-0 [ 4273.639523] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-4: Committing remote state change 2722422385 (primary_nodes=0) Mar 17 01:37:21 offine-stand-stor-0 [ 4273.639897] eth0: renamed from tmpfb4f9 Mar 17 01:37:21 offine-stand-stor-0 [ 4273.642457] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:21 offine-stand-stor-0 [ 4273.656294] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:21 offine-stand-stor-0 [ 4273.657024] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:21 offine-stand-stor-0 [ 4273.657738] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117: Enabling local AL-updates Mar 17 01:37:21 offine-stand-stor-0 [ 4273.686842] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:37:21 offine-stand-stor-0 [ 4273.687765] IPv6: ADDRCONF(NETDEV_CHANGE): lxc5699a012db5f: link becomes ready Mar 17 01:37:21 offine-stand-stor-0 [ 4273.908779] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-2: Preparing remote state change 2428351097 Mar 17 01:37:21 offine-stand-stor-0 [ 4273.924972] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: Preparing remote state change 3405365224 Mar 17 01:37:21 offine-stand-stor-0 [ 4273.930312] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: Committing remote state change 3405365224 (primary_nodes=0) Mar 17 01:37:21 offine-stand-stor-0 [ 4273.934175] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:21 offine-stand-stor-0 [ 4273.935930] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123: Enabling local AL-updates Mar 17 01:37:21 offine-stand-stor-0 [ 4273.943053] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-2: Committing remote state change 2428351097 (primary_nodes=0) Mar 17 01:37:21 offine-stand-stor-0 [ 4273.944428] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:21 offine-stand-stor-0 [ 4273.945187] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049: Enabling local AL-updates Mar 17 01:37:21 offine-stand-stor-0 [ 4274.030374] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-3: Preparing remote state change 3014385329 Mar 17 01:37:21 offine-stand-stor-0 [ 4274.047985] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-3: Committing remote state change 3014385329 (primary_nodes=0) Mar 17 01:37:21 offine-stand-stor-0 [ 4274.066155] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:21 offine-stand-stor-0 [ 4274.066921] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:21 offine-stand-stor-0 [ 4274.067639] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068: Enabling local AL-updates Mar 17 01:37:21 offine-stand-stor-0 [ 4274.209189] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-2: Preparing remote state change 1326915531 Mar 17 01:37:21 offine-stand-stor-0 [ 4274.224448] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-4: Preparing remote state change 3722722141 Mar 17 01:37:21 offine-stand-stor-0 [ 4274.226725] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-2: Committing remote state change 1326915531 (primary_nodes=0) Mar 17 01:37:21 offine-stand-stor-0 [ 4274.229174] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:21 offine-stand-stor-0 [ 4274.229971] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-4: Committing remote state change 3722722141 (primary_nodes=0) Mar 17 01:37:21 offine-stand-stor-0 [ 4274.232347] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:21 offine-stand-stor-0 [ 4274.262637] WARNING: chroot access! Mar 17 01:37:21 offine-stand-stor-0 [ 4274.279205] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-3: Preparing remote state change 1215339930 Mar 17 01:37:21 offine-stand-stor-0 [ 4274.297410] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-3: Committing remote state change 1215339930 (primary_nodes=0) Mar 17 01:37:21 offine-stand-stor-0 [ 4274.316098] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:21 offine-stand-stor-0 [ 4274.316982] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:21 offine-stand-stor-0 [ 4274.317773] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056: Enabling local AL-updates Mar 17 01:37:21 offine-stand-stor-0 [ 4274.387496] WARNING: chroot access! Mar 17 01:37:21 offine-stand-stor-0 [ 4274.400328] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-3: Preparing remote state change 3618390820 Mar 17 01:37:21 offine-stand-stor-0 [ 4274.420902] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-3: Committing remote state change 3618390820 (primary_nodes=0) Mar 17 01:37:21 offine-stand-stor-0 [ 4274.423446] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:21 offine-stand-stor-0 [ 4274.478961] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-1: Preparing remote state change 392827762 Mar 17 01:37:21 offine-stand-stor-0 [ 4274.481802] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-3: Preparing remote state change 4035289892 Mar 17 01:37:21 offine-stand-stor-0 [ 4274.486695] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-3: Preparing remote state change 3551033769 Mar 17 01:37:21 offine-stand-stor-0 [ 4274.496435] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-1: Committing remote state change 392827762 (primary_nodes=0) Mar 17 01:37:21 offine-stand-stor-0 [ 4274.497880] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:21 offine-stand-stor-0 [ 4274.498886] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-3: Committing remote state change 4035289892 (primary_nodes=0) Mar 17 01:37:21 offine-stand-stor-0 [ 4274.500972] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:21 offine-stand-stor-0 [ 4274.503656] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-3: Committing remote state change 3551033769 (primary_nodes=0) Mar 17 01:37:21 offine-stand-stor-0 [ 4274.505570] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:21 offine-stand-stor-0 [ 4274.550777] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-4: Preparing remote state change 3039466762 Mar 17 01:37:21 offine-stand-stor-0 [ 4274.568259] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-4: Committing remote state change 3039466762 (primary_nodes=0) Mar 17 01:37:21 offine-stand-stor-0 [ 4274.570279] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:22 offine-stand-stor-0 [ 4274.706824] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-2: Preparing remote state change 3420234624 Mar 17 01:37:22 offine-stand-stor-0 [ 4274.727904] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-2: Committing remote state change 3420234624 (primary_nodes=0) Mar 17 01:37:22 offine-stand-stor-0 [ 4274.755381] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f/0 drbd1081: bitmap WRITE of 1 pages took 20 ms Mar 17 01:37:22 offine-stand-stor-0 [ 4274.760622] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:22 offine-stand-stor-0 [ 4274.766495] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f/0 drbd1081: Enabling local AL-updates Mar 17 01:37:22 offine-stand-stor-0 [ 4274.906606] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-3: Preparing remote state change 2788174050 Mar 17 01:37:22 offine-stand-stor-0 [ 4274.928571] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-3: Committing remote state change 2788174050 (primary_nodes=0) Mar 17 01:37:22 offine-stand-stor-0 [ 4274.936805] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:22 offine-stand-stor-0 [ 4274.940479] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023: Enabling local AL-updates Mar 17 01:37:22 offine-stand-stor-0 [ 4274.977175] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-3: Preparing remote state change 2745911065 Mar 17 01:37:22 offine-stand-stor-0 [ 4274.999933] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-3: Committing remote state change 2745911065 (primary_nodes=0) Mar 17 01:37:22 offine-stand-stor-0 [ 4275.010137] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:22 offine-stand-stor-0 [ 4275.034158] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-3: Preparing remote state change 1789389223 Mar 17 01:37:22 offine-stand-stor-0 [ 4275.054467] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-3: Committing remote state change 1789389223 (primary_nodes=0) Mar 17 01:37:22 offine-stand-stor-0 [ 4275.058157] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:22 offine-stand-stor-0 [ 4275.153599] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-4: Preparing remote state change 1704571539 Mar 17 01:37:22 offine-stand-stor-0 [ 4275.176559] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-4: Committing remote state change 1704571539 (primary_nodes=0) Mar 17 01:37:22 offine-stand-stor-0 [ 4275.188055] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:22 offine-stand-stor-0 [ 4275.203750] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-1: Preparing remote state change 3088656997 Mar 17 01:37:22 offine-stand-stor-0 [ 4275.214002] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-1: Committing remote state change 3088656997 (primary_nodes=0) Mar 17 01:37:22 offine-stand-stor-0 [ 4275.227422] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:22 offine-stand-stor-0 [ 4275.415063] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: Preparing remote state change 1239162729 Mar 17 01:37:22 offine-stand-stor-0 [ 4275.415140] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-4: Preparing remote state change 3601216267 Mar 17 01:37:22 offine-stand-stor-0 [ 4275.428232] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-4: Committing remote state change 3601216267 (primary_nodes=0) Mar 17 01:37:22 offine-stand-stor-0 [ 4275.436744] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: Committing remote state change 1239162729 (primary_nodes=0) Mar 17 01:37:22 offine-stand-stor-0 [ 4275.438438] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:22 offine-stand-stor-0 [ 4275.457793] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-3: Preparing remote state change 1721054241 Mar 17 01:37:22 offine-stand-stor-0 [ 4275.464073] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-3: Committing remote state change 1721054241 (primary_nodes=0) Mar 17 01:37:22 offine-stand-stor-0 [ 4275.465304] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:22 offine-stand-stor-0 [ 4275.471619] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:22 offine-stand-stor-0 [ 4275.475693] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:22 offine-stand-stor-0 [ 4275.481549] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074: Enabling local AL-updates Mar 17 01:37:22 offine-stand-stor-0 [ 4275.523168] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Preparing remote state change 1388357952 Mar 17 01:37:22 offine-stand-stor-0 [ 4275.541106] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Committing remote state change 1388357952 (primary_nodes=0) Mar 17 01:37:22 offine-stand-stor-0 [ 4275.560048] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:22 offine-stand-stor-0 [ 4275.561171] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:22 offine-stand-stor-0 [ 4275.562284] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: Enabling local AL-updates Mar 17 01:37:22 offine-stand-stor-0 [ 4275.616742] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-3: Preparing remote state change 3272664470 Mar 17 01:37:23 offine-stand-stor-0 [ 4275.637038] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-3: Committing remote state change 3272664470 (primary_nodes=0) Mar 17 01:37:23 offine-stand-stor-0 [ 4275.647440] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:23 offine-stand-stor-0 [ 4275.678053] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-4: Preparing remote state change 1704107362 Mar 17 01:37:23 offine-stand-stor-0 [ 4275.700603] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-4: Committing remote state change 1704107362 (primary_nodes=0) Mar 17 01:37:23 offine-stand-stor-0 [ 4275.706281] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-4: peer( Primary -> Secondary ) [remote] Mar 17 01:37:23 offine-stand-stor-0 [ 4275.836488] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-3: Preparing remote state change 920462388 Mar 17 01:37:23 offine-stand-stor-0 [ 4275.854614] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-3: Committing remote state change 920462388 (primary_nodes=0) Mar 17 01:37:23 offine-stand-stor-0 [ 4275.856454] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:23 offine-stand-stor-0 [ 4275.884441] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: Preparing remote state change 3971906908 Mar 17 01:37:23 offine-stand-stor-0 [ 4275.901998] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: Committing remote state change 3971906908 (primary_nodes=0) Mar 17 01:37:23 offine-stand-stor-0 [ 4275.903779] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:23 offine-stand-stor-0 [ 4275.955075] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-1: Preparing remote state change 2052740179 Mar 17 01:37:23 offine-stand-stor-0 [ 4275.972994] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-1: Committing remote state change 2052740179 (primary_nodes=0) Mar 17 01:37:23 offine-stand-stor-0 [ 4275.991954] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130: bitmap WRITE of 2 pages took 16 ms Mar 17 01:37:23 offine-stand-stor-0 [ 4275.992851] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-1: peer( Primary -> Secondary ) [remote] Mar 17 01:37:23 offine-stand-stor-0 [ 4275.993725] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130: Enabling local AL-updates Mar 17 01:37:23 offine-stand-stor-0 [ 4276.021030] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-2: Preparing remote state change 1333749463 Mar 17 01:37:23 offine-stand-stor-0 [ 4276.038882] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-2: Committing remote state change 1333749463 (primary_nodes=0) Mar 17 01:37:23 offine-stand-stor-0 [ 4276.041342] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:23 offine-stand-stor-0 [ 4276.042201] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046: Enabling local AL-updates Mar 17 01:37:23 offine-stand-stor-0 [ 4276.191660] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-3: Preparing remote state change 1601275515 Mar 17 01:37:23 offine-stand-stor-0 [ 4276.214782] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-3: Committing remote state change 1601275515 (primary_nodes=0) Mar 17 01:37:23 offine-stand-stor-0 [ 4276.241217] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:23 offine-stand-stor-0 [ 4276.243422] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:23 offine-stand-stor-0 [ 4276.245024] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030: Enabling local AL-updates Mar 17 01:37:24 offine-stand-stor-0 [ 4276.639048] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-2: Preparing remote state change 3604383996 Mar 17 01:37:24 offine-stand-stor-0 [ 4276.658102] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-2: Committing remote state change 3604383996 (primary_nodes=0) Mar 17 01:37:24 offine-stand-stor-0 [ 4276.665223] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:24 offine-stand-stor-0 [ 4276.697580] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-2: Preparing remote state change 515210523 Mar 17 01:37:24 offine-stand-stor-0 [ 4276.718176] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-2: Committing remote state change 515210523 (primary_nodes=0) Mar 17 01:37:24 offine-stand-stor-0 [ 4276.722480] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:24 offine-stand-stor-0 [ 4276.852464] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-3: Preparing remote state change 3958190787 Mar 17 01:37:24 offine-stand-stor-0 [ 4276.870182] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-3: Committing remote state change 3958190787 (primary_nodes=0) Mar 17 01:37:24 offine-stand-stor-0 [ 4276.872030] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:24 offine-stand-stor-0 [ 4276.900250] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-3: Preparing remote state change 1514182160 Mar 17 01:37:24 offine-stand-stor-0 [ 4276.920475] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-3: Committing remote state change 1514182160 (primary_nodes=0) Mar 17 01:37:24 offine-stand-stor-0 [ 4276.938568] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076: bitmap WRITE of 1 pages took 20 ms Mar 17 01:37:24 offine-stand-stor-0 [ 4276.939740] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:24 offine-stand-stor-0 [ 4276.940495] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076: Enabling local AL-updates Mar 17 01:37:24 offine-stand-stor-0 [ 4276.959557] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-3: Preparing remote state change 1459027196 Mar 17 01:37:24 offine-stand-stor-0 [ 4276.992158] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-3: Committing remote state change 1459027196 (primary_nodes=0) Mar 17 01:37:24 offine-stand-stor-0 [ 4276.993569] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:24 offine-stand-stor-0 [ 4277.076326] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-2: Preparing remote state change 2740020723 Mar 17 01:37:24 offine-stand-stor-0 [ 4277.093772] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-2: Committing remote state change 2740020723 (primary_nodes=0) Mar 17 01:37:24 offine-stand-stor-0 [ 4277.095850] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:24 offine-stand-stor-0 [ 4277.238253] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-3: Preparing remote state change 2399696285 Mar 17 01:37:24 offine-stand-stor-0 [ 4277.259814] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-3: Preparing remote state change 1966861963 Mar 17 01:37:24 offine-stand-stor-0 [ 4277.262735] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-3: Committing remote state change 2399696285 (primary_nodes=0) Mar 17 01:37:24 offine-stand-stor-0 [ 4277.264843] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:24 offine-stand-stor-0 [ 4277.265744] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062: Enabling local AL-updates Mar 17 01:37:24 offine-stand-stor-0 [ 4277.277290] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-3: Committing remote state change 1966861963 (primary_nodes=0) Mar 17 01:37:24 offine-stand-stor-0 [ 4277.278747] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:24 offine-stand-stor-0 [ 4277.400521] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-3: Preparing remote state change 140387969 Mar 17 01:37:24 offine-stand-stor-0 [ 4277.418053] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-3: Committing remote state change 140387969 (primary_nodes=0) Mar 17 01:37:24 offine-stand-stor-0 [ 4277.436381] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:24 offine-stand-stor-0 [ 4277.437111] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:24 offine-stand-stor-0 [ 4277.437819] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071: Enabling local AL-updates Mar 17 01:37:24 offine-stand-stor-0 [ 4277.451643] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-3: Preparing remote state change 3479990632 Mar 17 01:37:24 offine-stand-stor-0 [ 4277.465172] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-3: Committing remote state change 3479990632 (primary_nodes=0) Mar 17 01:37:24 offine-stand-stor-0 [ 4277.467272] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:24 offine-stand-stor-0 [ 4277.558878] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: Preparing remote state change 1651897543 Mar 17 01:37:24 offine-stand-stor-0 [ 4277.568363] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-3: Preparing remote state change 1146188813 Mar 17 01:37:24 offine-stand-stor-0 [ 4277.572291] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-3: Committing remote state change 1146188813 (primary_nodes=0) Mar 17 01:37:24 offine-stand-stor-0 [ 4277.574885] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:24 offine-stand-stor-0 [ 4277.576002] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011: Enabling local AL-updates Mar 17 01:37:24 offine-stand-stor-0 [ 4277.576740] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: Committing remote state change 1651897543 (primary_nodes=0) Mar 17 01:37:24 offine-stand-stor-0 [ 4277.578897] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-3: Preparing remote state change 3960874020 Mar 17 01:37:24 offine-stand-stor-0 [ 4277.578936] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:24 offine-stand-stor-0 [ 4277.580635] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039: Enabling local AL-updates Mar 17 01:37:24 offine-stand-stor-0 [ 4277.583851] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-3: Committing remote state change 3960874020 (primary_nodes=0) Mar 17 01:37:24 offine-stand-stor-0 [ 4277.585827] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:25 offine-stand-stor-0 [ 4277.634183] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: Preparing remote state change 2071050482 Mar 17 01:37:25 offine-stand-stor-0 [ 4277.652649] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-3: Preparing remote state change 3668104077 Mar 17 01:37:25 offine-stand-stor-0 [ 4277.673953] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-3: Preparing remote state change 2759699300 Mar 17 01:37:25 offine-stand-stor-0 [ 4277.674239] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: Committing remote state change 2071050482 (primary_nodes=0) Mar 17 01:37:25 offine-stand-stor-0 [ 4277.675574] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-3: Committing remote state change 3668104077 (primary_nodes=0) Mar 17 01:37:25 offine-stand-stor-0 [ 4277.678207] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:25 offine-stand-stor-0 [ 4277.680465] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:25 offine-stand-stor-0 [ 4277.681676] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065: Enabling local AL-updates Mar 17 01:37:25 offine-stand-stor-0 [ 4277.691899] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-3: Committing remote state change 2759699300 (primary_nodes=0) Mar 17 01:37:25 offine-stand-stor-0 [ 4277.693578] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:25 offine-stand-stor-0 [ 4277.770518] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-3: Preparing remote state change 1966089338 Mar 17 01:37:25 offine-stand-stor-0 [ 4277.788142] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-3: Committing remote state change 1966089338 (primary_nodes=0) Mar 17 01:37:25 offine-stand-stor-0 [ 4277.789762] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-3: peer( Primary -> Secondary ) [remote] Mar 17 01:37:25 offine-stand-stor-0 [ 4277.897781] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-2: Preparing remote state change 2183062029 Mar 17 01:37:25 offine-stand-stor-0 [ 4277.915607] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-2: Committing remote state change 2183062029 (primary_nodes=0) Mar 17 01:37:25 offine-stand-stor-0 [ 4277.917506] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:25 offine-stand-stor-0 [ 4277.960996] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-2: Preparing remote state change 1056697785 Mar 17 01:37:25 offine-stand-stor-0 [ 4277.978589] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-2: Committing remote state change 1056697785 (primary_nodes=0) Mar 17 01:37:25 offine-stand-stor-0 [ 4277.980220] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:25 offine-stand-stor-0 [ 4278.473545] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-2: Preparing remote state change 3902806953 Mar 17 01:37:25 offine-stand-stor-0 [ 4278.491165] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-2: Committing remote state change 3902806953 (primary_nodes=0) Mar 17 01:37:25 offine-stand-stor-0 [ 4278.492902] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:26 offine-stand-stor-0 [ 4278.776305] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-2: Preparing remote state change 2511619865 Mar 17 01:37:26 offine-stand-stor-0 [ 4278.793804] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-2: Committing remote state change 2511619865 (primary_nodes=0) Mar 17 01:37:26 offine-stand-stor-0 [ 4278.795649] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:27 offine-stand-stor-0 [ 4280.214105] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-2: Preparing remote state change 955997342 Mar 17 01:37:27 offine-stand-stor-0 [ 4280.237269] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-2: Committing remote state change 955997342 (primary_nodes=0) Mar 17 01:37:27 offine-stand-stor-0 [ 4280.261473] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:27 offine-stand-stor-0 [ 4280.265500] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:27 offine-stand-stor-0 [ 4280.269186] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119: Enabling local AL-updates Mar 17 01:37:29 offine-stand-stor-0 [ 4281.720213] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-2: Preparing remote state change 3055921968 Mar 17 01:37:29 offine-stand-stor-0 [ 4281.737909] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-2: Committing remote state change 3055921968 (primary_nodes=0) Mar 17 01:37:29 offine-stand-stor-0 [ 4281.739428] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:29 offine-stand-stor-0 [ 4281.740243] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048: Enabling local AL-updates Mar 17 01:37:29 offine-stand-stor-0 [ 4282.557582] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-2: Preparing remote state change 397383629 Mar 17 01:37:29 offine-stand-stor-0 [ 4282.578650] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-2: Committing remote state change 397383629 (primary_nodes=0) Mar 17 01:37:29 offine-stand-stor-0 [ 4282.587301] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:30 offine-stand-stor-0 [ 4282.851288] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479 offline-stand-stor-2: Preparing remote state change 1423914659 Mar 17 01:37:30 offine-stand-stor-0 [ 4282.871771] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479 offline-stand-stor-2: Committing remote state change 1423914659 (primary_nodes=0) Mar 17 01:37:30 offine-stand-stor-0 [ 4282.899429] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479/0 drbd1070: bitmap WRITE of 1 pages took 20 ms Mar 17 01:37:30 offine-stand-stor-0 [ 4282.904946] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:30 offine-stand-stor-0 [ 4282.909879] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479/0 drbd1070: Enabling local AL-updates Mar 17 01:37:31 offine-stand-stor-0 [ 4283.973508] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-2: Preparing remote state change 1003575076 Mar 17 01:37:31 offine-stand-stor-0 [ 4284.007166] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-2: Committing remote state change 1003575076 (primary_nodes=0) Mar 17 01:37:31 offine-stand-stor-0 [ 4284.009425] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:31 offine-stand-stor-0 [ 4284.010601] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028: Enabling local AL-updates Mar 17 01:37:31 offine-stand-stor-0 [ 4284.391721] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-2: Preparing remote state change 405021989 Mar 17 01:37:31 offine-stand-stor-0 [ 4284.423651] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-2: Committing remote state change 405021989 (primary_nodes=0) Mar 17 01:37:31 offine-stand-stor-0 [ 4284.425097] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:32 offine-stand-stor-0 [ 4284.859495] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-2: Preparing remote state change 2747363137 Mar 17 01:37:32 offine-stand-stor-0 [ 4284.883524] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-2: Committing remote state change 2747363137 (primary_nodes=0) Mar 17 01:37:32 offine-stand-stor-0 [ 4284.903634] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083: bitmap WRITE of 1 pages took 16 ms Mar 17 01:37:32 offine-stand-stor-0 [ 4284.904492] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:32 offine-stand-stor-0 [ 4284.905326] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083: Enabling local AL-updates Mar 17 01:37:32 offine-stand-stor-0 [ 4284.988169] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-2: Preparing remote state change 2155377468 Mar 17 01:37:32 offine-stand-stor-0 [ 4285.012649] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-2: Committing remote state change 2155377468 (primary_nodes=0) Mar 17 01:37:32 offine-stand-stor-0 [ 4285.030773] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036: bitmap WRITE of 1 pages took 20 ms Mar 17 01:37:32 offine-stand-stor-0 [ 4285.031821] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:32 offine-stand-stor-0 [ 4285.032513] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036: Enabling local AL-updates Mar 17 01:37:32 offine-stand-stor-0 [ 4285.038604] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-2: Preparing remote state change 3413120662 Mar 17 01:37:32 offine-stand-stor-0 [ 4285.040621] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-2: Preparing remote state change 3466857644 Mar 17 01:37:32 offine-stand-stor-0 [ 4285.046135] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-2: Committing remote state change 3413120662 (primary_nodes=0) Mar 17 01:37:32 offine-stand-stor-0 [ 4285.048611] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-2: Committing remote state change 3466857644 (primary_nodes=0) Mar 17 01:37:32 offine-stand-stor-0 [ 4285.050303] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:32 offine-stand-stor-0 [ 4285.051461] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:32 offine-stand-stor-0 [ 4285.052711] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073: Enabling local AL-updates Mar 17 01:37:32 offine-stand-stor-0 [ 4285.110842] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-2: Preparing remote state change 2154265370 Mar 17 01:37:32 offine-stand-stor-0 [ 4285.116267] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-2: Preparing remote state change 3852835349 Mar 17 01:37:32 offine-stand-stor-0 [ 4285.118055] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-2: Preparing remote state change 3113492008 Mar 17 01:37:32 offine-stand-stor-0 [ 4285.144454] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-2: Committing remote state change 3852835349 (primary_nodes=0) Mar 17 01:37:32 offine-stand-stor-0 [ 4285.145243] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-2: Committing remote state change 2154265370 (primary_nodes=0) Mar 17 01:37:32 offine-stand-stor-0 [ 4285.148527] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:32 offine-stand-stor-0 [ 4285.148536] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:32 offine-stand-stor-0 [ 4285.149474] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033: Enabling local AL-updates Mar 17 01:37:32 offine-stand-stor-0 [ 4285.150623] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077: Enabling local AL-updates Mar 17 01:37:32 offine-stand-stor-0 [ 4285.150949] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-2: Committing remote state change 3113492008 (primary_nodes=0) Mar 17 01:37:32 offine-stand-stor-0 [ 4285.150955] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:32 offine-stand-stor-0 [ 4285.171953] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-2: Preparing remote state change 2230933240 Mar 17 01:37:32 offine-stand-stor-0 [ 4285.189707] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-2: Committing remote state change 2230933240 (primary_nodes=0) Mar 17 01:37:32 offine-stand-stor-0 [ 4285.191140] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:32 offine-stand-stor-0 [ 4285.224223] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-2: Preparing remote state change 175382300 Mar 17 01:37:32 offine-stand-stor-0 [ 4285.242073] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-2: Committing remote state change 175382300 (primary_nodes=0) Mar 17 01:37:32 offine-stand-stor-0 [ 4285.244565] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:32 offine-stand-stor-0 [ 4285.245425] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067: Enabling local AL-updates Mar 17 01:37:32 offine-stand-stor-0 [ 4285.300747] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-2: Preparing remote state change 1828960857 Mar 17 01:37:32 offine-stand-stor-0 [ 4285.318517] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-2: Committing remote state change 1828960857 (primary_nodes=0) Mar 17 01:37:32 offine-stand-stor-0 [ 4285.319977] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:33 offine-stand-stor-0 [ 4285.853378] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-2: Preparing remote state change 3895892730 Mar 17 01:37:33 offine-stand-stor-0 [ 4285.874592] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-2: Committing remote state change 3895892730 (primary_nodes=0) Mar 17 01:37:33 offine-stand-stor-0 [ 4285.884055] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:33 offine-stand-stor-0 [ 4285.888811] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016: Enabling local AL-updates Mar 17 01:37:33 offine-stand-stor-0 [ 4286.327569] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-2: Preparing remote state change 3874732076 Mar 17 01:37:33 offine-stand-stor-0 [ 4286.348364] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-2: Committing remote state change 3874732076 (primary_nodes=0) Mar 17 01:37:33 offine-stand-stor-0 [ 4286.356617] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-2: peer( Primary -> Secondary ) [remote] Mar 17 01:37:55 offine-stand-stor-0 [ 4307.893197] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:37:55 offine-stand-stor-0 [ 4307.894924] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955: State change failed: State change was refused by peer node (-10) Mar 17 01:37:55 offine-stand-stor-0 [ 4307.895983] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955/0 drbd1041 offline-stand-stor-3: Failed: pdsk( UpToDate -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:37:55 offine-stand-stor-0 [ 4307.902352] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:37:55 offine-stand-stor-0 [ 4307.905029] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955: State change failed: State change was refused by peer node (-10) Mar 17 01:37:55 offine-stand-stor-0 [ 4307.906181] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955/0 drbd1041 offline-stand-stor-2: Failed: pdsk( UpToDate -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:37:55 offine-stand-stor-0 [ 4308.058485] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-3: Preparing remote state change 2555591473 Mar 17 01:37:55 offine-stand-stor-0 [ 4308.076034] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-3: Committing remote state change 2555591473 (primary_nodes=0) Mar 17 01:37:55 offine-stand-stor-0 [ 4308.078024] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-3: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:37:55 offine-stand-stor-0 [ 4308.096727] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-3: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:37:55 offine-stand-stor-0 [ 4308.124283] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-2: Preparing remote state change 930695425 Mar 17 01:37:55 offine-stand-stor-0 [ 4308.142084] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-2: Committing remote state change 930695425 (primary_nodes=0) Mar 17 01:37:55 offine-stand-stor-0 [ 4308.144932] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-2: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:37:55 offine-stand-stor-0 [ 4308.147748] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-2: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:37:56 offine-stand-stor-0 [ 4309.448188] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-2: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) [down] Mar 17 01:37:56 offine-stand-stor-0 [ 4309.450782] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-2: Terminating sender thread Mar 17 01:37:56 offine-stand-stor-0 [ 4309.452744] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-2: Starting sender thread (from drbd_r_pvc-f4e4 [13886]) Mar 17 01:37:56 offine-stand-stor-0 [ 4309.490425] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-2: Connection closed Mar 17 01:37:56 offine-stand-stor-0 [ 4309.491938] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-2: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:37:56 offine-stand-stor-0 [ 4309.494300] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-2: Terminating receiver thread Mar 17 01:37:56 offine-stand-stor-0 [ 4309.512435] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-2: Terminating sender thread Mar 17 01:37:56 offine-stand-stor-0 [ 4309.530419] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-3: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) [down] Mar 17 01:37:56 offine-stand-stor-0 [ 4309.532359] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-3: Terminating sender thread Mar 17 01:37:56 offine-stand-stor-0 [ 4309.533535] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-3: Starting sender thread (from drbd_r_pvc-f4e4 [13888]) Mar 17 01:37:56 offine-stand-stor-0 [ 4309.550375] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955: Preparing cluster-wide state change 2397934280 (2->-1 0/0) Mar 17 01:37:56 offine-stand-stor-0 [ 4309.551426] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955: Committing cluster-wide state change 2397934280 (0ms) Mar 17 01:37:56 offine-stand-stor-0 [ 4309.590554] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-3: Connection closed Mar 17 01:37:56 offine-stand-stor-0 [ 4309.591478] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-3: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:37:56 offine-stand-stor-0 [ 4309.592998] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-3: Terminating receiver thread Mar 17 01:37:56 offine-stand-stor-0 [ 4309.610556] drbd pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955 offline-stand-stor-3: Terminating sender thread Mar 17 01:37:57 offine-stand-stor-0 [ 4309.674404] drbd /unregistered/pvc-f4e4803d-44e3-4ac3-80c4-fb152468c955: Terminating worker thread Mar 17 01:37:58 offine-stand-stor-0 [ 4311.404799] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-2: Preparing remote state change 4272850201 Mar 17 01:37:58 offine-stand-stor-0 [ 4311.422777] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-2: Committing remote state change 4272850201 (primary_nodes=0) Mar 17 01:37:58 offine-stand-stor-0 [ 4311.424409] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f/0 drbd1081 offline-stand-stor-2: pdsk( UpToDate -> Detaching ) [remote] Mar 17 01:37:58 offine-stand-stor-0 [ 4311.442750] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f/0 drbd1081 offline-stand-stor-2: pdsk( Detaching -> Diskless ) [peer-state] Mar 17 01:37:58 offine-stand-stor-0 [ 4311.482129] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f: Preparing cluster-wide state change 2026968047 (1->-1 7680/1024) Mar 17 01:37:58 offine-stand-stor-0 [ 4311.499749] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f: State change 2026968047: primary_nodes=0, weak_nodes=0 Mar 17 01:37:58 offine-stand-stor-0 [ 4311.500561] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f: Committing cluster-wide state change 2026968047 (20ms) Mar 17 01:37:58 offine-stand-stor-0 [ 4311.502452] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f/0 drbd1081: disk( UpToDate -> Detaching ) [detach] Mar 17 01:37:58 offine-stand-stor-0 [ 4311.506281] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f/0 drbd1081: Would lose quorum, but using tiebreaker logic to keep Mar 17 01:37:58 offine-stand-stor-0 [ 4311.529415] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f/0 drbd1081: disk( Detaching -> Diskless ) [go-diskless] Mar 17 01:37:58 offine-stand-stor-0 [ 4311.548273] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f/0 drbd1081: drbd_bm_resize called with capacity == 0 Mar 17 01:37:59 offine-stand-stor-0 [ 4311.959637] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:37:59 offine-stand-stor-0 [ 4311.968361] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f: State change failed: State change was refused by peer node (-10) Mar 17 01:37:59 offine-stand-stor-0 [ 4311.971917] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f: Failed: susp-io( no -> quorum ) [del-minor] Mar 17 01:37:59 offine-stand-stor-0 [ 4311.975503] drbd /unregistered/pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f/0 drbd1081: Failed: quorum( yes -> no ) [del-minor] Mar 17 01:37:59 offine-stand-stor-0 [ 4311.979841] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f/0 drbd1081 offline-stand-stor-3: Failed: pdsk( Diskless -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:37:59 offine-stand-stor-0 [ 4311.987459] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:37:59 offine-stand-stor-0 [ 4312.000602] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f: State change failed: State change was refused by peer node (-10) Mar 17 01:37:59 offine-stand-stor-0 [ 4312.007931] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f: Failed: susp-io( no -> quorum ) [del-minor] Mar 17 01:37:59 offine-stand-stor-0 [ 4312.016718] drbd /unregistered/pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f/0 drbd1081: Failed: quorum( yes -> no ) [del-minor] Mar 17 01:37:59 offine-stand-stor-0 [ 4312.035988] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f/0 drbd1081 offline-stand-stor-2: Failed: pdsk( Diskless -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:38:00 offine-stand-stor-0 [ 4312.694474] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) [del-peer] Mar 17 01:38:00 offine-stand-stor-0 [ 4312.696688] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f: Preparing cluster-wide state change 3060819382 (1->-1 0/0) Mar 17 01:38:00 offine-stand-stor-0 [ 4312.714730] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: Terminating sender thread Mar 17 01:38:00 offine-stand-stor-0 [ 4312.715974] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: Starting sender thread (from drbd_r_pvc-98eb [12497]) Mar 17 01:38:00 offine-stand-stor-0 [ 4312.739406] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f: State change 3060819382: primary_nodes=0, weak_nodes=0 Mar 17 01:38:00 offine-stand-stor-0 [ 4312.741718] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f: Committing cluster-wide state change 3060819382 (44ms) Mar 17 01:38:00 offine-stand-stor-0 [ 4312.760563] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: Connection closed Mar 17 01:38:00 offine-stand-stor-0 [ 4312.761614] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:38:00 offine-stand-stor-0 [ 4312.763366] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: Terminating receiver thread Mar 17 01:38:00 offine-stand-stor-0 [ 4312.764335] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: Terminating sender thread Mar 17 01:38:00 offine-stand-stor-0 [ 4312.803136] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: Starting sender thread (from drbdsetup [86494]) Mar 17 01:38:00 offine-stand-stor-0 [ 4312.810330] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:38:00 offine-stand-stor-0 [ 4312.811861] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-98eb [12472]) Mar 17 01:38:00 offine-stand-stor-0 [ 4312.816096] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:38:00 offine-stand-stor-0 [ 4312.819052] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-2: Preparing remote state change 803005500 Mar 17 01:38:00 offine-stand-stor-0 [ 4312.839878] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-2: Committing remote state change 803005500 (primary_nodes=0) Mar 17 01:38:00 offine-stand-stor-0 [ 4312.972806] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: conn( Connecting -> Disconnecting ) [del-peer] Mar 17 01:38:00 offine-stand-stor-0 [ 4312.976209] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: Terminating sender thread Mar 17 01:38:00 offine-stand-stor-0 [ 4312.978177] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: Starting sender thread (from drbd_r_pvc-98eb [86498]) Mar 17 01:38:00 offine-stand-stor-0 [ 4313.014387] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: Connection closed Mar 17 01:38:00 offine-stand-stor-0 [ 4313.015189] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:38:00 offine-stand-stor-0 [ 4313.016992] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: Terminating receiver thread Mar 17 01:38:00 offine-stand-stor-0 [ 4313.017968] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-3: Terminating sender thread Mar 17 01:38:00 offine-stand-stor-0 [ 4313.144139] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-2: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) [down] Mar 17 01:38:00 offine-stand-stor-0 [ 4313.145703] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-2: Terminating sender thread Mar 17 01:38:00 offine-stand-stor-0 [ 4313.146916] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-2: Starting sender thread (from drbd_r_pvc-98eb [12496]) Mar 17 01:38:00 offine-stand-stor-0 [ 4313.198534] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-2: Connection closed Mar 17 01:38:00 offine-stand-stor-0 [ 4313.199397] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-2: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:38:00 offine-stand-stor-0 [ 4313.201060] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-2: Terminating receiver thread Mar 17 01:38:00 offine-stand-stor-0 [ 4313.201826] drbd pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f offline-stand-stor-2: Terminating sender thread Mar 17 01:38:00 offine-stand-stor-0 [ 4313.250356] drbd /unregistered/pvc-98eb0f77-bb2f-4d76-bd38-47e74f4fda1f: Terminating worker thread Mar 17 01:38:01 offine-stand-stor-0 [ 4314.148264] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:38:01 offine-stand-stor-0 [ 4314.156087] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14: State change failed: State change was refused by peer node (-10) Mar 17 01:38:01 offine-stand-stor-0 [ 4314.159864] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14/0 drbd1058 offline-stand-stor-2: Failed: pdsk( UpToDate -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:38:01 offine-stand-stor-0 [ 4314.170450] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:38:01 offine-stand-stor-0 [ 4314.183896] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14: State change failed: State change was refused by peer node (-10) Mar 17 01:38:01 offine-stand-stor-0 [ 4314.189222] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14/0 drbd1058 offline-stand-stor-1: Failed: pdsk( UpToDate -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:38:01 offine-stand-stor-0 [ 4314.331411] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-1: Preparing remote state change 4232869310 Mar 17 01:38:01 offine-stand-stor-0 [ 4314.351836] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-1: Committing remote state change 4232869310 (primary_nodes=0) Mar 17 01:38:01 offine-stand-stor-0 [ 4314.360045] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-1: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:01 offine-stand-stor-0 [ 4314.368187] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-1: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:01 offine-stand-stor-0 [ 4314.376261] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: Preparing remote state change 3476584482 Mar 17 01:38:01 offine-stand-stor-0 [ 4314.397555] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: Committing remote state change 3476584482 (primary_nodes=0) Mar 17 01:38:01 offine-stand-stor-0 [ 4314.405592] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:01 offine-stand-stor-0 [ 4314.412543] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:02 offine-stand-stor-0 [ 4315.625181] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-1: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) [down] Mar 17 01:38:02 offine-stand-stor-0 [ 4315.626922] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-1: Terminating sender thread Mar 17 01:38:02 offine-stand-stor-0 [ 4315.628252] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-1: Starting sender thread (from drbd_r_pvc-945d [12426]) Mar 17 01:38:03 offine-stand-stor-0 [ 4315.674447] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-1: Connection closed Mar 17 01:38:03 offine-stand-stor-0 [ 4315.675641] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-1: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:38:03 offine-stand-stor-0 [ 4315.677288] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-1: Terminating receiver thread Mar 17 01:38:03 offine-stand-stor-0 [ 4315.692367] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: meta connection shut down by peer. Mar 17 01:38:03 offine-stand-stor-0 [ 4315.694882] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: sock was shut down by peer Mar 17 01:38:03 offine-stand-stor-0 [ 4315.696055] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: conn( Connected -> NetworkFailure ) peer( Secondary -> Unknown ) Mar 17 01:38:03 offine-stand-stor-0 [ 4315.699207] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: Terminating sender thread Mar 17 01:38:03 offine-stand-stor-0 [ 4315.700124] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: Starting sender thread (from drbd_r_pvc-945d [12428]) Mar 17 01:38:03 offine-stand-stor-0 [ 4315.701656] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-1: Terminating sender thread Mar 17 01:38:03 offine-stand-stor-0 [ 4315.726350] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14: Preparing cluster-wide state change 3633795417 (2->-1 0/0) Mar 17 01:38:03 offine-stand-stor-0 [ 4315.727163] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14: Committing cluster-wide state change 3633795417 (0ms) Mar 17 01:38:03 offine-stand-stor-0 [ 4315.744792] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: Connection closed Mar 17 01:38:03 offine-stand-stor-0 [ 4315.744808] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: conn( NetworkFailure -> Disconnecting ) [down] Mar 17 01:38:03 offine-stand-stor-0 [ 4315.747825] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:38:03 offine-stand-stor-0 [ 4315.749443] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: Terminating receiver thread Mar 17 01:38:03 offine-stand-stor-0 [ 4315.750280] drbd pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14 offline-stand-stor-2: Terminating sender thread Mar 17 01:38:03 offine-stand-stor-0 [ 4315.794375] drbd /unregistered/pvc-945d73a9-98cd-4ae2-a6a8-b371fd87ad14: Terminating worker thread Mar 17 01:38:06 offine-stand-stor-0 [ 4319.583084] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:38:06 offine-stand-stor-0 [ 4319.584916] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee: State change failed: State change was refused by peer node (-10) Mar 17 01:38:06 offine-stand-stor-0 [ 4319.585849] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee/0 drbd1007 offline-stand-stor-3: Failed: pdsk( UpToDate -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:38:06 offine-stand-stor-0 [ 4319.588214] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:38:07 offine-stand-stor-0 [ 4319.621123] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee: State change failed: State change was refused by peer node (-10) Mar 17 01:38:07 offine-stand-stor-0 [ 4319.637691] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee/0 drbd1007 offline-stand-stor-2: Failed: pdsk( UpToDate -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:38:07 offine-stand-stor-0 [ 4319.780895] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: Preparing remote state change 463307504 Mar 17 01:38:07 offine-stand-stor-0 [ 4319.823601] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: Committing remote state change 463307504 (primary_nodes=0) Mar 17 01:38:07 offine-stand-stor-0 [ 4319.842905] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-2: Preparing remote state change 3085007215 Mar 17 01:38:07 offine-stand-stor-0 [ 4319.860644] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:07 offine-stand-stor-0 [ 4319.862164] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:07 offine-stand-stor-0 [ 4319.863756] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-2: Committing remote state change 3085007215 (primary_nodes=0) Mar 17 01:38:07 offine-stand-stor-0 [ 4319.865422] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-2: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:07 offine-stand-stor-0 [ 4319.867736] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-2: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:08 offine-stand-stor-0 [ 4321.132358] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-2: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) [down] Mar 17 01:38:08 offine-stand-stor-0 [ 4321.135155] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-2: Terminating sender thread Mar 17 01:38:08 offine-stand-stor-0 [ 4321.137011] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-2: Starting sender thread (from drbd_r_pvc-ac02 [12728]) Mar 17 01:38:08 offine-stand-stor-0 [ 4321.186470] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-2: Connection closed Mar 17 01:38:08 offine-stand-stor-0 [ 4321.187283] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-2: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:38:08 offine-stand-stor-0 [ 4321.188910] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-2: Terminating receiver thread Mar 17 01:38:08 offine-stand-stor-0 [ 4321.206471] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-2: Terminating sender thread Mar 17 01:38:08 offine-stand-stor-0 [ 4321.238380] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee: Preparing cluster-wide state change 2339896467 (2->-1 0/0) Mar 17 01:38:08 offine-stand-stor-0 [ 4321.268381] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: sock was shut down by peer Mar 17 01:38:08 offine-stand-stor-0 [ 4321.268516] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: meta connection shut down by peer. Mar 17 01:38:08 offine-stand-stor-0 [ 4321.269636] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: conn( Connected -> BrokenPipe ) peer( Secondary -> Unknown ) Mar 17 01:38:08 offine-stand-stor-0 [ 4321.273671] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: meta connection shut down by peer. Mar 17 01:38:08 offine-stand-stor-0 [ 4321.273685] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee: Aborting cluster-wide state change 2339896467 (32ms) rv = -19 Mar 17 01:38:08 offine-stand-stor-0 [ 4321.276343] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: conn( BrokenPipe -> Disconnecting ) [down] Mar 17 01:38:08 offine-stand-stor-0 [ 4321.293003] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: Terminating sender thread Mar 17 01:38:08 offine-stand-stor-0 [ 4321.293972] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: Starting sender thread (from drbd_r_pvc-ac02 [12730]) Mar 17 01:38:08 offine-stand-stor-0 [ 4321.326522] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: Connection closed Mar 17 01:38:08 offine-stand-stor-0 [ 4321.328945] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:38:08 offine-stand-stor-0 [ 4321.335386] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: Terminating receiver thread Mar 17 01:38:08 offine-stand-stor-0 [ 4321.354925] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee offline-stand-stor-3: Terminating sender thread Mar 17 01:38:08 offine-stand-stor-0 [ 4321.378353] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee: Preparing cluster-wide state change 2959612557 (2->-1 0/0) Mar 17 01:38:08 offine-stand-stor-0 [ 4321.379255] drbd pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee: Committing cluster-wide state change 2959612557 (0ms) Mar 17 01:38:08 offine-stand-stor-0 [ 4321.418372] drbd /unregistered/pvc-ac02e6b5-73df-4a70-af0b-f05a2cd370ee: Terminating worker thread Mar 17 01:38:09 offine-stand-stor-0 [ 4322.456331] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:38:09 offine-stand-stor-0 [ 4322.463208] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779: State change failed: State change was refused by peer node (-10) Mar 17 01:38:09 offine-stand-stor-0 [ 4322.467012] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779/0 drbd1066 offline-stand-stor-3: Failed: pdsk( UpToDate -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:38:09 offine-stand-stor-0 [ 4322.482453] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:38:09 offine-stand-stor-0 [ 4322.494185] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779: State change failed: State change was refused by peer node (-10) Mar 17 01:38:09 offine-stand-stor-0 [ 4322.498610] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779/0 drbd1066 offline-stand-stor-2: Failed: pdsk( UpToDate -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:38:10 offine-stand-stor-0 [ 4322.662862] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-3: Preparing remote state change 431741529 Mar 17 01:38:10 offine-stand-stor-0 [ 4322.711664] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-3: Committing remote state change 431741529 (primary_nodes=0) Mar 17 01:38:10 offine-stand-stor-0 [ 4322.719234] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-2: Preparing remote state change 4101571557 Mar 17 01:38:10 offine-stand-stor-0 [ 4322.740350] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-2: Committing remote state change 4101571557 (primary_nodes=0) Mar 17 01:38:10 offine-stand-stor-0 [ 4322.747133] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-3: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:10 offine-stand-stor-0 [ 4322.754370] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-3: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:10 offine-stand-stor-0 [ 4322.763011] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-2: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:10 offine-stand-stor-0 [ 4322.763031] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-2: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:11 offine-stand-stor-0 [ 4324.101675] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-2: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) [down] Mar 17 01:38:11 offine-stand-stor-0 [ 4324.104271] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-2: Terminating sender thread Mar 17 01:38:11 offine-stand-stor-0 [ 4324.106086] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-2: Starting sender thread (from drbd_r_pvc-4293 [10987]) Mar 17 01:38:11 offine-stand-stor-0 [ 4324.150443] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-2: Connection closed Mar 17 01:38:11 offine-stand-stor-0 [ 4324.151256] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-2: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:38:11 offine-stand-stor-0 [ 4324.152848] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-2: Terminating receiver thread Mar 17 01:38:11 offine-stand-stor-0 [ 4324.164568] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-3: meta connection shut down by peer. Mar 17 01:38:11 offine-stand-stor-0 [ 4324.165676] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-3: conn( Connected -> NetworkFailure ) peer( Secondary -> Unknown ) Mar 17 01:38:11 offine-stand-stor-0 [ 4324.170399] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-3: sock was shut down by peer Mar 17 01:38:11 offine-stand-stor-0 [ 4324.171367] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-2: Terminating sender thread Mar 17 01:38:11 offine-stand-stor-0 [ 4324.172239] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-3: Terminating sender thread Mar 17 01:38:11 offine-stand-stor-0 [ 4324.173091] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-3: Starting sender thread (from drbd_r_pvc-4293 [10994]) Mar 17 01:38:11 offine-stand-stor-0 [ 4324.198428] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-3: Connection closed Mar 17 01:38:11 offine-stand-stor-0 [ 4324.198434] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-3: conn( NetworkFailure -> Disconnecting ) [down] Mar 17 01:38:11 offine-stand-stor-0 [ 4324.202129] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-3: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:38:11 offine-stand-stor-0 [ 4324.203759] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-3: Terminating receiver thread Mar 17 01:38:11 offine-stand-stor-0 [ 4324.204588] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779: Preparing cluster-wide state change 828066327 (2->-1 0/0) Mar 17 01:38:11 offine-stand-stor-0 [ 4324.205347] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779: Committing cluster-wide state change 828066327 (0ms) Mar 17 01:38:11 offine-stand-stor-0 [ 4324.206123] drbd pvc-4293ddf4-0423-468d-86f3-d1d6df903779 offline-stand-stor-3: Terminating sender thread Mar 17 01:38:11 offine-stand-stor-0 [ 4324.246361] drbd /unregistered/pvc-4293ddf4-0423-468d-86f3-d1d6df903779: Terminating worker thread Mar 17 01:38:13 offine-stand-stor-0 [ 4325.734167] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:38:13 offine-stand-stor-0 [ 4325.741540] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58: State change failed: State change was refused by peer node (-10) Mar 17 01:38:13 offine-stand-stor-0 [ 4325.745202] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58/0 drbd1087 offline-stand-stor-4: Failed: pdsk( UpToDate -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:38:13 offine-stand-stor-0 [ 4325.752485] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:38:13 offine-stand-stor-0 [ 4325.763391] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58: State change failed: State change was refused by peer node (-10) Mar 17 01:38:13 offine-stand-stor-0 [ 4325.768698] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58/0 drbd1087 offline-stand-stor-3: Failed: pdsk( UpToDate -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:38:13 offine-stand-stor-0 [ 4325.903714] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-3: Preparing remote state change 4032783963 Mar 17 01:38:13 offine-stand-stor-0 [ 4325.924490] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-3: Committing remote state change 4032783963 (primary_nodes=0) Mar 17 01:38:13 offine-stand-stor-0 [ 4325.932075] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-3: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:13 offine-stand-stor-0 [ 4325.939319] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-4: Preparing remote state change 1833010898 Mar 17 01:38:13 offine-stand-stor-0 [ 4325.960333] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-4: Committing remote state change 1833010898 (primary_nodes=0) Mar 17 01:38:13 offine-stand-stor-0 [ 4325.962797] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-4: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:13 offine-stand-stor-0 [ 4325.965181] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-4: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:13 offine-stand-stor-0 [ 4325.967236] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-3: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:14 offine-stand-stor-0 [ 4327.448389] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-3: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) [down] Mar 17 01:38:14 offine-stand-stor-0 [ 4327.450275] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-3: Terminating sender thread Mar 17 01:38:14 offine-stand-stor-0 [ 4327.451806] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-3: Starting sender thread (from drbd_r_pvc-60e8 [11683]) Mar 17 01:38:14 offine-stand-stor-0 [ 4327.502435] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-3: Connection closed Mar 17 01:38:14 offine-stand-stor-0 [ 4327.503450] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-3: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:38:14 offine-stand-stor-0 [ 4327.505269] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-3: Terminating receiver thread Mar 17 01:38:14 offine-stand-stor-0 [ 4327.522987] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-3: Terminating sender thread Mar 17 01:38:14 offine-stand-stor-0 [ 4327.540782] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-4: meta connection shut down by peer. Mar 17 01:38:14 offine-stand-stor-0 [ 4327.541833] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-4: conn( Connected -> NetworkFailure ) peer( Secondary -> Unknown ) Mar 17 01:38:14 offine-stand-stor-0 [ 4327.543723] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-4: sock was shut down by peer Mar 17 01:38:14 offine-stand-stor-0 [ 4327.544810] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-4: Terminating sender thread Mar 17 01:38:14 offine-stand-stor-0 [ 4327.545815] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-4: Starting sender thread (from drbd_r_pvc-60e8 [11684]) Mar 17 01:38:14 offine-stand-stor-0 [ 4327.564994] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58: Preparing cluster-wide state change 32328536 (2->-1 0/0) Mar 17 01:38:14 offine-stand-stor-0 [ 4327.566279] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58: Committing cluster-wide state change 32328536 (0ms) Mar 17 01:38:14 offine-stand-stor-0 [ 4327.567231] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-4: conn( NetworkFailure -> Disconnecting ) [down] Mar 17 01:38:14 offine-stand-stor-0 [ 4327.616903] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-4: Connection closed Mar 17 01:38:14 offine-stand-stor-0 [ 4327.617792] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-4: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:38:14 offine-stand-stor-0 [ 4327.619430] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-4: Terminating receiver thread Mar 17 01:38:14 offine-stand-stor-0 [ 4327.620262] drbd pvc-60e8a433-9728-438d-94b9-daa4bab49f58 offline-stand-stor-4: Terminating sender thread Mar 17 01:38:15 offine-stand-stor-0 [ 4327.666372] drbd /unregistered/pvc-60e8a433-9728-438d-94b9-daa4bab49f58: Terminating worker thread Mar 17 01:38:16 offine-stand-stor-0 [ 4329.577362] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:38:16 offine-stand-stor-0 [ 4329.579661] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879: State change failed: State change was refused by peer node (-10) Mar 17 01:38:16 offine-stand-stor-0 [ 4329.580785] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879/0 drbd1013 offline-stand-stor-3: Failed: pdsk( UpToDate -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:38:16 offine-stand-stor-0 [ 4329.583268] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:38:16 offine-stand-stor-0 [ 4329.616511] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879: State change failed: State change was refused by peer node (-10) Mar 17 01:38:17 offine-stand-stor-0 [ 4329.616604] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879/0 drbd1013 offline-stand-stor-2: Failed: pdsk( UpToDate -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:38:17 offine-stand-stor-0 [ 4329.776517] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-2: Preparing remote state change 2243470520 Mar 17 01:38:17 offine-stand-stor-0 [ 4329.795784] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-2: Committing remote state change 2243470520 (primary_nodes=0) Mar 17 01:38:17 offine-stand-stor-0 [ 4329.797442] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-2: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:17 offine-stand-stor-0 [ 4329.799109] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-2: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:17 offine-stand-stor-0 [ 4329.855080] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-3: Preparing remote state change 1487322876 Mar 17 01:38:17 offine-stand-stor-0 [ 4329.872650] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-3: Committing remote state change 1487322876 (primary_nodes=0) Mar 17 01:38:17 offine-stand-stor-0 [ 4329.874179] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-3: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:17 offine-stand-stor-0 [ 4329.875760] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-3: P_STATE packet received for volume 0, which is not configured locally Mar 17 01:38:18 offine-stand-stor-0 [ 4331.187015] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-2: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) [down] Mar 17 01:38:18 offine-stand-stor-0 [ 4331.189232] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-2: Terminating sender thread Mar 17 01:38:18 offine-stand-stor-0 [ 4331.190857] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-2: Starting sender thread (from drbd_r_pvc-b725 [12986]) Mar 17 01:38:18 offine-stand-stor-0 [ 4331.246468] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-2: Connection closed Mar 17 01:38:18 offine-stand-stor-0 [ 4331.247288] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-2: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:38:18 offine-stand-stor-0 [ 4331.248832] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-2: Terminating receiver thread Mar 17 01:38:18 offine-stand-stor-0 [ 4331.266406] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-2: Terminating sender thread Mar 17 01:38:18 offine-stand-stor-0 [ 4331.290440] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-3: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) [down] Mar 17 01:38:18 offine-stand-stor-0 [ 4331.292149] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-3: Terminating sender thread Mar 17 01:38:18 offine-stand-stor-0 [ 4331.293532] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-3: Starting sender thread (from drbd_r_pvc-b725 [12988]) Mar 17 01:38:18 offine-stand-stor-0 [ 4331.295725] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879: Preparing cluster-wide state change 353423269 (2->-1 0/0) Mar 17 01:38:18 offine-stand-stor-0 [ 4331.296806] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879: Committing cluster-wide state change 353423269 (0ms) Mar 17 01:38:18 offine-stand-stor-0 [ 4331.346515] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-3: Connection closed Mar 17 01:38:18 offine-stand-stor-0 [ 4331.347334] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-3: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:38:18 offine-stand-stor-0 [ 4331.348836] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-3: Terminating receiver thread Mar 17 01:38:18 offine-stand-stor-0 [ 4331.366340] drbd pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879 offline-stand-stor-3: Terminating sender thread Mar 17 01:38:18 offine-stand-stor-0 [ 4331.438480] drbd /unregistered/pvc-b725c8f0-5d03-48f3-b89b-3edd8e871879: Terminating worker thread Mar 17 01:38:20 offine-stand-stor-0 [ 4333.309042] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479 offline-stand-stor-2: Preparing remote state change 2720219251 Mar 17 01:38:20 offine-stand-stor-0 [ 4333.329658] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479 offline-stand-stor-2: Committing remote state change 2720219251 (primary_nodes=0) Mar 17 01:38:20 offine-stand-stor-0 [ 4333.337403] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479/0 drbd1070 offline-stand-stor-2: pdsk( UpToDate -> Detaching ) [remote] Mar 17 01:38:20 offine-stand-stor-0 [ 4333.361074] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479: Preparing cluster-wide state change 2146026655 (1->-1 7680/1024) Mar 17 01:38:20 offine-stand-stor-0 [ 4333.368190] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479: State change 2146026655: primary_nodes=0, weak_nodes=0 Mar 17 01:38:20 offine-stand-stor-0 [ 4333.373618] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479: Committing cluster-wide state change 2146026655 (12ms) Mar 17 01:38:20 offine-stand-stor-0 [ 4333.381997] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479/0 drbd1070 offline-stand-stor-2: pdsk( Detaching -> Diskless ) [peer-state] Mar 17 01:38:20 offine-stand-stor-0 [ 4333.390526] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479/0 drbd1070: disk( UpToDate -> Detaching ) [detach] Mar 17 01:38:20 offine-stand-stor-0 [ 4333.407933] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479/0 drbd1070: Would lose quorum, but using tiebreaker logic to keep Mar 17 01:38:20 offine-stand-stor-0 [ 4333.410349] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479/0 drbd1070: disk( Detaching -> Diskless ) [go-diskless] Mar 17 01:38:20 offine-stand-stor-0 [ 4333.430930] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479/0 drbd1070: drbd_bm_resize called with capacity == 0 Mar 17 01:38:20 offine-stand-stor-0 [ 4333.495886] eth0: renamed from tmp1ef17 Mar 17 01:38:20 offine-stand-stor-0 [ 4333.531000] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:38:20 offine-stand-stor-0 [ 4333.531916] IPv6: ADDRCONF(NETDEV_CHANGE): lxce958c5d240e4: link becomes ready Mar 17 01:38:21 offine-stand-stor-0 [ 4333.876144] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:38:21 offine-stand-stor-0 [ 4333.877717] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479: State change failed: State change was refused by peer node (-10) Mar 17 01:38:21 offine-stand-stor-0 [ 4333.878487] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479: Failed: susp-io( no -> quorum ) [del-minor] Mar 17 01:38:21 offine-stand-stor-0 [ 4333.879278] drbd /unregistered/pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479/0 drbd1070: Failed: quorum( yes -> no ) [del-minor] Mar 17 01:38:21 offine-stand-stor-0 [ 4333.880013] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479/0 drbd1070 offline-stand-stor-3: Failed: pdsk( Diskless -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:38:21 offine-stand-stor-0 [ 4333.882034] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:38:21 offine-stand-stor-0 [ 4333.884237] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479: State change failed: State change was refused by peer node (-10) Mar 17 01:38:21 offine-stand-stor-0 [ 4333.885172] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479: Failed: susp-io( no -> quorum ) [del-minor] Mar 17 01:38:21 offine-stand-stor-0 [ 4333.886105] drbd /unregistered/pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479/0 drbd1070: Failed: quorum( yes -> no ) [del-minor] Mar 17 01:38:21 offine-stand-stor-0 [ 4333.887037] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479/0 drbd1070 offline-stand-stor-2: Failed: pdsk( Diskless -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:38:21 offine-stand-stor-0 [ 4334.013360] WARNING: chroot access! Mar 17 01:38:22 offine-stand-stor-0 [ 4334.082850] WARNING: chroot access! Mar 17 01:38:22 offine-stand-stor-0 [ 4334.693626] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479 offline-stand-stor-3: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) [del-peer] Mar 17 01:38:22 offine-stand-stor-0 [ 4334.703867] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479 offline-stand-stor-3: Terminating sender thread Mar 17 01:38:22 offine-stand-stor-0 [ 4334.706924] drbd pvc-daaa4fed-540a-4bb8-ad50-d6ba07126479 offline-stand-stor-3: Starting sender thread (from drbd_r_pvc-daaa [13435]) Mar 17 01:38:22 offine-stand-stor-0 [ 4334.762465] BUG: kernel NULL pointer dereference, address: 000000000000078c Mar 17 01:38:22 offine-stand-stor-0 [ 4334.763253] #PF: supervisor write access in kernel mode Mar 17 01:38:22 offine-stand-stor-0 [ 4334.763993] #PF: error_code(0x0002) - not-present page Mar 17 01:38:22 offine-stand-stor-0 [ 4334.764865] PGD 0 P4D 0 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.765591] Oops: 0002 [#1] SMP PTI Mar 17 01:38:22 offine-stand-stor-0 [ 4334.766259] CPU: 5 PID: 13435 Comm: drbd_r_pvc-daaa Kdump: loaded Tainted: G OE 5.15.0-83-generic #astra1+ci14 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.767117] Hardware name: Supermicro SYS-5039MS-H8TRF/X11SSD-F, BIOS 2.3 12/20/2019 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.767795] RIP: 0010:_raw_spin_lock_irq+0x17/0x40 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.768501] Code: cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 fa 66 0f 1f 44 00 00 31 c0 ba 01 00 00 00 0f b1 17 75 06 5d c3 cc cc cc cc 89 c6 e8 d6 c5 42 ff 66 90 5d Mar 17 01:38:22 offine-stand-stor-0 [ 4334.769906] RSP: 0018:ffffa24d3e1e3c48 EFLAGS: 00010046 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.770660] RAX: 0000000000000000 RBX: ffff902fc347e780 RCX: 0000000000000000 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.771336] RDX: 0000000000000001 RSI: ffffa24d3e1e3ca0 RDI: 000000000000078c Mar 17 01:38:22 offine-stand-stor-0 [ 4334.771997] RBP: ffffa24d3e1e3c48 R08: ffff90306da773e0 R09: ffff90306da773e0 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.772757] R10: ffff90306da773e0 R11: ffff90306da773e0 R12: 0000000000000001 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.773396] R13: ffff902e8a073000 R14: 000000000000078c R15: ffff90306da77000 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.774032] FS: 0000000000000000(0000) GS:ffff9035d7b40000(0000) knlGS:0000000000000000 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.774712] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.775423] CR2: 000000000000078c CR3: 000000058e410005 CR4: 00000000003706e0 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.776071] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.776690] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.777303] Call Trace: Mar 17 01:38:22 offine-stand-stor-0 [ 4334.777930] Mar 17 01:38:22 offine-stand-stor-0 [ 4334.778568] ? show_regs.cold.16+0x1a/0x1f Mar 17 01:38:22 offine-stand-stor-0 [ 4334.779240] ? __die_body+0x1f/0x70 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.779861] ? __die+0x2a/0x35 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.780448] ? page_fault_oops+0x136/0x2b0 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.781054] ? do_user_addr_fault+0x33e/0x660 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.781667] ? finish_task_switch+0x81/0x2a0 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.782385] ? exc_page_fault+0x7e/0x170 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.783023] ? asm_exc_page_fault+0x27/0x30 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.783604] ? _raw_spin_lock_irq+0x17/0x40 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.784143] drbd_free_peer_req+0xa9/0x240 [drbd] Mar 17 01:38:22 offine-stand-stor-0 [ 4334.784688] drbd_finish_peer_reqs+0xc2/0x180 [drbd] Mar 17 01:38:22 offine-stand-stor-0 [ 4334.785211] drain_resync_activity+0x579/0xdc0 [drbd] Mar 17 01:38:22 offine-stand-stor-0 [ 4334.785720] ? wake_up_q+0x4e/0x90 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.786204] ? __mutex_unlock_slowpath.isra.24+0x9c/0x110 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.786691] ? mutex_unlock+0x26/0x30 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.787162] conn_disconnect+0x1b3/0xa40 [drbd] Mar 17 01:38:22 offine-stand-stor-0 [ 4334.787643] drbd_receiver+0x5ef/0x990 [drbd] Mar 17 01:38:22 offine-stand-stor-0 [ 4334.788103] ? drbd_unplug_all_devices+0x50/0x50 [drbd] Mar 17 01:38:22 offine-stand-stor-0 [ 4334.788593] drbd_thread_setup+0x85/0x1e0 [drbd] Mar 17 01:38:22 offine-stand-stor-0 [ 4334.789081] ? inc_open_count+0xb0/0xb0 [drbd] Mar 17 01:38:22 offine-stand-stor-0 [ 4334.789532] kthread+0x12d/0x150 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.790280] ? set_kthread_struct+0x50/0x50 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.790903] ret_from_fork+0x1f/0x30 Mar 17 01:38:22 offine-stand-stor-0 [ 4334.791402] Mar 17 01:38:22 offine-stand-stor-0 [ 4334.791792] Modules linked in: netconsole(E) drbd_transport_tcp(OE) udp_diag(E) ip_set(E) xt_CT(E) cls_bpf(E) sch_ingress(E) vxlan(E) ip6_udp_tunnel(E) udp_tunnel(E) sch_fq(E) bcache(E) crc64(E) dm_cache(E) dm_writecache(E) xfrm_user(E) xfrm_algo(E) veth(E) nvme_rdma(E) nvme_fabrics(E) nvmet_rdma(E) nvmet(E) nvme_core(E) rdma_cm(E) iw_cm(E) ib_cm(E) nf_tables(E) ib_core(E) nfnetlink(E) xt_socket(E) nf_socket_ipv4(E) nf_socket_ipv6(E) ip6table_raw(E) iptable_raw(E) ip6table_filter(E) ip6table_nat(E) ip6table_mangle(E) ip6_tables(E) xt_MASQUERADE(E) xt_mark(E) iptable_nat(E) nf_nat(E) xt_conntrack(E) nf_conntrack(E) nf_defrag_ipv6(E) nf_defrag_ipv4(E) xt_comment(E) iptable_filter(E) iptable_mangle(E) bpfilter(E) dm_thin_pool(E) dm_persistent_data(E) dm_bio_prison(E) dm_bufio(E) tcp_diag(E) inet_diag(E) aufs(E) overlay(E) intel_rapl_msr(E) intel_rapl_common(E) intel_tcc_cooling(E) x86_pkg_temp_thermal(E) intel_powerclamp(E) coretemp(E) kvm_intel(E) kvm(E) crct10dif_pclmul(E) Mar 17 01:38:22 offine-stand-stor-0 [ 4334.791850] crc32_pclmul(E) ghash_clmulni_intel(E) aesni_intel(E) crypto_simd(E) cryptd(E) rapl(E) intel_cstate(E) ipmi_ssif(E) ast(E) drm_vram_helper(E) drm_ttm_helper(E) ttm(E) drm_kms_helper(E) cec(E) rc_core(E) mei_me(E) drm(E) fb_sys_fops(E) syscopyarea(E) sysfillrect(E) joydev(E) sysimgblt(E) ee1004(E) mei(E) input_leds(E) intel_pch_thermal(E) ie31200_edac(E) acpi_ipmi(E) ipmi_si(E) ipmi_devintf(E) ipmi_msghandler(E) acpi_power_meter(E) acpi_pad(E) mac_hid(E) handshake(OE) drbd(OE) lru_cache(E) libcrc32c(E) br_netfilter(E) bridge(E) stp(E) llc(E) parport_pc(E) ppdev(E) lp(E) parport(E) sunrpc(E) ip_tables(E) x_tables(E) autofs4(E) hid_generic(E) usbhid(E) hid(E) i2c_i801(E) i2c_smbus(E) igb(E) intel_ish_ipc(E) xhci_pci(E) i2c_algo_bit(E) xhci_pci_renesas(E) intel_ishtp(E) dca(E) video(E) parsec(OE) digsig_verif(OE) [last unloaded: netconsole] Mar 17 01:38:22 offine-stand-stor-0 [ 4334.798957] CR2: 000000000000078c Mar 17 01:53:08 offine-stand-stor-0 [ 53.785169] igb 0000:02:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX Mar 17 01:53:08 offine-stand-stor-0 [ 53.804390] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:53:18 offine-stand-stor-0 [ 62.950262] bpfilter: Loaded bpfilter_umh pid 1665 Mar 17 01:53:18 offine-stand-stor-0 [ 62.950509] Started bpfilter Mar 17 01:53:18 offine-stand-stor-0 [ 63.713311] WARNING: chroot access! Mar 17 01:53:18 offine-stand-stor-0 [ 63.713375] WARNING: chroot access! Mar 17 01:53:18 offine-stand-stor-0 [ 63.717610] WARNING: chroot access! Mar 17 01:53:18 offine-stand-stor-0 [ 63.718166] WARNING: chroot access! Mar 17 01:53:18 offine-stand-stor-0 [ 63.728669] WARNING: chroot access! Mar 17 01:53:18 offine-stand-stor-0 [ 63.872347] WARNING: chroot access! Mar 17 01:53:18 offine-stand-stor-0 [ 63.875712] WARNING: chroot access! Mar 17 01:53:19 offine-stand-stor-0 [ 63.879396] WARNING: chroot access! Mar 17 01:53:19 offine-stand-stor-0 [ 63.886982] WARNING: chroot access! Mar 17 01:53:19 offine-stand-stor-0 [ 63.888626] WARNING: chroot access! Mar 17 01:53:19 offine-stand-stor-0 [ 64.032903] WARNING: chroot access! Mar 17 01:53:25 offine-stand-stor-0 [ 64.431139] WARNING: chroot access! Mar 17 01:53:25 offine-stand-stor-0 [ 70.300931] WARNING: chroot access! Mar 17 01:53:25 offine-stand-stor-0 [ 70.413866] WARNING: chroot access! Mar 17 01:53:25 offine-stand-stor-0 [ 70.613239] WARNING: chroot access! Mar 17 01:53:25 offine-stand-stor-0 [ 70.633818] WARNING: chroot access! Mar 17 01:53:25 offine-stand-stor-0 [ 70.772657] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 70.773746] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 70.945791] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 70.953204] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 70.954925] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 70.973526] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.203048] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.206843] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.249976] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.263355] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.287541] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.381489] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.391113] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.409723] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.611088] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.612328] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.614600] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.703461] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.776489] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.776706] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.833397] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.845127] WARNING: chroot access! Mar 17 01:53:26 offine-stand-stor-0 [ 71.851263] WARNING: chroot access! Mar 17 01:53:27 offine-stand-stor-0 [ 71.860647] WARNING: chroot access! Mar 17 01:53:27 offine-stand-stor-0 [ 72.160888] WARNING: chroot access! Mar 17 01:53:27 offine-stand-stor-0 [ 72.163670] WARNING: chroot access! Mar 17 01:53:27 offine-stand-stor-0 [ 72.268886] WARNING: chroot access! Mar 17 01:53:27 offine-stand-stor-0 [ 72.274395] WARNING: chroot access! Mar 17 01:53:27 offine-stand-stor-0 [ 72.318141] WARNING: chroot access! Mar 17 01:53:27 offine-stand-stor-0 [ 72.458623] WARNING: chroot access! Mar 17 01:53:27 offine-stand-stor-0 [ 72.624678] WARNING: chroot access! Mar 17 01:53:27 offine-stand-stor-0 [ 72.692876] WARNING: chroot access! Mar 17 01:53:27 offine-stand-stor-0 [ 72.785624] WARNING: chroot access! Mar 17 01:53:28 offine-stand-stor-0 [ 72.809068] WARNING: chroot access! Mar 17 01:53:28 offine-stand-stor-0 [ 72.902381] WARNING: chroot access! Mar 17 01:53:28 offine-stand-stor-0 [ 73.035521] WARNING: chroot access! Mar 17 01:53:28 offine-stand-stor-0 [ 73.227242] WARNING: chroot access! Mar 17 01:53:28 offine-stand-stor-0 [ 73.229585] WARNING: chroot access! Mar 17 01:53:28 offine-stand-stor-0 [ 73.393183] WARNING: chroot access! Mar 17 01:53:28 offine-stand-stor-0 [ 73.528449] WARNING: chroot access! Mar 17 01:53:28 offine-stand-stor-0 [ 73.681541] WARNING: chroot access! Mar 17 01:53:29 offine-stand-stor-0 [ 73.697933] WARNING: chroot access! Mar 17 01:53:29 offine-stand-stor-0 [ 74.688398] WARNING: chroot access! Mar 17 01:53:29 offine-stand-stor-0 [ 74.729266] WARNING: chroot access! Mar 17 01:53:30 offine-stand-stor-0 [ 74.829419] WARNING: chroot access! Mar 17 01:53:30 offine-stand-stor-0 [ 74.953542] WARNING: chroot access! Mar 17 01:53:31 offine-stand-stor-0 [ 75.678810] WARNING: chroot access! Mar 17 01:53:32 offine-stand-stor-0 [ 76.690334] WARNING: chroot access! Mar 17 01:53:32 offine-stand-stor-0 [ 77.700815] WARNING: chroot access! Mar 17 01:53:32 offine-stand-stor-0 [ 77.737600] systemd-journald[584]: File /var/log/journal/014713a6dfc0435aae73a05ed1204534/user-1000.journal corrupted or uncleanly shut down, renaming and replacing. Mar 17 01:53:34 offine-stand-stor-0 [ 77.825067] WARNING: chroot access! Mar 17 01:53:34 offine-stand-stor-0 [ 79.264799] Initializing XFRM netlink socket Mar 17 01:53:35 offine-stand-stor-0 [ 80.472981] IPv6: ADDRCONF(NETDEV_CHANGE): cilium_net: link becomes ready Mar 17 01:53:35 offine-stand-stor-0 [ 80.473300] IPv6: ADDRCONF(NETDEV_CHANGE): cilium_host: link becomes ready Mar 17 01:53:38 offine-stand-stor-0 [ 83.449488] IPv6: ADDRCONF(NETDEV_CHANGE): lxc_health: link becomes ready Mar 17 01:53:46 offine-stand-stor-0 [ 91.762174] eth0: renamed from tmp2bc30 Mar 17 01:53:46 offine-stand-stor-0 [ 91.799949] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:53:46 offine-stand-stor-0 [ 91.800401] IPv6: ADDRCONF(NETDEV_CHANGE): lxc34820b93d98b: link becomes ready Mar 17 01:53:46 offine-stand-stor-0 [ 91.860857] eth0: renamed from tmp5e702 Mar 17 01:53:47 offine-stand-stor-0 [ 91.958616] eth0: renamed from tmpc5ee7 Mar 17 01:53:47 offine-stand-stor-0 [ 92.086055] eth0: renamed from tmp5ef02 Mar 17 01:53:47 offine-stand-stor-0 [ 92.220501] IPv6: ADDRCONF(NETDEV_CHANGE): lxcacffab54399c: link becomes ready Mar 17 01:53:47 offine-stand-stor-0 [ 92.220945] IPv6: ADDRCONF(NETDEV_CHANGE): lxc27992c4f1fe8: link becomes ready Mar 17 01:53:47 offine-stand-stor-0 [ 92.291127] eth0: renamed from tmpd7bc6 Mar 17 01:53:47 offine-stand-stor-0 [ 92.425074] IPv6: ADDRCONF(NETDEV_CHANGE): lxc4f9d22df8e5b: link becomes ready Mar 17 01:53:47 offine-stand-stor-0 [ 92.425615] IPv6: ADDRCONF(NETDEV_CHANGE): lxcd6650215bd60: link becomes ready Mar 17 01:53:47 offine-stand-stor-0 [ 92.481266] eth0: renamed from tmpf423e Mar 17 01:53:47 offine-stand-stor-0 [ 92.514338] WARNING: chroot access! Mar 17 01:53:47 offine-stand-stor-0 [ 92.580163] eth0: renamed from tmp13731 Mar 17 01:53:47 offine-stand-stor-0 [ 92.706719] WARNING: chroot access! Mar 17 01:53:47 offine-stand-stor-0 [ 92.712824] IPv6: ADDRCONF(NETDEV_CHANGE): lxc7e971da57942: link becomes ready Mar 17 01:53:47 offine-stand-stor-0 [ 92.777150] eth0: renamed from tmpc6639 Mar 17 01:53:47 offine-stand-stor-0 [ 92.852463] eth0: renamed from tmp36977 Mar 17 01:53:48 offine-stand-stor-0 [ 92.855138] WARNING: chroot access! Mar 17 01:53:48 offine-stand-stor-0 [ 92.897318] eth0: renamed from tmp68215 Mar 17 01:53:48 offine-stand-stor-0 [ 92.936667] IPv6: ADDRCONF(NETDEV_CHANGE): lxc9e319bb1f569: link becomes ready Mar 17 01:53:48 offine-stand-stor-0 [ 92.937235] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:53:48 offine-stand-stor-0 [ 92.937778] IPv6: ADDRCONF(NETDEV_CHANGE): lxc66fbeadf9fcf: link becomes ready Mar 17 01:53:48 offine-stand-stor-0 [ 93.105554] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:53:48 offine-stand-stor-0 [ 93.105972] IPv6: ADDRCONF(NETDEV_CHANGE): lxcdf422fc9fbf6: link becomes ready Mar 17 01:53:48 offine-stand-stor-0 [ 93.164816] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:53:48 offine-stand-stor-0 [ 93.165398] IPv6: ADDRCONF(NETDEV_CHANGE): lxccda95c41e5ff: link becomes ready Mar 17 01:53:48 offine-stand-stor-0 [ 93.221455] WARNING: chroot access! Mar 17 01:53:48 offine-stand-stor-0 [ 93.225009] WARNING: chroot access! Mar 17 01:53:48 offine-stand-stor-0 [ 93.318930] eth0: renamed from tmp9fe57 Mar 17 01:53:48 offine-stand-stor-0 [ 93.359707] WARNING: chroot access! Mar 17 01:53:48 offine-stand-stor-0 [ 93.417468] eth0: renamed from tmp46d1f Mar 17 01:53:48 offine-stand-stor-0 [ 93.476843] WARNING: chroot access! Mar 17 01:53:48 offine-stand-stor-0 [ 93.480488] WARNING: chroot access! Mar 17 01:53:48 offine-stand-stor-0 [ 93.548037] IPv6: ADDRCONF(NETDEV_CHANGE): lxc00b03233939b: link becomes ready Mar 17 01:53:48 offine-stand-stor-0 [ 93.565738] IPv6: ADDRCONF(NETDEV_CHANGE): lxcc13af5764e22: link becomes ready Mar 17 01:53:48 offine-stand-stor-0 [ 93.616054] WARNING: chroot access! Mar 17 01:53:48 offine-stand-stor-0 [ 93.616335] eth0: renamed from tmp33b59 Mar 17 01:53:48 offine-stand-stor-0 [ 93.628650] WARNING: chroot access! Mar 17 01:53:48 offine-stand-stor-0 [ 93.688192] WARNING: chroot access! Mar 17 01:53:48 offine-stand-stor-0 [ 93.706778] IPv6: ADDRCONF(NETDEV_CHANGE): lxc4dd06d56665a: link becomes ready Mar 17 01:53:48 offine-stand-stor-0 [ 93.724338] WARNING: chroot access! Mar 17 01:53:49 offine-stand-stor-0 [ 93.858668] WARNING: chroot access! Mar 17 01:53:49 offine-stand-stor-0 [ 93.953358] WARNING: chroot access! Mar 17 01:53:49 offine-stand-stor-0 [ 93.954331] WARNING: chroot access! Mar 17 01:53:49 offine-stand-stor-0 [ 94.059011] WARNING: chroot access! Mar 17 01:53:49 offine-stand-stor-0 [ 94.070106] WARNING: chroot access! Mar 17 01:53:49 offine-stand-stor-0 [ 94.118851] WARNING: chroot access! Mar 17 01:53:49 offine-stand-stor-0 [ 94.244480] WARNING: chroot access! Mar 17 01:53:49 offine-stand-stor-0 [ 94.325792] WARNING: chroot access! Mar 17 01:53:49 offine-stand-stor-0 [ 94.439313] WARNING: chroot access! Mar 17 01:53:49 offine-stand-stor-0 [ 94.497660] WARNING: chroot access! Mar 17 01:53:49 offine-stand-stor-0 [ 94.623206] WARNING: chroot access! Mar 17 01:53:50 offine-stand-stor-0 [ 94.868199] WARNING: chroot access! Mar 17 01:53:50 offine-stand-stor-0 [ 95.015269] WARNING: chroot access! Mar 17 01:53:50 offine-stand-stor-0 [ 95.127623] WARNING: chroot access! Mar 17 01:53:50 offine-stand-stor-0 [ 95.128168] WARNING: chroot access! Mar 17 01:53:50 offine-stand-stor-0 [ 95.189641] WARNING: chroot access! Mar 17 01:53:50 offine-stand-stor-0 [ 95.325010] WARNING: chroot access! Mar 17 01:53:50 offine-stand-stor-0 [ 95.410443] WARNING: chroot access! Mar 17 01:53:50 offine-stand-stor-0 [ 95.514416] WARNING: chroot access! Mar 17 01:53:51 offine-stand-stor-0 [ 95.878102] WARNING: chroot access! Mar 17 01:53:51 offine-stand-stor-0 [ 95.963115] WARNING: chroot access! Mar 17 01:53:52 offine-stand-stor-0 [ 96.831381] WARNING: chroot access! Mar 17 01:53:52 offine-stand-stor-0 [ 96.940238] WARNING: chroot access! Mar 17 01:53:58 offine-stand-stor-0 [ 97.070260] WARNING: chroot access! Mar 17 01:54:09 offine-stand-stor-0 [ 103.499299] WARNING: chroot access! Mar 17 01:54:15 offine-stand-stor-0 [ 114.145548] WARNING: chroot access! Mar 17 01:54:22 offine-stand-stor-0 [ 120.204583] WARNING: chroot access! Mar 17 01:54:22 offine-stand-stor-0 [ 127.764164] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2: Starting worker thread (from drbdsetup [9014]) Mar 17 01:54:22 offine-stand-stor-0 [ 127.787439] drbd: registered transport class 'tcp' (version:9.2.8) Mar 17 01:54:22 offine-stand-stor-0 [ 127.800740] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-1: Starting sender thread (from drbdsetup [9019]) Mar 17 01:54:22 offine-stand-stor-0 [ 127.805550] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-4: Starting sender thread (from drbdsetup [9025]) Mar 17 01:54:22 offine-stand-stor-0 [ 127.816679] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2: susp-io( no -> quorum ) [connect] Mar 17 01:54:22 offine-stand-stor-0 [ 127.817084] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:22 offine-stand-stor-0 [ 127.818118] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-00ce [9015]) Mar 17 01:54:22 offine-stand-stor-0 [ 127.819020] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:22 offine-stand-stor-0 [ 127.839440] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:22 offine-stand-stor-0 [ 127.839861] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-00ce [9015]) Mar 17 01:54:22 offine-stand-stor-0 [ 127.863146] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3: Starting worker thread (from drbdsetup [9039]) Mar 17 01:54:22 offine-stand-stor-0 [ 127.873651] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-3: Starting sender thread (from drbdsetup [9045]) Mar 17 01:54:22 offine-stand-stor-0 [ 127.876391] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-4: Starting sender thread (from drbdsetup [9047]) Mar 17 01:54:23 offine-stand-stor-0 [ 127.884959] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 127.890917] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3: susp-io( no -> quorum ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 127.891554] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 127.892296] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-011e [9040]) Mar 17 01:54:23 offine-stand-stor-0 [ 127.894057] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 127.897377] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-011e [9040]) Mar 17 01:54:23 offine-stand-stor-0 [ 127.897418] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 127.901285] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 127.928312] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb: Starting worker thread (from drbdsetup [9070]) Mar 17 01:54:23 offine-stand-stor-0 [ 127.937662] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-3: Starting sender thread (from drbdsetup [9076]) Mar 17 01:54:23 offine-stand-stor-0 [ 127.952660] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-4: Starting sender thread (from drbdsetup [9078]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.002903] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052: meta-data IO uses: blk-bio Mar 17 01:54:23 offine-stand-stor-0 [ 128.009161] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb: susp-io( no -> quorum ) [attach] Mar 17 01:54:23 offine-stand-stor-0 [ 128.010714] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:23 offine-stand-stor-0 [ 128.012393] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052: Maximum number of peer devices = 7 Mar 17 01:54:23 offine-stand-stor-0 [ 128.014259] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb: Method to ensure write ordering: flush Mar 17 01:54:23 offine-stand-stor-0 [ 128.015886] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:23 offine-stand-stor-0 [ 128.018604] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:23 offine-stand-stor-0 [ 128.020380] drbd1052: detected capacity change from 0 to 10491632 Mar 17 01:54:23 offine-stand-stor-0 [ 128.020383] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052: size = 5123 MB (5245816 KB) Mar 17 01:54:23 offine-stand-stor-0 [ 128.038056] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052: recounting of set bits took additional 0ms Mar 17 01:54:23 offine-stand-stor-0 [ 128.039152] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:23 offine-stand-stor-0 [ 128.040206] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052: attached to current UUID: D097368DF6DA1CB6 Mar 17 01:54:23 offine-stand-stor-0 [ 128.041381] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052: Setting exposed data uuid: D097368DF6DA1CB6 Mar 17 01:54:23 offine-stand-stor-0 [ 128.055254] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.064387] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.069096] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-01db [9071]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.072285] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-01db [9071]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.075781] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.079301] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.110698] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0: Starting worker thread (from drbdsetup [9117]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.128700] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-1: Starting sender thread (from drbdsetup [9122]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.137764] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-2: Starting sender thread (from drbdsetup [9124]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.170065] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: meta-data IO uses: blk-bio Mar 17 01:54:23 offine-stand-stor-0 [ 128.187861] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:23 offine-stand-stor-0 [ 128.189279] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: Maximum number of peer devices = 7 Mar 17 01:54:23 offine-stand-stor-0 [ 128.196739] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0: Method to ensure write ordering: flush Mar 17 01:54:23 offine-stand-stor-0 [ 128.197772] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: drbd_bm_resize called with capacity == 4201520 Mar 17 01:54:23 offine-stand-stor-0 [ 128.198905] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: resync bitmap: bits=525190 words=57449 pages=113 Mar 17 01:54:23 offine-stand-stor-0 [ 128.199811] drbd1019: detected capacity change from 0 to 4201520 Mar 17 01:54:23 offine-stand-stor-0 [ 128.200754] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: size = 2052 MB (2100760 KB) Mar 17 01:54:23 offine-stand-stor-0 [ 128.202523] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: recounting of set bits took additional 0ms Mar 17 01:54:23 offine-stand-stor-0 [ 128.203522] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:23 offine-stand-stor-0 [ 128.204344] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: attached to current UUID: 53AACC02901D4964 Mar 17 01:54:23 offine-stand-stor-0 [ 128.205193] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: Setting exposed data uuid: 53AACC02901D4964 Mar 17 01:54:23 offine-stand-stor-0 [ 128.211496] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.213687] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-054e [9118]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.214430] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.216375] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.216405] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-054e [9118]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.220824] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.243619] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b: Starting worker thread (from drbdsetup [9149]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.249876] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-1: Starting sender thread (from drbdsetup [9154]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.254527] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-4: Starting sender thread (from drbdsetup [9156]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.264181] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b: susp-io( no -> quorum ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.265624] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.266979] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-09bd [9150]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.268668] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.271916] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.271933] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-09bd [9150]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.278785] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.323689] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658: Starting worker thread (from drbdsetup [9179]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.328549] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-1: Starting sender thread (from drbdsetup [9184]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.333414] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-3: Starting sender thread (from drbdsetup [9186]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.347065] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: meta-data IO uses: blk-bio Mar 17 01:54:23 offine-stand-stor-0 [ 128.348395] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658: susp-io( no -> quorum ) [attach] Mar 17 01:54:23 offine-stand-stor-0 [ 128.349385] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:23 offine-stand-stor-0 [ 128.350322] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: Maximum number of peer devices = 7 Mar 17 01:54:23 offine-stand-stor-0 [ 128.351557] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658: Method to ensure write ordering: flush Mar 17 01:54:23 offine-stand-stor-0 [ 128.352821] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: drbd_bm_resize called with capacity == 4201520 Mar 17 01:54:23 offine-stand-stor-0 [ 128.354179] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: resync bitmap: bits=525190 words=57449 pages=113 Mar 17 01:54:23 offine-stand-stor-0 [ 128.355264] drbd1004: detected capacity change from 0 to 4201520 Mar 17 01:54:23 offine-stand-stor-0 [ 128.356346] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: size = 2052 MB (2100760 KB) Mar 17 01:54:23 offine-stand-stor-0 [ 128.358126] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: recounting of set bits took additional 0ms Mar 17 01:54:23 offine-stand-stor-0 [ 128.359090] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:23 offine-stand-stor-0 [ 128.360060] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: attached to current UUID: 67153CC85B549AA2 Mar 17 01:54:23 offine-stand-stor-0 [ 128.360951] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: Setting exposed data uuid: 67153CC85B549AA2 Mar 17 01:54:23 offine-stand-stor-0 [ 128.365832] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.367910] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-0b3d [9180]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.370773] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.373008] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.374118] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-0b3d [9180]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.376147] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.378274] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:23 offine-stand-stor-0 [ 128.380653] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:23 offine-stand-stor-0 [ 128.389957] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:23 offine-stand-stor-0 [ 128.408581] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:23 offine-stand-stor-0 [ 128.410190] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:23 offine-stand-stor-0 [ 128.425521] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be: Starting worker thread (from drbdsetup [9212]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.427861] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:23 offine-stand-stor-0 [ 128.431585] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-1: Starting sender thread (from drbdsetup [9218]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.435680] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-4: Starting sender thread (from drbdsetup [9220]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.436654] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:23 offine-stand-stor-0 [ 128.436674] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:23 offine-stand-stor-0 [ 128.436676] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:23 offine-stand-stor-0 [ 128.439366] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:23 offine-stand-stor-0 [ 128.440402] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:23 offine-stand-stor-0 [ 128.445177] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-1: Preparing remote state change 3030980134 Mar 17 01:54:23 offine-stand-stor-0 [ 128.445622] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:23 offine-stand-stor-0 [ 128.447221] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be: susp-io( no -> quorum ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.451274] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.452149] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-0c9c [9213]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.452325] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-4: Preparing remote state change 1642975923 Mar 17 01:54:23 offine-stand-stor-0 [ 128.453573] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.454903] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.454942] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-0c9c [9213]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.463441] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.474638] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9: Starting worker thread (from drbdsetup [9238]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.479598] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-3: Starting sender thread (from drbdsetup [9243]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.487484] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-4: Starting sender thread (from drbdsetup [9245]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.495199] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9: susp-io( no -> quorum ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.496328] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.497634] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-0d56 [9239]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.500375] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.502886] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.504432] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-0d56 [9239]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.506807] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.522158] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32: Starting worker thread (from drbdsetup [9260]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.527100] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-2: Starting sender thread (from drbdsetup [9265]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.534177] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-3: Starting sender thread (from drbdsetup [9267]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.540759] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32: susp-io( no -> quorum ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.542035] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.544339] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.546816] drbd1050: detected capacity change from 0 to 10491632 Mar 17 01:54:23 offine-stand-stor-0 [ 128.547830] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2/0 drbd1050: size = 5123 MB (5245816 KB) Mar 17 01:54:23 offine-stand-stor-0 [ 128.548773] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2/0 drbd1050 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:23 offine-stand-stor-0 [ 128.549877] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2/0 drbd1050 offline-stand-stor-1: peer 6AF0204E229AC0BC:80D7B0DC532C0880:80D7B0DC532C0880:0000000000000000 bits:0 flags:1120 Mar 17 01:54:23 offine-stand-stor-0 [ 128.552159] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2/0 drbd1050: Setting exposed data uuid: 6AF0204E229AC0BC Mar 17 01:54:23 offine-stand-stor-0 [ 128.552561] drbd1090: detected capacity change from 0 to 10491632 Mar 17 01:54:23 offine-stand-stor-0 [ 128.553040] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-1022 [9261]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.554018] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3/0 drbd1090: size = 5123 MB (5245816 KB) Mar 17 01:54:23 offine-stand-stor-0 [ 128.555857] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.555876] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-1022 [9261]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.557287] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3/0 drbd1090 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:23 offine-stand-stor-0 [ 128.559856] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333: Starting worker thread (from drbdsetup [9282]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.562576] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3/0 drbd1090 offline-stand-stor-4: peer A54010BE08FF2B30:0000000000000000:C4152F64DD12160E:0000000000000000 bits:0 flags:1120 Mar 17 01:54:23 offine-stand-stor-0 [ 128.567186] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3/0 drbd1090: Setting exposed data uuid: A54010BE08FF2B30 Mar 17 01:54:23 offine-stand-stor-0 [ 128.572627] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-1: Committing remote state change 3030980134 (primary_nodes=0) Mar 17 01:54:23 offine-stand-stor-0 [ 128.572635] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.573429] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-1: Starting sender thread (from drbdsetup [9287]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.574451] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2: susp-io( quorum -> no ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.574991] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-4: Starting sender thread (from drbdsetup [9289]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.575271] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-4: Committing remote state change 1642975923 (primary_nodes=0) Mar 17 01:54:23 offine-stand-stor-0 [ 128.575279] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3: susp-io( quorum -> no ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.575281] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.575283] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3/0 drbd1090: quorum( no -> yes ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.575285] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3/0 drbd1090 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.578397] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333: susp-io( no -> quorum ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.579206] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.580051] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.582786] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2/0 drbd1050: quorum( no -> yes ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.584412] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-1277 [9283]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.585469] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.585789] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2/0 drbd1050 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.588158] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.588174] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-1277 [9283]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.588876] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-4: Preparing remote state change 1295264902 Mar 17 01:54:23 offine-stand-stor-0 [ 128.590728] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.593568] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-3: Preparing remote state change 3034461391 Mar 17 01:54:23 offine-stand-stor-0 [ 128.596674] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-4: Handshake to peer 3 successful: Agreed network protocol version 122 Mar 17 01:54:23 offine-stand-stor-0 [ 128.599794] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:23 offine-stand-stor-0 [ 128.600360] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:23 offine-stand-stor-0 [ 128.601390] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:23 offine-stand-stor-0 [ 128.602072] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:23 offine-stand-stor-0 [ 128.605902] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:23 offine-stand-stor-0 [ 128.607875] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-3: Preparing remote state change 3599600504 Mar 17 01:54:23 offine-stand-stor-0 [ 128.638038] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29: Starting worker thread (from drbdsetup [9314]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.646700] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-2: Starting sender thread (from drbdsetup [9319]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.652260] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-3: Starting sender thread (from drbdsetup [9321]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.658600] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2/0 drbd1050 offline-stand-stor-4: my exposed UUID: 6AF0204E229AC0BC Mar 17 01:54:23 offine-stand-stor-0 [ 128.659897] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2/0 drbd1050 offline-stand-stor-4: peer 6AF0204E229AC0BC:80D7B0DC532C0880:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:23 offine-stand-stor-0 [ 128.664993] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3/0 drbd1090 offline-stand-stor-3: my exposed UUID: A54010BE08FF2B30 Mar 17 01:54:23 offine-stand-stor-0 [ 128.666526] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3/0 drbd1090 offline-stand-stor-3: peer A54010BE08FF2B30:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:23 offine-stand-stor-0 [ 128.671826] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-3: Committing remote state change 3034461391 (primary_nodes=0) Mar 17 01:54:23 offine-stand-stor-0 [ 128.674128] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.676574] drbd pvc-011e4032-9fe8-4e3a-a031-90ff340f2ea3/0 drbd1090 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.678773] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-4: Committing remote state change 1295264902 (primary_nodes=0) Mar 17 01:54:23 offine-stand-stor-0 [ 128.678858] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:23 offine-stand-stor-0 [ 128.679579] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056: meta-data IO uses: blk-bio Mar 17 01:54:23 offine-stand-stor-0 [ 128.680861] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.681730] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052 offline-stand-stor-3: self D097368DF6DA1CB6:0000000000000000:25311E4E584A83A6:438DE47F1B372F54 bits:0 flags:20 Mar 17 01:54:23 offine-stand-stor-0 [ 128.682710] drbd pvc-00ce786b-741b-45d3-8bcf-4a8fbc84cae2/0 drbd1050 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.684641] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052 offline-stand-stor-3: peer D097368DF6DA1CB6:0000000000000000:25311E4E584A83A6:2B173B167A09B2DC bits:0 flags:1120 Mar 17 01:54:23 offine-stand-stor-0 [ 128.692290] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:23 offine-stand-stor-0 [ 128.694748] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29: susp-io( no -> quorum ) [attach] Mar 17 01:54:23 offine-stand-stor-0 [ 128.695814] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:23 offine-stand-stor-0 [ 128.697426] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-3: Committing remote state change 3599600504 (primary_nodes=0) Mar 17 01:54:23 offine-stand-stor-0 [ 128.697488] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056: Maximum number of peer devices = 7 Mar 17 01:54:23 offine-stand-stor-0 [ 128.699819] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb: susp-io( quorum -> no ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.699823] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.699831] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052: quorum( no -> yes ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.699835] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:23 offine-stand-stor-0 [ 128.699991] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052 offline-stand-stor-3: cleared bm UUID and bitmap D097368DF6DA1CB6:0000000000000000:25311E4E584A83A6:438DE47F1B372F54 Mar 17 01:54:23 offine-stand-stor-0 [ 128.701615] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29: Method to ensure write ordering: flush Mar 17 01:54:23 offine-stand-stor-0 [ 128.710599] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb: Preparing cluster-wide state change 3078112830 (1->3 499/146) Mar 17 01:54:23 offine-stand-stor-0 [ 128.710839] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:23 offine-stand-stor-0 [ 128.713719] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:23 offine-stand-stor-0 [ 128.714806] drbd1056: detected capacity change from 0 to 10491632 Mar 17 01:54:23 offine-stand-stor-0 [ 128.715956] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056: size = 5123 MB (5245816 KB) Mar 17 01:54:23 offine-stand-stor-0 [ 128.723954] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056: recounting of set bits took additional 0ms Mar 17 01:54:23 offine-stand-stor-0 [ 128.725138] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:23 offine-stand-stor-0 [ 128.726383] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056: attached to current UUID: D7B2E43ACD922AC2 Mar 17 01:54:23 offine-stand-stor-0 [ 128.727464] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056: Setting exposed data uuid: D7B2E43ACD922AC2 Mar 17 01:54:23 offine-stand-stor-0 [ 128.731329] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.732928] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-136e [9315]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.733910] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:23 offine-stand-stor-0 [ 128.735583] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:23 offine-stand-stor-0 [ 128.736585] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.736614] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-136e [9315]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.739034] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:23 offine-stand-stor-0 [ 128.741860] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:23 offine-stand-stor-0 [ 128.744768] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:23 offine-stand-stor-0 [ 128.752034] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:23 offine-stand-stor-0 [ 128.754372] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:23 offine-stand-stor-0 [ 128.756557] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0: Preparing cluster-wide state change 881979679 (1->2 499/146) Mar 17 01:54:23 offine-stand-stor-0 [ 128.766116] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:23 offine-stand-stor-0 [ 128.802534] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e: Starting worker thread (from drbdsetup [9356]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.810841] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-2: Starting sender thread (from drbdsetup [9361]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.813852] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:23 offine-stand-stor-0 [ 128.816509] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:23 offine-stand-stor-0 [ 128.822361] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-3: Starting sender thread (from drbdsetup [9363]) Mar 17 01:54:23 offine-stand-stor-0 [ 128.837041] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071: meta-data IO uses: blk-bio Mar 17 01:54:23 offine-stand-stor-0 [ 128.838497] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e: susp-io( no -> quorum ) [attach] Mar 17 01:54:23 offine-stand-stor-0 [ 128.839724] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:23 offine-stand-stor-0 [ 128.841132] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071: Maximum number of peer devices = 7 Mar 17 01:54:23 offine-stand-stor-0 [ 128.842940] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e: Method to ensure write ordering: flush Mar 17 01:54:23 offine-stand-stor-0 [ 128.843914] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:23 offine-stand-stor-0 [ 128.845623] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:23 offine-stand-stor-0 [ 128.846709] drbd1071: detected capacity change from 0 to 10491632 Mar 17 01:54:23 offine-stand-stor-0 [ 128.847619] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071: size = 5123 MB (5245816 KB) Mar 17 01:54:23 offine-stand-stor-0 [ 128.848774] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:23 offine-stand-stor-0 [ 128.860562] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052 offline-stand-stor-4: self D097368DF6DA1CB6:3A25C8DF2559703A:25311E4E584A83A6:438DE47F1B372F54 bits:0 flags:0 Mar 17 01:54:23 offine-stand-stor-0 [ 128.860658] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-2: self 53AACC02901D4964:4BCD2048E1128232:42C1D1E5BFF997D4:5F8649053CF2E04C bits:0 flags:0 Mar 17 01:54:23 offine-stand-stor-0 [ 128.862475] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052 offline-stand-stor-4: peer's exposed UUID: D097368DF6DA1CB7 Mar 17 01:54:23 offine-stand-stor-0 [ 128.869613] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071: recounting of set bits took additional 0ms Mar 17 01:54:23 offine-stand-stor-0 [ 128.869635] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:23 offine-stand-stor-0 [ 128.869639] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071: attached to current UUID: AC23BAAC9C28C062 Mar 17 01:54:23 offine-stand-stor-0 [ 128.869644] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071: Setting exposed data uuid: AC23BAAC9C28C062 Mar 17 01:54:24 offine-stand-stor-0 [ 128.869704] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-2: peer's exposed UUID: 9E2175E500DC3468 Mar 17 01:54:24 offine-stand-stor-0 [ 128.869879] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0: State change 881979679: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFF8 Mar 17 01:54:24 offine-stand-stor-0 [ 128.871855] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:24 offine-stand-stor-0 [ 128.873244] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-4: Preparing remote state change 2082104760 Mar 17 01:54:24 offine-stand-stor-0 [ 128.873338] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb: State change 3078112830: primary_nodes=0, weak_nodes=0 Mar 17 01:54:24 offine-stand-stor-0 [ 128.873349] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb: Committing cluster-wide state change 3078112830 (172ms) Mar 17 01:54:24 offine-stand-stor-0 [ 128.873440] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:24 offine-stand-stor-0 [ 128.873444] drbd pvc-01db5ecd-9e20-44de-be09-77e32028f9eb/0 drbd1052 offline-stand-stor-4: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:24 offine-stand-stor-0 [ 128.874119] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:24 offine-stand-stor-0 [ 128.874868] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0: Committing cluster-wide state change 881979679 (116ms) Mar 17 01:54:24 offine-stand-stor-0 [ 128.874916] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:24 offine-stand-stor-0 [ 128.874919] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: disk( UpToDate -> Outdated ) [connected] Mar 17 01:54:24 offine-stand-stor-0 [ 128.874921] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:24 offine-stand-stor-0 [ 128.874932] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: Enabling local AL-updates Mar 17 01:54:24 offine-stand-stor-0 [ 128.875879] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-15fc [9357]) Mar 17 01:54:24 offine-stand-stor-0 [ 128.904581] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-1: Preparing remote state change 1452917369 Mar 17 01:54:24 offine-stand-stor-0 [ 128.906704] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 128.906750] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-1: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 128.906964] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:24 offine-stand-stor-0 [ 128.906994] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-15fc [9357]) Mar 17 01:54:24 offine-stand-stor-0 [ 128.908539] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:24 offine-stand-stor-0 [ 128.909803] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 128.913006] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 128.916356] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 128.923911] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 128.937320] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658: Preparing cluster-wide state change 1172224246 (1->2 499/146) Mar 17 01:54:24 offine-stand-stor-0 [ 128.938358] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-3: Aborting local state change 1172224246 to yield to remote state change 1936001907. Mar 17 01:54:24 offine-stand-stor-0 [ 128.944570] drbd1120: detected capacity change from 0 to 10491632 Mar 17 01:54:24 offine-stand-stor-0 [ 128.945783] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b/0 drbd1120: size = 5123 MB (5245816 KB) Mar 17 01:54:24 offine-stand-stor-0 [ 128.946945] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b/0 drbd1120 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:24 offine-stand-stor-0 [ 128.948211] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b/0 drbd1120 offline-stand-stor-4: peer CACC42BA1356F916:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:24 offine-stand-stor-0 [ 128.948648] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-1: drbd_sync_handshake: Mar 17 01:54:24 offine-stand-stor-0 [ 128.950418] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b/0 drbd1120: Setting exposed data uuid: CACC42BA1356F916 Mar 17 01:54:24 offine-stand-stor-0 [ 128.951440] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-1: self 53AACC02901D4964:0000000000000000:42C1D1E5BFF997D4:5F8649053CF2E04C bits:0 flags:20 Mar 17 01:54:24 offine-stand-stor-0 [ 128.954513] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-4: Committing remote state change 2082104760 (primary_nodes=0) Mar 17 01:54:24 offine-stand-stor-0 [ 128.955670] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02: Starting worker thread (from drbdsetup [9399]) Mar 17 01:54:24 offine-stand-stor-0 [ 128.956660] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-1: peer 9E2175E500DC3469:53AACC02901D4965:A90C4494B0C69F0A:368B0894CD21E81E bits:1152 flags:1120 Mar 17 01:54:24 offine-stand-stor-0 [ 128.959808] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b: susp-io( quorum -> no ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 128.962218] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-1: uuid_compare()=target-use-bitmap by rule=bitmap-peer Mar 17 01:54:24 offine-stand-stor-0 [ 128.964989] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 128.964991] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b/0 drbd1120: quorum( no -> yes ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 128.964994] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b/0 drbd1120 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 128.966719] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-2: Starting sender thread (from drbdsetup [9404]) Mar 17 01:54:24 offine-stand-stor-0 [ 128.971140] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-1: Committing remote state change 1452917369 (primary_nodes=1) Mar 17 01:54:24 offine-stand-stor-0 [ 128.974244] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-3: Starting sender thread (from drbdsetup [9406]) Mar 17 01:54:24 offine-stand-stor-0 [ 128.974768] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Primary ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 128.984176] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> WFBitMapT ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 128.985304] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 128.987376] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: Disabling local AL-updates (optimization) Mar 17 01:54:24 offine-stand-stor-0 [ 128.991136] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 128.992907] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: Setting exposed data uuid: 9E2175E500DC3468 Mar 17 01:54:24 offine-stand-stor-0 [ 128.994018] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044: meta-data IO uses: blk-bio Mar 17 01:54:24 offine-stand-stor-0 [ 129.000113] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-1: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 43(1), total 43; compression: 100.0% Mar 17 01:54:24 offine-stand-stor-0 [ 129.004585] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 129.005489] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-1: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 43(1), total 43; compression: 100.0% Mar 17 01:54:24 offine-stand-stor-0 [ 129.006994] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-1: self 67153CC85B549AA2:C705BE1126008C84:9861276908E13884:9490607B36C192B0 bits:0 flags:0 Mar 17 01:54:24 offine-stand-stor-0 [ 129.006999] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-1: peer's exposed UUID: 15376AF37D222C30 Mar 17 01:54:24 offine-stand-stor-0 [ 129.007025] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658: Aborting cluster-wide state change 1172224246 (68ms) rv = -19 Mar 17 01:54:24 offine-stand-stor-0 [ 129.007051] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-3: Preparing remote state change 1936001907 Mar 17 01:54:24 offine-stand-stor-0 [ 129.008420] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 129.009251] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02: susp-io( no -> quorum ) [attach] Mar 17 01:54:24 offine-stand-stor-0 [ 129.028538] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 129.029566] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:24 offine-stand-stor-0 [ 129.032705] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 129.034220] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: disk( Outdated -> Inconsistent ) [receive-bitmap] Mar 17 01:54:24 offine-stand-stor-0 [ 129.034275] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044: Maximum number of peer devices = 7 Mar 17 01:54:24 offine-stand-stor-0 [ 129.036553] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 129.036555] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 129.037597] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.038675] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-2: resync-susp( no -> connection dependency ) [receive-bitmap] Mar 17 01:54:24 offine-stand-stor-0 [ 129.047512] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.049445] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-1: repl( WFBitMapT -> SyncTarget ) [receive-bitmap] Mar 17 01:54:24 offine-stand-stor-0 [ 129.049683] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02: Method to ensure write ordering: flush Mar 17 01:54:24 offine-stand-stor-0 [ 129.049705] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-1: Began resync as SyncTarget (will sync 4608 KB [1152 bits set]). Mar 17 01:54:24 offine-stand-stor-0 [ 129.054131] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.054676] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:24 offine-stand-stor-0 [ 129.055855] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:24 offine-stand-stor-0 [ 129.057834] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-4: Preparing remote state change 3256801481 Mar 17 01:54:24 offine-stand-stor-0 [ 129.059438] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:24 offine-stand-stor-0 [ 129.059595] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: self 67153CC85B549AA2:0000000000000000:9861276908E13884:9490607B36C192B0 bits:0 flags:20 Mar 17 01:54:24 offine-stand-stor-0 [ 129.061253] drbd1044: detected capacity change from 0 to 10491632 Mar 17 01:54:24 offine-stand-stor-0 [ 129.062114] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: peer 15376AF37D222C31:67153CC85B549AA3:869E302E7562B3D4:8AFF3B26AF573786 bits:895 flags:1120 Mar 17 01:54:24 offine-stand-stor-0 [ 129.062130] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: uuid_compare()=target-use-bitmap by rule=bitmap-peer Mar 17 01:54:24 offine-stand-stor-0 [ 129.062183] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-3: Aborting remote state change 1936001907 Mar 17 01:54:24 offine-stand-stor-0 [ 129.063221] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044: size = 5123 MB (5245816 KB) Mar 17 01:54:24 offine-stand-stor-0 [ 129.064133] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658: Preparing cluster-wide state change 3152158331 (1->2 499/146) Mar 17 01:54:24 offine-stand-stor-0 [ 129.070753] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.089985] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-4: Preparing remote state change 854687889 Mar 17 01:54:24 offine-stand-stor-0 [ 129.092481] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 129.097670] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 129.104094] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044: recounting of set bits took additional 0ms Mar 17 01:54:24 offine-stand-stor-0 [ 129.105687] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:24 offine-stand-stor-0 [ 129.106787] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044: attached to current UUID: 332C37166175B492 Mar 17 01:54:24 offine-stand-stor-0 [ 129.107879] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044: Setting exposed data uuid: 332C37166175B492 Mar 17 01:54:24 offine-stand-stor-0 [ 129.109485] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.110731] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 129.112693] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 129.113711] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-3: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 129.113715] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 129.114268] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:24 offine-stand-stor-0 [ 129.114791] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-1624 [9400]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.121428] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:24 offine-stand-stor-0 [ 129.125194] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.128563] drbd1092: detected capacity change from 0 to 10491632 Mar 17 01:54:24 offine-stand-stor-0 [ 129.128566] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9/0 drbd1092: size = 5123 MB (5245816 KB) Mar 17 01:54:24 offine-stand-stor-0 [ 129.128607] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9/0 drbd1092 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:24 offine-stand-stor-0 [ 129.128609] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9/0 drbd1092 offline-stand-stor-4: peer 911487E4ADD8A246:0000000000000000:09E76B2B2EE8D93A:0000000000000000 bits:0 flags:1120 Mar 17 01:54:24 offine-stand-stor-0 [ 129.128612] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9/0 drbd1092: Setting exposed data uuid: 911487E4ADD8A246 Mar 17 01:54:24 offine-stand-stor-0 [ 129.129176] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-1: Resync done (total 1 sec; paused 0 sec; 4608 K/sec) Mar 17 01:54:24 offine-stand-stor-0 [ 129.129187] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-1: updated UUIDs 9E2175E500DC3468:0000000000000000:42C1D1E5BFF997D4:5F8649053CF2E04C Mar 17 01:54:24 offine-stand-stor-0 [ 129.129193] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019: disk( Inconsistent -> UpToDate ) [resync-finished] Mar 17 01:54:24 offine-stand-stor-0 [ 129.129195] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-2: resync-susp( connection dependency -> no ) [resync-finished] Mar 17 01:54:24 offine-stand-stor-0 [ 129.129197] drbd pvc-054e258b-8251-4752-a4c3-e02f4266d9e0/0 drbd1019 offline-stand-stor-1: repl( SyncTarget -> Established ) [resync-finished] Mar 17 01:54:24 offine-stand-stor-0 [ 129.130450] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-2: Preparing remote state change 2462624087 Mar 17 01:54:24 offine-stand-stor-0 [ 129.131006] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-1: self 67153CC85B549AA2:C705BE1126008C84:9861276908E13884:9490607B36C192B0 bits:0 flags:0 Mar 17 01:54:24 offine-stand-stor-0 [ 129.131011] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-1: peer's exposed UUID: 15376AF37D222C30 Mar 17 01:54:24 offine-stand-stor-0 [ 129.150028] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-3: Rejecting concurrent remote state change 2254779137 because of state change 3256801481 Mar 17 01:54:24 offine-stand-stor-0 [ 129.156659] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-1624 [9400]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.156778] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:24 offine-stand-stor-0 [ 129.157723] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 129.159879] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 129.160060] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-4: Committing remote state change 3256801481 (primary_nodes=0) Mar 17 01:54:24 offine-stand-stor-0 [ 129.160079] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9: susp-io( quorum -> no ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.160083] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.160085] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9/0 drbd1092: quorum( no -> yes ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.160094] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9/0 drbd1092 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.160222] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658: State change 3152158331: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFF8 Mar 17 01:54:24 offine-stand-stor-0 [ 129.160227] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658: Committing cluster-wide state change 3152158331 (96ms) Mar 17 01:54:24 offine-stand-stor-0 [ 129.160247] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:24 offine-stand-stor-0 [ 129.160250] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: disk( UpToDate -> Outdated ) [connected] Mar 17 01:54:24 offine-stand-stor-0 [ 129.160253] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-1: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:24 offine-stand-stor-0 [ 129.160258] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: Enabling local AL-updates Mar 17 01:54:24 offine-stand-stor-0 [ 129.164451] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:24 offine-stand-stor-0 [ 129.167903] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.168556] drbd1086: detected capacity change from 0 to 10491632 Mar 17 01:54:24 offine-stand-stor-0 [ 129.168565] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be/0 drbd1086: size = 5123 MB (5245816 KB) Mar 17 01:54:24 offine-stand-stor-0 [ 129.168610] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be/0 drbd1086 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:24 offine-stand-stor-0 [ 129.168612] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be/0 drbd1086 offline-stand-stor-4: peer 17C724C40788D92E:0000000000000000:D517873620A8FE64:0000000000000000 bits:0 flags:1120 Mar 17 01:54:24 offine-stand-stor-0 [ 129.168615] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be/0 drbd1086: Setting exposed data uuid: 17C724C40788D92E Mar 17 01:54:24 offine-stand-stor-0 [ 129.177916] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.178755] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-4: Preparing remote state change 1608685860 Mar 17 01:54:24 offine-stand-stor-0 [ 129.178969] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-4: Committing remote state change 854687889 (primary_nodes=0) Mar 17 01:54:24 offine-stand-stor-0 [ 129.178987] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be: susp-io( quorum -> no ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.178989] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.178991] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be/0 drbd1086: quorum( no -> yes ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.178993] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be/0 drbd1086 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.188818] drbd1075: detected capacity change from 0 to 10491632 Mar 17 01:54:24 offine-stand-stor-0 [ 129.196252] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479: Starting worker thread (from drbdsetup [9451]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.207566] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-2: Starting sender thread (from drbdsetup [9456]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.209315] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32/0 drbd1075: size = 5123 MB (5245816 KB) Mar 17 01:54:24 offine-stand-stor-0 [ 129.210739] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-3: Preparing remote state change 3305742372 Mar 17 01:54:24 offine-stand-stor-0 [ 129.212671] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9/0 drbd1092 offline-stand-stor-3: my exposed UUID: 911487E4ADD8A246 Mar 17 01:54:24 offine-stand-stor-0 [ 129.215068] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32/0 drbd1075 offline-stand-stor-2: my exposed UUID: 0000000000000000 Mar 17 01:54:24 offine-stand-stor-0 [ 129.217430] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9/0 drbd1092 offline-stand-stor-3: peer 911487E4ADD8A246:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:24 offine-stand-stor-0 [ 129.218618] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32/0 drbd1075 offline-stand-stor-2: peer FC76BAD32E6DCEAC:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:24 offine-stand-stor-0 [ 129.224819] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-3: Starting sender thread (from drbdsetup [9458]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.227067] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32/0 drbd1075: Setting exposed data uuid: FC76BAD32E6DCEAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.231055] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-1: Preparing remote state change 4076238116 Mar 17 01:54:24 offine-stand-stor-0 [ 129.246557] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064: meta-data IO uses: blk-bio Mar 17 01:54:24 offine-stand-stor-0 [ 129.247304] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-2: Committing remote state change 2462624087 (primary_nodes=0) Mar 17 01:54:24 offine-stand-stor-0 [ 129.249218] drbd1109: detected capacity change from 0 to 10491632 Mar 17 01:54:24 offine-stand-stor-0 [ 129.250846] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32: susp-io( quorum -> no ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.250849] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.250851] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32/0 drbd1075: quorum( no -> yes ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.260940] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:24 offine-stand-stor-0 [ 129.260945] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: self 67153CC85B549AA2:0000000000000000:9861276908E13884:9490607B36C192B0 bits:0 flags:20 Mar 17 01:54:24 offine-stand-stor-0 [ 129.260948] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: peer 15376AF37D222C31:67153CC85B549AA3:869E302E7562B3D4:8AFF3B26AF573786 bits:895 flags:1120 Mar 17 01:54:24 offine-stand-stor-0 [ 129.260952] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: uuid_compare()=target-use-bitmap by rule=bitmap-peer Mar 17 01:54:24 offine-stand-stor-0 [ 129.260975] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479: susp-io( no -> quorum ) [attach] Mar 17 01:54:24 offine-stand-stor-0 [ 129.260978] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:24 offine-stand-stor-0 [ 129.260986] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064: Maximum number of peer devices = 7 Mar 17 01:54:24 offine-stand-stor-0 [ 129.269609] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 129.269614] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 129.279268] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.281847] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 129.281851] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 129.285750] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.288626] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29: Preparing cluster-wide state change 3163046038 (1->2 499/146) Mar 17 01:54:24 offine-stand-stor-0 [ 129.291182] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-3: Aborting local state change 3163046038 to yield to remote state change 818954093. Mar 17 01:54:24 offine-stand-stor-0 [ 129.294831] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333/0 drbd1109: size = 5123 MB (5245816 KB) Mar 17 01:54:24 offine-stand-stor-0 [ 129.295442] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32/0 drbd1075 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.298170] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333/0 drbd1109 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:24 offine-stand-stor-0 [ 129.299351] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479: Method to ensure write ordering: flush Mar 17 01:54:24 offine-stand-stor-0 [ 129.301710] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333/0 drbd1109 offline-stand-stor-4: peer 75C034D691028496:0000000000000000:E68A7865721195AA:0000000000000000 bits:0 flags:1120 Mar 17 01:54:24 offine-stand-stor-0 [ 129.303100] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-3: Committing remote state change 3305742372 (primary_nodes=1) Mar 17 01:54:24 offine-stand-stor-0 [ 129.303110] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-3: Preparing remote state change 4259652127 Mar 17 01:54:24 offine-stand-stor-0 [ 129.303242] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:24 offine-stand-stor-0 [ 129.303679] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:24 offine-stand-stor-0 [ 129.303682] drbd1064: detected capacity change from 0 to 10491632 Mar 17 01:54:24 offine-stand-stor-0 [ 129.303683] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064: size = 5123 MB (5245816 KB) Mar 17 01:54:24 offine-stand-stor-0 [ 129.305914] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333/0 drbd1109: Setting exposed data uuid: 75C034D691028496 Mar 17 01:54:24 offine-stand-stor-0 [ 129.306979] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658: susp-io( quorum -> no ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.309783] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064: recounting of set bits took additional 0ms Mar 17 01:54:24 offine-stand-stor-0 [ 129.310289] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Primary ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.310292] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: quorum( no -> yes ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.313448] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:24 offine-stand-stor-0 [ 129.314237] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> WFBitMapT ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.315110] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064: attached to current UUID: F9C8F620D3C9BE96 Mar 17 01:54:24 offine-stand-stor-0 [ 129.316127] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: Disabling local AL-updates (optimization) Mar 17 01:54:24 offine-stand-stor-0 [ 129.318891] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064: Setting exposed data uuid: F9C8F620D3C9BE96 Mar 17 01:54:24 offine-stand-stor-0 [ 129.319734] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: Setting exposed data uuid: 15376AF37D222C30 Mar 17 01:54:24 offine-stand-stor-0 [ 129.323712] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 129.324151] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-4: Committing remote state change 1608685860 (primary_nodes=0) Mar 17 01:54:24 offine-stand-stor-0 [ 129.325985] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 129.327267] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:24 offine-stand-stor-0 [ 129.327893] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.352477] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333: susp-io( quorum -> no ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.356698] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:24 offine-stand-stor-0 [ 129.365345] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-1: Preparing remote state change 2560937412 Mar 17 01:54:24 offine-stand-stor-0 [ 129.373525] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.375409] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-1721 [9452]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.376338] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333/0 drbd1109: quorum( no -> yes ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.377827] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-1721 [9452]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.378884] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:24 offine-stand-stor-0 [ 129.379450] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333/0 drbd1109 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.381740] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 39(1), total 39; compression: 100.0% Mar 17 01:54:24 offine-stand-stor-0 [ 129.383593] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-1: Preparing remote state change 1708787313 Mar 17 01:54:24 offine-stand-stor-0 [ 129.384679] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 39(1), total 39; compression: 100.0% Mar 17 01:54:24 offine-stand-stor-0 [ 129.388608] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be/0 drbd1086 offline-stand-stor-1: my exposed UUID: 17C724C40788D92E Mar 17 01:54:24 offine-stand-stor-0 [ 129.389036] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: disk( Outdated -> Inconsistent ) [receive-bitmap] Mar 17 01:54:24 offine-stand-stor-0 [ 129.390159] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be/0 drbd1086 offline-stand-stor-1: peer 17C724C40788D92E:0000000000000000:C42A79512F502348:0000000000000000 bits:0 flags:1120 Mar 17 01:54:24 offine-stand-stor-0 [ 129.391702] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32/0 drbd1075 offline-stand-stor-3: my exposed UUID: FC76BAD32E6DCEAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.391706] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32/0 drbd1075 offline-stand-stor-3: peer FC76BAD32E6DCEAC:0000000000000000:F0CD198FF2FC0FC0:0000000000000000 bits:0 flags:1120 Mar 17 01:54:24 offine-stand-stor-0 [ 129.391891] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: repl( WFBitMapT -> SyncTarget ) [receive-bitmap] Mar 17 01:54:24 offine-stand-stor-0 [ 129.429669] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 129.430575] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-1: resync-susp( no -> connection dependency ) [receive-bitmap] Mar 17 01:54:24 offine-stand-stor-0 [ 129.431451] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 129.432429] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27: Starting worker thread (from drbdsetup [9501]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.432495] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: Began resync as SyncTarget (will sync 3580 KB [895 bits set]). Mar 17 01:54:24 offine-stand-stor-0 [ 129.435967] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-3: Committing remote state change 4259652127 (primary_nodes=0) Mar 17 01:54:24 offine-stand-stor-0 [ 129.438752] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333/0 drbd1109 offline-stand-stor-1: my exposed UUID: 75C034D691028496 Mar 17 01:54:24 offine-stand-stor-0 [ 129.439092] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 129.439095] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 129.440002] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b/0 drbd1120 offline-stand-stor-1: my exposed UUID: CACC42BA1356F916 Mar 17 01:54:24 offine-stand-stor-0 [ 129.440005] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b/0 drbd1120 offline-stand-stor-1: peer CACC42BA1356F916:0000000000000000:F454AA5666D6FFBE:0000000000000000 bits:0 flags:1120 Mar 17 01:54:24 offine-stand-stor-0 [ 129.442457] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.442468] drbd pvc-1022be2e-e783-47ff-b078-d93a547a7d32/0 drbd1075 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.443229] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.444886] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-1: Starting sender thread (from drbdsetup [9509]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.446034] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-4: Starting sender thread (from drbdsetup [9511]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.449026] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-1: Committing remote state change 2560937412 (primary_nodes=0) Mar 17 01:54:24 offine-stand-stor-0 [ 129.449035] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.449043] drbd pvc-09bd4c3d-e6d5-4b73-b515-46e25c83f25b/0 drbd1120 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.449552] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:24 offine-stand-stor-0 [ 129.449708] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27: susp-io( no -> quorum ) [connect] Mar 17 01:54:24 offine-stand-stor-0 [ 129.449711] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:24 offine-stand-stor-0 [ 129.449744] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-178d [9505]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.449787] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:24 offine-stand-stor-0 [ 129.450736] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:24 offine-stand-stor-0 [ 129.450759] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-178d [9505]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.450822] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:24 offine-stand-stor-0 [ 129.483169] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333/0 drbd1109 offline-stand-stor-1: peer 75C034D691028496:0000000000000000:0E4841D0F8C7312C:0000000000000000 bits:0 flags:1120 Mar 17 01:54:24 offine-stand-stor-0 [ 129.579305] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-1: Committing remote state change 4076238116 (primary_nodes=0) Mar 17 01:54:24 offine-stand-stor-0 [ 129.579311] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.579621] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-1: Committing remote state change 1708787313 (primary_nodes=0) Mar 17 01:54:24 offine-stand-stor-0 [ 129.580138] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.580268] drbd pvc-12774cb8-44c1-45be-8ffa-b555b1c61333/0 drbd1109 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.584584] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e: Preparing cluster-wide state change 2395545894 (1->2 499/146) Mar 17 01:54:24 offine-stand-stor-0 [ 129.585785] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.595548] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-3: Aborting local state change 2395545894 to yield to remote state change 1494044937. Mar 17 01:54:24 offine-stand-stor-0 [ 129.596820] drbd pvc-0c9ce22d-ee5b-4bea-a6e5-86d971b307be/0 drbd1086 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:24 offine-stand-stor-0 [ 129.633359] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba: Starting worker thread (from drbdsetup [9536]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.640484] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-2: Starting sender thread (from drbdsetup [9541]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.646217] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: Starting sender thread (from drbdsetup [9543]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.663136] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039: meta-data IO uses: blk-bio Mar 17 01:54:24 offine-stand-stor-0 [ 129.664769] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba: susp-io( no -> quorum ) [attach] Mar 17 01:54:24 offine-stand-stor-0 [ 129.666089] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:24 offine-stand-stor-0 [ 129.667354] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039: Maximum number of peer devices = 7 Mar 17 01:54:24 offine-stand-stor-0 [ 129.669050] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba: Method to ensure write ordering: flush Mar 17 01:54:24 offine-stand-stor-0 [ 129.670972] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:24 offine-stand-stor-0 [ 129.673504] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:24 offine-stand-stor-0 [ 129.675500] drbd1039: detected capacity change from 0 to 10491632 Mar 17 01:54:24 offine-stand-stor-0 [ 129.677119] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039: size = 5123 MB (5245816 KB) Mar 17 01:54:24 offine-stand-stor-0 [ 129.685255] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 129.687390] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039: recounting of set bits took additional 0ms Mar 17 01:54:24 offine-stand-stor-0 [ 129.689594] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:24 offine-stand-stor-0 [ 129.689597] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 129.693191] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.701950] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: Resync done (total 1 sec; paused 0 sec; 3580 K/sec) Mar 17 01:54:24 offine-stand-stor-0 [ 129.701957] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: updated UUIDs 15376AF37D222C30:0000000000000000:9861276908E13884:9490607B36C192B0 Mar 17 01:54:24 offine-stand-stor-0 [ 129.701967] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004: disk( Inconsistent -> UpToDate ) [resync-finished] Mar 17 01:54:24 offine-stand-stor-0 [ 129.701970] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-3: repl( SyncTarget -> Established ) [resync-finished] Mar 17 01:54:24 offine-stand-stor-0 [ 129.701973] drbd pvc-0b3d58c7-c2eb-4d11-93c5-eb17afd8d658/0 drbd1004 offline-stand-stor-1: resync-susp( connection dependency -> no ) [resync-finished] Mar 17 01:54:24 offine-stand-stor-0 [ 129.713239] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-3: Preparing remote state change 2319735983 Mar 17 01:54:24 offine-stand-stor-0 [ 129.718698] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:24 offine-stand-stor-0 [ 129.718961] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:24 offine-stand-stor-0 [ 129.720142] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:24 offine-stand-stor-0 [ 129.731222] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-3: Preparing remote state change 748916018 Mar 17 01:54:24 offine-stand-stor-0 [ 129.731440] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039: attached to current UUID: 9FC928A9D4517B98 Mar 17 01:54:24 offine-stand-stor-0 [ 129.745038] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039: Setting exposed data uuid: 9FC928A9D4517B98 Mar 17 01:54:24 offine-stand-stor-0 [ 129.749361] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:24 offine-stand-stor-0 [ 129.752025] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:24 offine-stand-stor-0 [ 129.752353] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-1f54 [9537]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.755720] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:24 offine-stand-stor-0 [ 129.755742] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-1f54 [9537]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.761516] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:24 offine-stand-stor-0 [ 129.781463] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269: Starting worker thread (from drbdsetup [9570]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.792562] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29: Aborting cluster-wide state change 3163046038 (504ms) rv = -19 Mar 17 01:54:24 offine-stand-stor-0 [ 129.794172] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-3: Preparing remote state change 818954093 Mar 17 01:54:24 offine-stand-stor-0 [ 129.809547] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-1: Starting sender thread (from drbdsetup [9575]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.851859] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-4: Starting sender thread (from drbdsetup [9577]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.859588] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269: susp-io( no -> quorum ) [connect] Mar 17 01:54:24 offine-stand-stor-0 [ 129.860722] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:24 offine-stand-stor-0 [ 129.861758] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-1f66 [9571]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.863814] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:24 offine-stand-stor-0 [ 129.866471] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-1f66 [9571]) Mar 17 01:54:24 offine-stand-stor-0 [ 129.866666] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:24 offine-stand-stor-0 [ 129.872823] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:25 offine-stand-stor-0 [ 129.889149] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423: Starting worker thread (from drbdsetup [9592]) Mar 17 01:54:25 offine-stand-stor-0 [ 129.897597] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-2: Starting sender thread (from drbdsetup [9597]) Mar 17 01:54:25 offine-stand-stor-0 [ 129.904625] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-4: Starting sender thread (from drbdsetup [9599]) Mar 17 01:54:25 offine-stand-stor-0 [ 129.911453] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423: susp-io( no -> quorum ) [connect] Mar 17 01:54:25 offine-stand-stor-0 [ 129.912421] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:25 offine-stand-stor-0 [ 129.914054] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-21bf [9593]) Mar 17 01:54:25 offine-stand-stor-0 [ 129.915191] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:25 offine-stand-stor-0 [ 129.953520] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:25 offine-stand-stor-0 [ 129.957782] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:25 offine-stand-stor-0 [ 129.960647] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9/0 drbd1092 offline-stand-stor-3: my exposed UUID: 911487E4ADD8A246 Mar 17 01:54:25 offine-stand-stor-0 [ 129.963267] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9/0 drbd1092 offline-stand-stor-3: peer 911487E4ADD8A246:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:25 offine-stand-stor-0 [ 129.963271] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:25 offine-stand-stor-0 [ 129.964751] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:25 offine-stand-stor-0 [ 129.964753] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056 offline-stand-stor-3: self D7B2E43ACD922AC2:0000000000000000:CD2732354265AB5A:0000000000000000 bits:0 flags:20 Mar 17 01:54:25 offine-stand-stor-0 [ 129.964756] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056 offline-stand-stor-3: peer D7B2E43ACD922AC2:0000000000000000:50FBCF976585D904:AC389EC8EB021BF8 bits:0 flags:1120 Mar 17 01:54:25 offine-stand-stor-0 [ 129.964759] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:25 offine-stand-stor-0 [ 129.968623] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:25 offine-stand-stor-0 [ 129.970147] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-21bf [9593]) Mar 17 01:54:25 offine-stand-stor-0 [ 129.972745] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:25 offine-stand-stor-0 [ 129.973479] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:25 offine-stand-stor-0 [ 129.973482] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:25 offine-stand-stor-0 [ 129.986975] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479: Preparing cluster-wide state change 785017803 (0->1 499/146) Mar 17 01:54:25 offine-stand-stor-0 [ 129.987069] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-3: Committing remote state change 2319735983 (primary_nodes=0) Mar 17 01:54:25 offine-stand-stor-0 [ 129.987077] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 129.987079] drbd pvc-0d5634bb-258c-4d72-9d7f-9d4e00ea8ce9/0 drbd1092 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 129.989535] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f: Starting worker thread (from drbdsetup [9614]) Mar 17 01:54:25 offine-stand-stor-0 [ 129.992983] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:25 offine-stand-stor-0 [ 129.992993] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044 offline-stand-stor-3: self 332C37166175B492:0000000000000000:AEBBA1CC55679BF4:0000000000000000 bits:0 flags:20 Mar 17 01:54:25 offine-stand-stor-0 [ 129.992997] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044 offline-stand-stor-3: peer 332C37166175B492:0000000000000000:AF706AA382F95CA8:B22AA4BAEAD85980 bits:0 flags:1120 Mar 17 01:54:25 offine-stand-stor-0 [ 129.993000] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:25 offine-stand-stor-0 [ 129.997417] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-1: Starting sender thread (from drbdsetup [9619]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.001819] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-3: Starting sender thread (from drbdsetup [9621]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.002276] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-3: Committing remote state change 818954093 (primary_nodes=0) Mar 17 01:54:25 offine-stand-stor-0 [ 130.002294] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29: susp-io( quorum -> no ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.002296] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.002298] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056: quorum( no -> yes ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.002301] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.002469] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056 offline-stand-stor-3: cleared bm UUID and bitmap D7B2E43ACD922AC2:0000000000000000:CD2732354265AB5A:0000000000000000 Mar 17 01:54:25 offine-stand-stor-0 [ 130.002794] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29: Preparing cluster-wide state change 3277483361 (1->2 499/146) Mar 17 01:54:25 offine-stand-stor-0 [ 130.008120] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f: susp-io( no -> quorum ) [connect] Mar 17 01:54:25 offine-stand-stor-0 [ 130.008129] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:25 offine-stand-stor-0 [ 130.008161] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-232c [9615]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.009206] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:25 offine-stand-stor-0 [ 130.009292] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:25 offine-stand-stor-0 [ 130.009326] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-232c [9615]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.012469] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:25 offine-stand-stor-0 [ 130.018570] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:25 offine-stand-stor-0 [ 130.020665] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-3: Committing remote state change 748916018 (primary_nodes=0) Mar 17 01:54:25 offine-stand-stor-0 [ 130.022828] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:25 offine-stand-stor-0 [ 130.024547] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:25 offine-stand-stor-0 [ 130.025285] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02: susp-io( quorum -> no ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.035137] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:25 offine-stand-stor-0 [ 130.037374] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.037994] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478: Starting worker thread (from drbdsetup [9639]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.047309] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-1: Preparing remote state change 4015626669 Mar 17 01:54:25 offine-stand-stor-0 [ 130.049076] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044: quorum( no -> yes ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.049081] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.100541] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e: Aborting cluster-wide state change 2395545894 (516ms) rv = -19 Mar 17 01:54:25 offine-stand-stor-0 [ 130.102117] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-3: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:25 offine-stand-stor-0 [ 130.102463] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044 offline-stand-stor-3: cleared bm UUID and bitmap 332C37166175B492:0000000000000000:AEBBA1CC55679BF4:0000000000000000 Mar 17 01:54:25 offine-stand-stor-0 [ 130.102791] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02: Preparing cluster-wide state change 1145215542 (1->2 499/146) Mar 17 01:54:25 offine-stand-stor-0 [ 130.106228] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-3: Preparing remote state change 1494044937 Mar 17 01:54:25 offine-stand-stor-0 [ 130.109758] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:25 offine-stand-stor-0 [ 130.114566] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-2: Starting sender thread (from drbdsetup [9644]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.125195] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:25 offine-stand-stor-0 [ 130.186014] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-3: Starting sender thread (from drbdsetup [9646]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.188745] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056 offline-stand-stor-2: self D7B2E43ACD922AC2:0000000000000000:CD2732354265AB5A:0000000000000000 bits:0 flags:0 Mar 17 01:54:25 offine-stand-stor-0 [ 130.190735] drbd1040: detected capacity change from 0 to 10491632 Mar 17 01:54:25 offine-stand-stor-0 [ 130.193557] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056 offline-stand-stor-2: peer's exposed UUID: D7B2E43ACD922AC2 Mar 17 01:54:25 offine-stand-stor-0 [ 130.193575] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29: State change 3277483361: primary_nodes=0, weak_nodes=0 Mar 17 01:54:25 offine-stand-stor-0 [ 130.193578] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29: Committing cluster-wide state change 3277483361 (192ms) Mar 17 01:54:25 offine-stand-stor-0 [ 130.193685] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:25 offine-stand-stor-0 [ 130.193689] drbd pvc-136e7e48-d023-428c-9543-c7c19a374b29/0 drbd1056 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:25 offine-stand-stor-0 [ 130.198498] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:25 offine-stand-stor-0 [ 130.199500] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27/0 drbd1040: size = 5123 MB (5245816 KB) Mar 17 01:54:25 offine-stand-stor-0 [ 130.201445] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064 offline-stand-stor-2: self F9C8F620D3C9BE96:0000000000000000:0E0718C742350182:EE2E3A0050CA3EBC bits:0 flags:20 Mar 17 01:54:25 offine-stand-stor-0 [ 130.201450] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064 offline-stand-stor-2: peer F9C8F620D3C9BE96:0000000000000000:0E0718C742350182:B05681548A8C7430 bits:0 flags:1120 Mar 17 01:54:25 offine-stand-stor-0 [ 130.201457] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:25 offine-stand-stor-0 [ 130.203002] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27/0 drbd1040 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:25 offine-stand-stor-0 [ 130.204965] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479: State change 785017803: primary_nodes=0, weak_nodes=0 Mar 17 01:54:25 offine-stand-stor-0 [ 130.206288] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27/0 drbd1040 offline-stand-stor-1: peer 48C5EBB710C129D4:0000000000000000:D2125B2DDA2E521C:0000000000000000 bits:0 flags:1120 Mar 17 01:54:25 offine-stand-stor-0 [ 130.207258] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479: Committing cluster-wide state change 785017803 (220ms) Mar 17 01:54:25 offine-stand-stor-0 [ 130.207896] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478: susp-io( no -> quorum ) [connect] Mar 17 01:54:25 offine-stand-stor-0 [ 130.207899] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:25 offine-stand-stor-0 [ 130.207930] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-2ac8 [9640]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.207968] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:25 offine-stand-stor-0 [ 130.208670] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044 offline-stand-stor-2: self 332C37166175B492:0000000000000000:AEBBA1CC55679BF4:0000000000000000 bits:0 flags:0 Mar 17 01:54:25 offine-stand-stor-0 [ 130.208674] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044 offline-stand-stor-2: peer's exposed UUID: 332C37166175B492 Mar 17 01:54:25 offine-stand-stor-0 [ 130.208687] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02: State change 1145215542: primary_nodes=0, weak_nodes=0 Mar 17 01:54:25 offine-stand-stor-0 [ 130.208689] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02: Committing cluster-wide state change 1145215542 (108ms) Mar 17 01:54:25 offine-stand-stor-0 [ 130.208715] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:25 offine-stand-stor-0 [ 130.208718] drbd pvc-162417e7-db81-4ac1-9bea-f0850b479d02/0 drbd1044 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:25 offine-stand-stor-0 [ 130.208840] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:25 offine-stand-stor-0 [ 130.208843] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071 offline-stand-stor-3: self AC23BAAC9C28C062:0000000000000000:7F9043834CB1B6BE:0000000000000000 bits:0 flags:20 Mar 17 01:54:25 offine-stand-stor-0 [ 130.208847] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071 offline-stand-stor-3: peer AC23BAAC9C28C062:0000000000000000:F98FD54AAE5F0220:5A5639229C73AC38 bits:0 flags:1120 Mar 17 01:54:25 offine-stand-stor-0 [ 130.208851] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:25 offine-stand-stor-0 [ 130.210220] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27/0 drbd1040: Setting exposed data uuid: 48C5EBB710C129D4 Mar 17 01:54:25 offine-stand-stor-0 [ 130.213096] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:25 offine-stand-stor-0 [ 130.213789] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479: susp-io( quorum -> no ) [connected] Mar 17 01:54:25 offine-stand-stor-0 [ 130.215268] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-2ac8 [9640]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.217722] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:25 offine-stand-stor-0 [ 130.220975] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-3: Committing remote state change 1494044937 (primary_nodes=0) Mar 17 01:54:25 offine-stand-stor-0 [ 130.222633] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064: quorum( no -> yes ) [connected] Mar 17 01:54:25 offine-stand-stor-0 [ 130.222637] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [connected] Mar 17 01:54:25 offine-stand-stor-0 [ 130.222732] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064 offline-stand-stor-2: cleared bm UUID and bitmap F9C8F620D3C9BE96:0000000000000000:0E0718C742350182:EE2E3A0050CA3EBC Mar 17 01:54:25 offine-stand-stor-0 [ 130.224246] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e: susp-io( quorum -> no ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.226050] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-1: Committing remote state change 4015626669 (primary_nodes=0) Mar 17 01:54:25 offine-stand-stor-0 [ 130.229736] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.231803] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27: susp-io( quorum -> no ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.234246] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071: quorum( no -> yes ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.236243] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.236247] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27/0 drbd1040: quorum( no -> yes ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.236250] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27/0 drbd1040 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.241227] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.259479] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479: Preparing cluster-wide state change 418659922 (0->2 499/146) Mar 17 01:54:25 offine-stand-stor-0 [ 130.259843] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071 offline-stand-stor-3: cleared bm UUID and bitmap AC23BAAC9C28C062:0000000000000000:7F9043834CB1B6BE:0000000000000000 Mar 17 01:54:25 offine-stand-stor-0 [ 130.282018] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af: Starting worker thread (from drbdsetup [9670]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.282921] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-4: Preparing remote state change 3707175694 Mar 17 01:54:25 offine-stand-stor-0 [ 130.283139] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e: Preparing cluster-wide state change 4053084505 (1->2 499/146) Mar 17 01:54:25 offine-stand-stor-0 [ 130.284655] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:25 offine-stand-stor-0 [ 130.346080] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:25 offine-stand-stor-0 [ 130.348774] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:25 offine-stand-stor-0 [ 130.350073] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:25 offine-stand-stor-0 [ 130.352255] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:25 offine-stand-stor-0 [ 130.364088] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-2: Starting sender thread (from drbdsetup [9675]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.366407] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:25 offine-stand-stor-0 [ 130.368582] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071 offline-stand-stor-2: self AC23BAAC9C28C062:0000000000000000:7F9043834CB1B6BE:0000000000000000 bits:0 flags:0 Mar 17 01:54:25 offine-stand-stor-0 [ 130.368664] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27/0 drbd1040 offline-stand-stor-4: my exposed UUID: 48C5EBB710C129D4 Mar 17 01:54:25 offine-stand-stor-0 [ 130.368667] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27/0 drbd1040 offline-stand-stor-4: peer 48C5EBB710C129D4:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:25 offine-stand-stor-0 [ 130.371486] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:25 offine-stand-stor-0 [ 130.372323] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-3: Starting sender thread (from drbdsetup [9677]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.373192] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071 offline-stand-stor-2: peer's exposed UUID: AC23BAAC9C28C062 Mar 17 01:54:25 offine-stand-stor-0 [ 130.373239] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e: State change 4053084505: primary_nodes=0, weak_nodes=0 Mar 17 01:54:25 offine-stand-stor-0 [ 130.373242] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e: Committing cluster-wide state change 4053084505 (92ms) Mar 17 01:54:25 offine-stand-stor-0 [ 130.373307] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:25 offine-stand-stor-0 [ 130.379542] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064 offline-stand-stor-3: self F9C8F620D3C9BE96:0000000000000000:0E0718C742350182:EE2E3A0050CA3EBC bits:0 flags:0 Mar 17 01:54:25 offine-stand-stor-0 [ 130.380545] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba: Preparing cluster-wide state change 816755780 (1->2 499/146) Mar 17 01:54:25 offine-stand-stor-0 [ 130.381261] drbd pvc-15fce6ad-bcb4-4d93-899c-080ee583824e/0 drbd1071 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:25 offine-stand-stor-0 [ 130.386277] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028: meta-data IO uses: blk-bio Mar 17 01:54:25 offine-stand-stor-0 [ 130.387217] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064 offline-stand-stor-3: peer's exposed UUID: F9C8F620D3C9BE97 Mar 17 01:54:25 offine-stand-stor-0 [ 130.387770] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-4: Committing remote state change 3707175694 (primary_nodes=0) Mar 17 01:54:25 offine-stand-stor-0 [ 130.387781] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.387785] drbd pvc-178da240-67f3-4744-87b3-bc708dfaad27/0 drbd1040 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.388601] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:25 offine-stand-stor-0 [ 130.388605] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:25 offine-stand-stor-0 [ 130.389953] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af: susp-io( no -> quorum ) [attach] Mar 17 01:54:25 offine-stand-stor-0 [ 130.392310] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479: State change 418659922: primary_nodes=0, weak_nodes=0 Mar 17 01:54:25 offine-stand-stor-0 [ 130.392622] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:25 offine-stand-stor-0 [ 130.392625] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:25 offine-stand-stor-0 [ 130.393321] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:25 offine-stand-stor-0 [ 130.393368] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028: Maximum number of peer devices = 7 Mar 17 01:54:25 offine-stand-stor-0 [ 130.395042] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479: Committing cluster-wide state change 418659922 (136ms) Mar 17 01:54:25 offine-stand-stor-0 [ 130.397093] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af: Method to ensure write ordering: flush Mar 17 01:54:25 offine-stand-stor-0 [ 130.403879] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:25 offine-stand-stor-0 [ 130.405556] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:25 offine-stand-stor-0 [ 130.405560] drbd pvc-1721262e-07da-4c89-a3bb-f6d499470479/0 drbd1064 offline-stand-stor-3: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:25 offine-stand-stor-0 [ 130.405684] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: Aborting local state change 816755780 to yield to remote state change 3363482545. Mar 17 01:54:25 offine-stand-stor-0 [ 130.405693] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:25 offine-stand-stor-0 [ 130.405945] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:25 offine-stand-stor-0 [ 130.406334] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:25 offine-stand-stor-0 [ 130.406338] drbd1028: detected capacity change from 0 to 10491632 Mar 17 01:54:25 offine-stand-stor-0 [ 130.406345] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028: size = 5123 MB (5245816 KB) Mar 17 01:54:25 offine-stand-stor-0 [ 130.411752] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-4: Preparing remote state change 2275900327 Mar 17 01:54:25 offine-stand-stor-0 [ 130.417631] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028: recounting of set bits took additional 0ms Mar 17 01:54:25 offine-stand-stor-0 [ 130.425093] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039 offline-stand-stor-2: self 9FC928A9D4517B98:0000000000000000:5E019A2A9CCE3BD4:0000000000000000 bits:0 flags:0 Mar 17 01:54:25 offine-stand-stor-0 [ 130.425649] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:25 offine-stand-stor-0 [ 130.427751] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039 offline-stand-stor-2: peer's exposed UUID: 9FC928A9D4517B98 Mar 17 01:54:25 offine-stand-stor-0 [ 130.429768] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028: attached to current UUID: 8AD22D573BCFBF56 Mar 17 01:54:25 offine-stand-stor-0 [ 130.429774] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028: Setting exposed data uuid: 8AD22D573BCFBF56 Mar 17 01:54:25 offine-stand-stor-0 [ 130.432030] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba: Aborting cluster-wide state change 816755780 (48ms) rv = -19 Mar 17 01:54:25 offine-stand-stor-0 [ 130.452792] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: Preparing remote state change 3363482545 Mar 17 01:54:25 offine-stand-stor-0 [ 130.461037] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:25 offine-stand-stor-0 [ 130.463424] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-2e78 [9671]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.467428] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:25 offine-stand-stor-0 [ 130.471066] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:25 offine-stand-stor-0 [ 130.472821] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-2e78 [9671]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.475517] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:25 offine-stand-stor-0 [ 130.493906] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:25 offine-stand-stor-0 [ 130.495994] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:25 offine-stand-stor-0 [ 130.499138] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:25 offine-stand-stor-0 [ 130.507244] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-2: Preparing remote state change 1580237204 Mar 17 01:54:25 offine-stand-stor-0 [ 130.521265] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43: Starting worker thread (from drbdsetup [9707]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.540717] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-1: Starting sender thread (from drbdsetup [9712]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.545795] drbd1111: detected capacity change from 0 to 10491632 Mar 17 01:54:25 offine-stand-stor-0 [ 130.546824] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269/0 drbd1111: size = 5123 MB (5245816 KB) Mar 17 01:54:25 offine-stand-stor-0 [ 130.547873] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269/0 drbd1111 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:25 offine-stand-stor-0 [ 130.548611] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:25 offine-stand-stor-0 [ 130.549228] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269/0 drbd1111 offline-stand-stor-4: peer EA23F0B204463410:0000000000000000:2F74830BE5C1B864:0000000000000000 bits:0 flags:1120 Mar 17 01:54:25 offine-stand-stor-0 [ 130.551230] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-4: Starting sender thread (from drbdsetup [9714]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.551450] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:25 offine-stand-stor-0 [ 130.553992] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269/0 drbd1111: Setting exposed data uuid: EA23F0B204463410 Mar 17 01:54:25 offine-stand-stor-0 [ 130.554081] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:25 offine-stand-stor-0 [ 130.554083] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:25 offine-stand-stor-0 [ 130.558681] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43: susp-io( no -> quorum ) [connect] Mar 17 01:54:25 offine-stand-stor-0 [ 130.562694] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:25 offine-stand-stor-0 [ 130.564818] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:25 offine-stand-stor-0 [ 130.566373] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:25 offine-stand-stor-0 [ 130.568082] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-4: Committing remote state change 2275900327 (primary_nodes=0) Mar 17 01:54:25 offine-stand-stor-0 [ 130.569881] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:25 offine-stand-stor-0 [ 130.571317] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269: susp-io( quorum -> no ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.573181] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-2ebb [9708]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.573837] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.576087] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:25 offine-stand-stor-0 [ 130.576104] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-2ebb [9708]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.577407] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269/0 drbd1111: quorum( no -> yes ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.582541] drbd1015: detected capacity change from 0 to 10491632 Mar 17 01:54:25 offine-stand-stor-0 [ 130.583374] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269/0 drbd1111 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:25 offine-stand-stor-0 [ 130.583450] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-1: Preparing remote state change 3546842342 Mar 17 01:54:25 offine-stand-stor-0 [ 130.584619] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:25 offine-stand-stor-0 [ 130.584622] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039 offline-stand-stor-3: self 9FC928A9D4517B98:0000000000000000:5E019A2A9CCE3BD4:0000000000000000 bits:0 flags:20 Mar 17 01:54:25 offine-stand-stor-0 [ 130.584630] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039 offline-stand-stor-3: peer 9FC928A9D4517B98:0000000000000000:5215B42EDE763CCC:7660B532A68EEB5C bits:0 flags:1120 Mar 17 01:54:25 offine-stand-stor-0 [ 130.584633] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:25 offine-stand-stor-0 [ 130.584638] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: Aborting remote state change 3363482545 Mar 17 01:54:25 offine-stand-stor-0 [ 130.584644] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: Preparing remote state change 2570782627 Mar 17 01:54:25 offine-stand-stor-0 [ 130.592825] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:25 offine-stand-stor-0 [ 130.594505] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-3: Preparing remote state change 3488664573 Mar 17 01:54:25 offine-stand-stor-0 [ 130.605006] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a: Starting worker thread (from drbdsetup [9732]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.610569] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-1: Starting sender thread (from drbdsetup [9737]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.612610] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:25 offine-stand-stor-0 [ 130.612612] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:25 offine-stand-stor-0 [ 130.623678] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:25 offine-stand-stor-0 [ 130.628075] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423/0 drbd1015: size = 5123 MB (5245816 KB) Mar 17 01:54:25 offine-stand-stor-0 [ 130.631362] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-2: Starting sender thread (from drbdsetup [9739]) Mar 17 01:54:25 offine-stand-stor-0 [ 130.657541] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423/0 drbd1015 offline-stand-stor-2: my exposed UUID: 0000000000000000 Mar 17 01:54:25 offine-stand-stor-0 [ 130.662540] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a: susp-io( no -> quorum ) [connect] Mar 17 01:54:26 offine-stand-stor-0 [ 130.664642] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:26 offine-stand-stor-0 [ 130.664645] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039 offline-stand-stor-3: self 9FC928A9D4517B98:0000000000000000:5E019A2A9CCE3BD4:0000000000000000 bits:0 flags:20 Mar 17 01:54:26 offine-stand-stor-0 [ 130.664648] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039 offline-stand-stor-3: peer 9FC928A9D4517B98:0000000000000000:5215B42EDE763CCC:7660B532A68EEB5C bits:0 flags:1120 Mar 17 01:54:26 offine-stand-stor-0 [ 130.664652] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:26 offine-stand-stor-0 [ 130.664666] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: Committing remote state change 2570782627 (primary_nodes=0) Mar 17 01:54:26 offine-stand-stor-0 [ 130.664673] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba: susp-io( quorum -> no ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 130.664676] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 130.664678] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039: quorum( no -> yes ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 130.664686] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 130.664758] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039 offline-stand-stor-3: cleared bm UUID and bitmap 9FC928A9D4517B98:0000000000000000:5E019A2A9CCE3BD4:0000000000000000 Mar 17 01:54:26 offine-stand-stor-0 [ 130.665097] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba: Preparing cluster-wide state change 1584139971 (1->2 499/146) Mar 17 01:54:26 offine-stand-stor-0 [ 130.684277] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423/0 drbd1015 offline-stand-stor-2: peer A849F7D7CD62FB5A:0000000000000000:0F794E148EB69A36:0000000000000000 bits:0 flags:1120 Mar 17 01:54:26 offine-stand-stor-0 [ 130.686227] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:26 offine-stand-stor-0 [ 130.686400] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-2f3e [9733]) Mar 17 01:54:26 offine-stand-stor-0 [ 130.686579] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:26 offine-stand-stor-0 [ 130.720887] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423/0 drbd1015: Setting exposed data uuid: A849F7D7CD62FB5A Mar 17 01:54:26 offine-stand-stor-0 [ 130.724374] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:26 offine-stand-stor-0 [ 130.740624] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:26 offine-stand-stor-0 [ 130.740645] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:26 offine-stand-stor-0 [ 130.746373] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:26 offine-stand-stor-0 [ 130.760765] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-2: Committing remote state change 1580237204 (primary_nodes=0) Mar 17 01:54:26 offine-stand-stor-0 [ 130.761225] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-2f3e [9733]) Mar 17 01:54:26 offine-stand-stor-0 [ 130.776588] drbd1099: detected capacity change from 0 to 10491632 Mar 17 01:54:26 offine-stand-stor-0 [ 130.776592] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f/0 drbd1099: size = 5123 MB (5245816 KB) Mar 17 01:54:26 offine-stand-stor-0 [ 130.776668] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f/0 drbd1099 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:26 offine-stand-stor-0 [ 130.776671] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f/0 drbd1099 offline-stand-stor-3: peer 78EC0F8B345D3706:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:26 offine-stand-stor-0 [ 130.776673] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f/0 drbd1099: Setting exposed data uuid: 78EC0F8B345D3706 Mar 17 01:54:26 offine-stand-stor-0 [ 130.784553] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423: susp-io( quorum -> no ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 130.785280] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-3: Committing remote state change 3488664573 (primary_nodes=0) Mar 17 01:54:26 offine-stand-stor-0 [ 130.785765] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:26 offine-stand-stor-0 [ 130.799365] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-2: Preparing remote state change 1498802456 Mar 17 01:54:26 offine-stand-stor-0 [ 130.819114] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00: Starting worker thread (from drbdsetup [9764]) Mar 17 01:54:26 offine-stand-stor-0 [ 130.823008] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-1: Starting sender thread (from drbdsetup [9769]) Mar 17 01:54:26 offine-stand-stor-0 [ 130.829994] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-3: Starting sender thread (from drbdsetup [9771]) Mar 17 01:54:26 offine-stand-stor-0 [ 130.832326] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 130.834271] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f: susp-io( quorum -> no ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 130.834281] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 130.834284] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f/0 drbd1099: quorum( no -> yes ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 130.834287] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f/0 drbd1099 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 130.872626] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-3: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:26 offine-stand-stor-0 [ 130.887429] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423/0 drbd1015: quorum( no -> yes ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 130.887477] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423/0 drbd1015 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 130.890309] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:26 offine-stand-stor-0 [ 130.893604] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:26 offine-stand-stor-0 [ 130.942967] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017: meta-data IO uses: blk-bio Mar 17 01:54:26 offine-stand-stor-0 [ 130.943488] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-4: Preparing remote state change 1028286734 Mar 17 01:54:26 offine-stand-stor-0 [ 130.946972] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-1: Preparing remote state change 952197283 Mar 17 01:54:26 offine-stand-stor-0 [ 130.952749] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269/0 drbd1111 offline-stand-stor-1: my exposed UUID: EA23F0B204463410 Mar 17 01:54:26 offine-stand-stor-0 [ 130.956782] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00: susp-io( no -> quorum ) [attach] Mar 17 01:54:26 offine-stand-stor-0 [ 130.957717] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269/0 drbd1111 offline-stand-stor-1: peer EA23F0B204463410:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:26 offine-stand-stor-0 [ 130.961947] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:26 offine-stand-stor-0 [ 130.962006] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017: Maximum number of peer devices = 7 Mar 17 01:54:26 offine-stand-stor-0 [ 130.971889] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-1: Committing remote state change 3546842342 (primary_nodes=0) Mar 17 01:54:26 offine-stand-stor-0 [ 130.972848] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00: Method to ensure write ordering: flush Mar 17 01:54:26 offine-stand-stor-0 [ 130.984564] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039 offline-stand-stor-2: self 9FC928A9D4517B98:0000000000000000:5E019A2A9CCE3BD4:0000000000000000 bits:0 flags:0 Mar 17 01:54:26 offine-stand-stor-0 [ 130.985200] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 130.985203] drbd pvc-1f6614d1-3be5-4ae8-9bbf-72cdb7750269/0 drbd1111 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 130.986206] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423/0 drbd1015 offline-stand-stor-4: my exposed UUID: A849F7D7CD62FB5A Mar 17 01:54:26 offine-stand-stor-0 [ 130.986224] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017: drbd_bm_resize called with capacity == 4201520 Mar 17 01:54:26 offine-stand-stor-0 [ 130.986248] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423/0 drbd1015 offline-stand-stor-4: peer A849F7D7CD62FB5A:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:26 offine-stand-stor-0 [ 130.986552] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039 offline-stand-stor-2: peer's exposed UUID: 9FC928A9D4517B98 Mar 17 01:54:26 offine-stand-stor-0 [ 130.990187] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017: resync bitmap: bits=525190 words=57449 pages=113 Mar 17 01:54:26 offine-stand-stor-0 [ 130.992766] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba: State change 1584139971: primary_nodes=0, weak_nodes=0 Mar 17 01:54:26 offine-stand-stor-0 [ 130.993783] drbd1017: detected capacity change from 0 to 4201520 Mar 17 01:54:26 offine-stand-stor-0 [ 130.993785] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017: size = 2052 MB (2100760 KB) Mar 17 01:54:26 offine-stand-stor-0 [ 130.994642] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017: recounting of set bits took additional 0ms Mar 17 01:54:26 offine-stand-stor-0 [ 130.995456] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba: Committing cluster-wide state change 1584139971 (328ms) Mar 17 01:54:26 offine-stand-stor-0 [ 130.996331] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:26 offine-stand-stor-0 [ 130.996334] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017: attached to current UUID: 96BFB5C059A0C94E Mar 17 01:54:26 offine-stand-stor-0 [ 130.996337] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017: Setting exposed data uuid: 96BFB5C059A0C94E Mar 17 01:54:26 offine-stand-stor-0 [ 130.998391] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:26 offine-stand-stor-0 [ 131.000492] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:26 offine-stand-stor-0 [ 131.000643] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-3: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:26 offine-stand-stor-0 [ 131.000647] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:26 offine-stand-stor-0 [ 131.001466] drbd pvc-1f54f996-41a5-4839-b076-c1b3e77176ba/0 drbd1039 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:26 offine-stand-stor-0 [ 131.007234] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-4: Committing remote state change 1028286734 (primary_nodes=0) Mar 17 01:54:26 offine-stand-stor-0 [ 131.008155] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:26 offine-stand-stor-0 [ 131.008743] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:26 offine-stand-stor-0 [ 131.013439] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:26 offine-stand-stor-0 [ 131.014696] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-32f4 [9765]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.014761] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:26 offine-stand-stor-0 [ 131.015839] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:26 offine-stand-stor-0 [ 131.015866] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-32f4 [9765]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.015915] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:26 offine-stand-stor-0 [ 131.016695] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f/0 drbd1099 offline-stand-stor-1: my exposed UUID: 78EC0F8B345D3706 Mar 17 01:54:26 offine-stand-stor-0 [ 131.016699] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f/0 drbd1099 offline-stand-stor-1: peer 78EC0F8B345D3706:0000000000000000:1ADAF561932D97E6:0000000000000000 bits:0 flags:1120 Mar 17 01:54:26 offine-stand-stor-0 [ 131.022856] drbd1082: detected capacity change from 0 to 10491632 Mar 17 01:54:26 offine-stand-stor-0 [ 131.022859] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478/0 drbd1082: size = 5123 MB (5245816 KB) Mar 17 01:54:26 offine-stand-stor-0 [ 131.022904] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478/0 drbd1082 offline-stand-stor-2: my exposed UUID: 0000000000000000 Mar 17 01:54:26 offine-stand-stor-0 [ 131.022907] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478/0 drbd1082 offline-stand-stor-2: peer E64EA4A94BEC3370:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:26 offine-stand-stor-0 [ 131.022914] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478/0 drbd1082: Setting exposed data uuid: E64EA4A94BEC3370 Mar 17 01:54:26 offine-stand-stor-0 [ 131.023502] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-2: Committing remote state change 1498802456 (primary_nodes=0) Mar 17 01:54:26 offine-stand-stor-0 [ 131.023510] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478: susp-io( quorum -> no ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.023513] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.023514] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478/0 drbd1082: quorum( no -> yes ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.023522] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478/0 drbd1082 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.027431] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-3: Preparing remote state change 3054540403 Mar 17 01:54:26 offine-stand-stor-0 [ 131.041050] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-1: Committing remote state change 952197283 (primary_nodes=0) Mar 17 01:54:26 offine-stand-stor-0 [ 131.042701] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.044842] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.095616] drbd pvc-21bf321c-a2a5-4e0f-bda3-e606d739a423/0 drbd1015 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.097861] drbd pvc-232caf0f-7640-4363-afde-4952e28deb5f/0 drbd1099 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.098601] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:26 offine-stand-stor-0 [ 131.099465] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d: Starting worker thread (from drbdsetup [9809]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.101424] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af: Preparing cluster-wide state change 2330425591 (0->2 499/146) Mar 17 01:54:26 offine-stand-stor-0 [ 131.108726] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-2: Starting sender thread (from drbdsetup [9814]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.124672] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:26 offine-stand-stor-0 [ 131.128628] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-3: Starting sender thread (from drbdsetup [9817]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.129125] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:26 offine-stand-stor-0 [ 131.144939] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073: meta-data IO uses: blk-bio Mar 17 01:54:26 offine-stand-stor-0 [ 131.148519] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478/0 drbd1082 offline-stand-stor-3: my exposed UUID: E64EA4A94BEC3370 Mar 17 01:54:26 offine-stand-stor-0 [ 131.151456] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d: susp-io( no -> quorum ) [attach] Mar 17 01:54:26 offine-stand-stor-0 [ 131.151730] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478/0 drbd1082 offline-stand-stor-3: peer E64EA4A94BEC3370:0000000000000000:8D0D29CA2DDCDB58:0000000000000000 bits:0 flags:1120 Mar 17 01:54:26 offine-stand-stor-0 [ 131.152989] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:26 offine-stand-stor-0 [ 131.153040] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073: Maximum number of peer devices = 7 Mar 17 01:54:26 offine-stand-stor-0 [ 131.158208] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-3: Committing remote state change 3054540403 (primary_nodes=0) Mar 17 01:54:26 offine-stand-stor-0 [ 131.159700] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:26 offine-stand-stor-0 [ 131.160599] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d: Method to ensure write ordering: flush Mar 17 01:54:26 offine-stand-stor-0 [ 131.160635] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:26 offine-stand-stor-0 [ 131.160638] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:26 offine-stand-stor-0 [ 131.161179] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:26 offine-stand-stor-0 [ 131.161512] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.161949] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:26 offine-stand-stor-0 [ 131.161958] drbd1073: detected capacity change from 0 to 10491632 Mar 17 01:54:26 offine-stand-stor-0 [ 131.161960] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073: size = 5123 MB (5245816 KB) Mar 17 01:54:26 offine-stand-stor-0 [ 131.184836] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028 offline-stand-stor-3: self 8AD22D573BCFBF56:D24F682CE1163FF9:0000000000000000:0000000000000000 bits:0 flags:0 Mar 17 01:54:26 offine-stand-stor-0 [ 131.186469] drbd pvc-2ac846b6-58d7-434b-981e-330efabf9478/0 drbd1082 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.186982] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073: recounting of set bits took additional 0ms Mar 17 01:54:26 offine-stand-stor-0 [ 131.186993] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:26 offine-stand-stor-0 [ 131.186996] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073: attached to current UUID: 771B146CAE188BB0 Mar 17 01:54:26 offine-stand-stor-0 [ 131.187001] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073: Setting exposed data uuid: 771B146CAE188BB0 Mar 17 01:54:26 offine-stand-stor-0 [ 131.187731] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028 offline-stand-stor-3: peer's exposed UUID: 8AD22D573BCFBF56 Mar 17 01:54:26 offine-stand-stor-0 [ 131.189016] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:26 offine-stand-stor-0 [ 131.189534] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-335d [9810]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.190420] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-1: Preparing remote state change 3876366300 Mar 17 01:54:26 offine-stand-stor-0 [ 131.190673] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:26 offine-stand-stor-0 [ 131.193481] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af: State change 2330425591: primary_nodes=0, weak_nodes=0 Mar 17 01:54:26 offine-stand-stor-0 [ 131.196630] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-335d [9810]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.196661] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:26 offine-stand-stor-0 [ 131.199541] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af: Committing cluster-wide state change 2330425591 (96ms) Mar 17 01:54:26 offine-stand-stor-0 [ 131.208601] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:26 offine-stand-stor-0 [ 131.209620] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:26 offine-stand-stor-0 [ 131.213531] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:26 offine-stand-stor-0 [ 131.214690] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028 offline-stand-stor-3: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:26 offine-stand-stor-0 [ 131.223941] drbd1112: detected capacity change from 0 to 10491632 Mar 17 01:54:26 offine-stand-stor-0 [ 131.224558] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af: Preparing cluster-wide state change 3202756652 (0->1 499/146) Mar 17 01:54:26 offine-stand-stor-0 [ 131.256247] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186: Starting worker thread (from drbdsetup [9853]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.256601] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43/0 drbd1112: size = 5123 MB (5245816 KB) Mar 17 01:54:26 offine-stand-stor-0 [ 131.265247] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-2: Starting sender thread (from drbdsetup [9858]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.312578] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43/0 drbd1112 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:26 offine-stand-stor-0 [ 131.313599] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:26 offine-stand-stor-0 [ 131.314397] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43/0 drbd1112 offline-stand-stor-1: peer 4D7CB0594659A47E:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:26 offine-stand-stor-0 [ 131.315306] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:26 offine-stand-stor-0 [ 131.316599] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:26 offine-stand-stor-0 [ 131.316602] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:26 offine-stand-stor-0 [ 131.317461] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43/0 drbd1112: Setting exposed data uuid: 4D7CB0594659A47E Mar 17 01:54:26 offine-stand-stor-0 [ 131.318463] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:26 offine-stand-stor-0 [ 131.319460] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-3: Starting sender thread (from drbdsetup [9860]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.320893] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:26 offine-stand-stor-0 [ 131.324675] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:26 offine-stand-stor-0 [ 131.324814] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028 offline-stand-stor-2: self 8AD22D573BCFBF56:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:20 Mar 17 01:54:26 offine-stand-stor-0 [ 131.336353] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-1: Committing remote state change 3876366300 (primary_nodes=0) Mar 17 01:54:26 offine-stand-stor-0 [ 131.336660] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028 offline-stand-stor-2: peer 8AD22D573BCFBF56:0000000000000000:8DA23A8BB9B85DC4:880D606145E46320 bits:0 flags:1120 Mar 17 01:54:26 offine-stand-stor-0 [ 131.336728] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:26 offine-stand-stor-0 [ 131.337987] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43: susp-io( quorum -> no ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.339851] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af: State change 3202756652: primary_nodes=0, weak_nodes=0 Mar 17 01:54:26 offine-stand-stor-0 [ 131.342162] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.342165] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43/0 drbd1112: quorum( no -> yes ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.342168] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43/0 drbd1112 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.343200] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af: Committing cluster-wide state change 3202756652 (116ms) Mar 17 01:54:26 offine-stand-stor-0 [ 131.344275] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-4: Preparing remote state change 829311804 Mar 17 01:54:26 offine-stand-stor-0 [ 131.344630] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046: meta-data IO uses: blk-bio Mar 17 01:54:26 offine-stand-stor-0 [ 131.344761] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186: susp-io( no -> quorum ) [attach] Mar 17 01:54:26 offine-stand-stor-0 [ 131.344764] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:26 offine-stand-stor-0 [ 131.344782] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046: Maximum number of peer devices = 7 Mar 17 01:54:26 offine-stand-stor-0 [ 131.345012] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186: Method to ensure write ordering: flush Mar 17 01:54:26 offine-stand-stor-0 [ 131.345043] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:26 offine-stand-stor-0 [ 131.345579] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af: susp-io( quorum -> no ) [connected] Mar 17 01:54:26 offine-stand-stor-0 [ 131.345790] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:26 offine-stand-stor-0 [ 131.345794] drbd1046: detected capacity change from 0 to 10491632 Mar 17 01:54:26 offine-stand-stor-0 [ 131.345796] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046: size = 5123 MB (5245816 KB) Mar 17 01:54:26 offine-stand-stor-0 [ 131.352652] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046: recounting of set bits took additional 4ms Mar 17 01:54:26 offine-stand-stor-0 [ 131.353327] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:26 offine-stand-stor-0 [ 131.354659] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:26 offine-stand-stor-0 [ 131.354936] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-1: Preparing remote state change 4086758137 Mar 17 01:54:26 offine-stand-stor-0 [ 131.356017] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028: quorum( no -> yes ) [connected] Mar 17 01:54:26 offine-stand-stor-0 [ 131.357624] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046: attached to current UUID: 1061295464AC6E58 Mar 17 01:54:26 offine-stand-stor-0 [ 131.361155] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [connected] Mar 17 01:54:26 offine-stand-stor-0 [ 131.364529] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046: Setting exposed data uuid: 1061295464AC6E58 Mar 17 01:54:26 offine-stand-stor-0 [ 131.366396] drbd pvc-2e785d09-16e1-49ca-9fbb-368d755cb7af/0 drbd1028 offline-stand-stor-2: cleared bm UUID and bitmap 8AD22D573BCFBF56:0000000000000000:0000000000000000:0000000000000000 Mar 17 01:54:26 offine-stand-stor-0 [ 131.373552] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:26 offine-stand-stor-0 [ 131.380877] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43/0 drbd1112 offline-stand-stor-4: my exposed UUID: 4D7CB0594659A47E Mar 17 01:54:26 offine-stand-stor-0 [ 131.382800] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-3442 [9854]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.383681] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43/0 drbd1112 offline-stand-stor-4: peer 4D7CB0594659A47E:0000000000000000:2FD289781FEBEA6A:0000000000000000 bits:0 flags:1120 Mar 17 01:54:26 offine-stand-stor-0 [ 131.383706] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:26 offine-stand-stor-0 [ 131.386217] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:26 offine-stand-stor-0 [ 131.386236] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-3442 [9854]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.405124] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-4: Committing remote state change 829311804 (primary_nodes=0) Mar 17 01:54:26 offine-stand-stor-0 [ 131.406638] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:26 offine-stand-stor-0 [ 131.408591] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.412565] drbd1127: detected capacity change from 0 to 10491632 Mar 17 01:54:26 offine-stand-stor-0 [ 131.413415] drbd pvc-2ebbd071-39cb-4462-b5d2-fb9b4dbbee43/0 drbd1112 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.415506] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a/0 drbd1127: size = 5123 MB (5245816 KB) Mar 17 01:54:26 offine-stand-stor-0 [ 131.493391] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a/0 drbd1127 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:26 offine-stand-stor-0 [ 131.494705] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a/0 drbd1127 offline-stand-stor-1: peer 145056049350F8DE:0000000000000000:18A66C22BCC2A970:0000000000000000 bits:0 flags:1120 Mar 17 01:54:26 offine-stand-stor-0 [ 131.497040] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a/0 drbd1127: Setting exposed data uuid: 145056049350F8DE Mar 17 01:54:26 offine-stand-stor-0 [ 131.501555] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-1: Committing remote state change 4086758137 (primary_nodes=0) Mar 17 01:54:26 offine-stand-stor-0 [ 131.503831] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a: susp-io( quorum -> no ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.504939] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.507089] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a/0 drbd1127: quorum( no -> yes ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.508281] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a/0 drbd1127 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.512086] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-2: Preparing remote state change 1574307987 Mar 17 01:54:26 offine-stand-stor-0 [ 131.538642] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d: Starting worker thread (from drbdsetup [9895]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.544720] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:26 offine-stand-stor-0 [ 131.545276] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-2: Starting sender thread (from drbdsetup [9900]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.547956] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:26 offine-stand-stor-0 [ 131.553033] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-3: Starting sender thread (from drbdsetup [9902]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.554309] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-3: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:26 offine-stand-stor-0 [ 131.559204] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:26 offine-stand-stor-0 [ 131.563420] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a/0 drbd1127 offline-stand-stor-2: my exposed UUID: 145056049350F8DE Mar 17 01:54:26 offine-stand-stor-0 [ 131.567515] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:26 offine-stand-stor-0 [ 131.580039] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034: meta-data IO uses: blk-bio Mar 17 01:54:26 offine-stand-stor-0 [ 131.589940] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d: susp-io( no -> quorum ) [attach] Mar 17 01:54:26 offine-stand-stor-0 [ 131.589944] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:26 offine-stand-stor-0 [ 131.589960] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034: Maximum number of peer devices = 7 Mar 17 01:54:26 offine-stand-stor-0 [ 131.590218] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d: Method to ensure write ordering: flush Mar 17 01:54:26 offine-stand-stor-0 [ 131.590243] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:26 offine-stand-stor-0 [ 131.591072] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:26 offine-stand-stor-0 [ 131.591102] drbd1034: detected capacity change from 0 to 10491632 Mar 17 01:54:26 offine-stand-stor-0 [ 131.591103] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034: size = 5123 MB (5245816 KB) Mar 17 01:54:26 offine-stand-stor-0 [ 131.595607] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a/0 drbd1127 offline-stand-stor-2: peer 145056049350F8DE:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:26 offine-stand-stor-0 [ 131.600164] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:26 offine-stand-stor-0 [ 131.613918] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034: recounting of set bits took additional 0ms Mar 17 01:54:26 offine-stand-stor-0 [ 131.613936] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:26 offine-stand-stor-0 [ 131.613939] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034: attached to current UUID: AC0CF9E913B9720E Mar 17 01:54:26 offine-stand-stor-0 [ 131.613943] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034: Setting exposed data uuid: AC0CF9E913B9720E Mar 17 01:54:26 offine-stand-stor-0 [ 131.617723] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:26 offine-stand-stor-0 [ 131.619342] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-1: Preparing remote state change 811571158 Mar 17 01:54:26 offine-stand-stor-0 [ 131.622593] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:26 offine-stand-stor-0 [ 131.648270] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-3514 [9896]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.648396] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-2: Committing remote state change 1574307987 (primary_nodes=0) Mar 17 01:54:26 offine-stand-stor-0 [ 131.650863] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-3514 [9896]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.653228] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.655390] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:26 offine-stand-stor-0 [ 131.657187] drbd pvc-2f3ea1db-b10c-436a-9084-a35085bd0e5a/0 drbd1127 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.659824] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:26 offine-stand-stor-0 [ 131.713260] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: Starting worker thread (from drbdsetup [9935]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.724580] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-1: drbd_sync_handshake: Mar 17 01:54:26 offine-stand-stor-0 [ 131.725918] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-1: self 96BFB5C059A0C94E:0000000000000000:E5B5A72B4D364D1E:A22571138AE395F6 bits:0 flags:20 Mar 17 01:54:26 offine-stand-stor-0 [ 131.728436] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-1: peer DBC41CCF4A24FB55:96BFB5C059A0C94F:35B37D0825E04256:D1EC5F43761429A4 bits:865 flags:1120 Mar 17 01:54:26 offine-stand-stor-0 [ 131.730120] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:26 offine-stand-stor-0 [ 131.731113] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-1: uuid_compare()=target-use-bitmap by rule=bitmap-peer Mar 17 01:54:26 offine-stand-stor-0 [ 131.733199] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Starting sender thread (from drbdsetup [9940]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.769458] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:26 offine-stand-stor-0 [ 131.771938] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-1: Committing remote state change 811571158 (primary_nodes=1) Mar 17 01:54:26 offine-stand-stor-0 [ 131.772920] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Starting sender thread (from drbdsetup [9944]) Mar 17 01:54:26 offine-stand-stor-0 [ 131.820510] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:26 offine-stand-stor-0 [ 131.821072] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-3: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:26 offine-stand-stor-0 [ 131.821074] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:26 offine-stand-stor-0 [ 131.822153] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00: susp-io( quorum -> no ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.822480] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:26 offine-stand-stor-0 [ 131.828576] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d: Preparing cluster-wide state change 1951291196 (1->2 499/146) Mar 17 01:54:26 offine-stand-stor-0 [ 131.828662] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Primary ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.837008] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017: disk( UpToDate -> Outdated ) quorum( no -> yes ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.838832] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> WFBitMapT ) [remote] Mar 17 01:54:26 offine-stand-stor-0 [ 131.840860] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017: Setting exposed data uuid: DBC41CCF4A24FB54 Mar 17 01:54:26 offine-stand-stor-0 [ 131.843026] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00: Preparing cluster-wide state change 2937694490 (1->2 499/146) Mar 17 01:54:26 offine-stand-stor-0 [ 131.849575] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-1: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 35(1), total 35; compression: 100.0% Mar 17 01:54:26 offine-stand-stor-0 [ 131.850306] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: meta-data IO uses: blk-bio Mar 17 01:54:26 offine-stand-stor-0 [ 131.852605] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-1: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 35(1), total 35; compression: 100.0% Mar 17 01:54:26 offine-stand-stor-0 [ 131.855907] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: susp-io( no -> quorum ) [attach] Mar 17 01:54:26 offine-stand-stor-0 [ 131.857277] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:26 offine-stand-stor-0 [ 131.858522] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: Maximum number of peer devices = 7 Mar 17 01:54:26 offine-stand-stor-0 [ 131.860346] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: Method to ensure write ordering: flush Mar 17 01:54:26 offine-stand-stor-0 [ 131.861710] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:26 offine-stand-stor-0 [ 131.863230] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:26 offine-stand-stor-0 [ 131.864286] drbd1121: detected capacity change from 0 to 10491632 Mar 17 01:54:26 offine-stand-stor-0 [ 131.865282] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: size = 5123 MB (5245816 KB) Mar 17 01:54:26 offine-stand-stor-0 [ 131.878838] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: recounting of set bits took additional 0ms Mar 17 01:54:26 offine-stand-stor-0 [ 131.880205] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:27 offine-stand-stor-0 [ 131.881324] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: attached to current UUID: C87B173B63750456 Mar 17 01:54:27 offine-stand-stor-0 [ 131.882341] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: Setting exposed data uuid: C87B173B63750456 Mar 17 01:54:27 offine-stand-stor-0 [ 131.884559] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073 offline-stand-stor-3: self 771B146CAE188BB0:2293404B565DF0C4:9E1DC0BA9B0B1DB2:0000000000000000 bits:0 flags:0 Mar 17 01:54:27 offine-stand-stor-0 [ 131.885958] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 131.887577] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073 offline-stand-stor-3: peer's exposed UUID: 771B146CAE188BB0 Mar 17 01:54:27 offine-stand-stor-0 [ 131.889183] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-35ed [9936]) Mar 17 01:54:27 offine-stand-stor-0 [ 131.889771] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 131.891245] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d: State change 1951291196: primary_nodes=0, weak_nodes=0 Mar 17 01:54:27 offine-stand-stor-0 [ 131.893434] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 131.893459] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-35ed [9936]) Mar 17 01:54:27 offine-stand-stor-0 [ 131.894885] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d: Committing cluster-wide state change 1951291196 (64ms) Mar 17 01:54:27 offine-stand-stor-0 [ 131.896321] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 131.898428] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:27 offine-stand-stor-0 [ 131.902304] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:27 offine-stand-stor-0 [ 131.904383] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073 offline-stand-stor-3: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:27 offine-stand-stor-0 [ 131.911476] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:27 offine-stand-stor-0 [ 131.913411] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-3: self 96BFB5C059A0C94E:398C129CAB5A4FB2:E5B5A72B4D364D1E:A22571138AE395F6 bits:0 flags:0 Mar 17 01:54:27 offine-stand-stor-0 [ 131.915315] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-3: peer's exposed UUID: DBC41CCF4A24FB54 Mar 17 01:54:27 offine-stand-stor-0 [ 131.917558] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00: State change 2937694490: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFF8 Mar 17 01:54:27 offine-stand-stor-0 [ 131.919591] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00: Committing cluster-wide state change 2937694490 (76ms) Mar 17 01:54:27 offine-stand-stor-0 [ 131.920664] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:27 offine-stand-stor-0 [ 131.922996] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-3: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:27 offine-stand-stor-0 [ 131.932941] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-3: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:27 offine-stand-stor-0 [ 131.933874] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-2: Preparing remote state change 3729897418 Mar 17 01:54:27 offine-stand-stor-0 [ 131.935930] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:27 offine-stand-stor-0 [ 131.937575] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:27 offine-stand-stor-0 [ 131.944566] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186: Preparing cluster-wide state change 3819785348 (1->2 499/146) Mar 17 01:54:27 offine-stand-stor-0 [ 131.956327] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5: Starting worker thread (from drbdsetup [9980]) Mar 17 01:54:27 offine-stand-stor-0 [ 131.959890] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:27 offine-stand-stor-0 [ 131.970282] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-2: Starting sender thread (from drbdsetup [9986]) Mar 17 01:54:27 offine-stand-stor-0 [ 131.974784] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-3: Starting sender thread (from drbdsetup [9988]) Mar 17 01:54:27 offine-stand-stor-0 [ 131.976801] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:27 offine-stand-stor-0 [ 131.979687] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073 offline-stand-stor-2: self 771B146CAE188BB0:0000000000000000:9E1DC0BA9B0B1DB2:0000000000000000 bits:0 flags:20 Mar 17 01:54:27 offine-stand-stor-0 [ 131.982210] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073 offline-stand-stor-2: peer 771B146CAE188BB0:0000000000000000:CA937C346A3B31C6:7F67845BC7E70C68 bits:0 flags:1120 Mar 17 01:54:27 offine-stand-stor-0 [ 131.985194] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:27 offine-stand-stor-0 [ 131.988637] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046 offline-stand-stor-3: self 1061295464AC6E58:0000000000000000:F40A97AF5546DAAC:0000000000000000 bits:0 flags:0 Mar 17 01:54:27 offine-stand-stor-0 [ 131.991937] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046 offline-stand-stor-3: peer's exposed UUID: 1061295464AC6E58 Mar 17 01:54:27 offine-stand-stor-0 [ 131.992135] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-2: Committing remote state change 3729897418 (primary_nodes=0) Mar 17 01:54:27 offine-stand-stor-0 [ 132.000420] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d: susp-io( quorum -> no ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.002773] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.007225] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073: quorum( no -> yes ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.009327] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.013610] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037: meta-data IO uses: blk-bio Mar 17 01:54:27 offine-stand-stor-0 [ 132.013675] drbd pvc-335d38d8-f830-448b-b86a-eb5c50011f8d/0 drbd1073 offline-stand-stor-2: cleared bm UUID and bitmap 771B146CAE188BB0:0000000000000000:9E1DC0BA9B0B1DB2:0000000000000000 Mar 17 01:54:27 offine-stand-stor-0 [ 132.015611] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5: susp-io( no -> quorum ) [attach] Mar 17 01:54:27 offine-stand-stor-0 [ 132.020486] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:27 offine-stand-stor-0 [ 132.022070] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037: Maximum number of peer devices = 7 Mar 17 01:54:27 offine-stand-stor-0 [ 132.024031] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5: Method to ensure write ordering: flush Mar 17 01:54:27 offine-stand-stor-0 [ 132.025285] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:27 offine-stand-stor-0 [ 132.027457] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:27 offine-stand-stor-0 [ 132.029297] drbd1037: detected capacity change from 0 to 10491632 Mar 17 01:54:27 offine-stand-stor-0 [ 132.030467] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037: size = 5123 MB (5245816 KB) Mar 17 01:54:27 offine-stand-stor-0 [ 132.036967] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186: State change 3819785348: primary_nodes=0, weak_nodes=0 Mar 17 01:54:27 offine-stand-stor-0 [ 132.038031] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186: Committing cluster-wide state change 3819785348 (92ms) Mar 17 01:54:27 offine-stand-stor-0 [ 132.039077] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:27 offine-stand-stor-0 [ 132.042023] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046 offline-stand-stor-3: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:27 offine-stand-stor-0 [ 132.048817] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037: recounting of set bits took additional 4ms Mar 17 01:54:27 offine-stand-stor-0 [ 132.050329] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:27 offine-stand-stor-0 [ 132.051435] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037: attached to current UUID: 1E7B95B89CF2A5F2 Mar 17 01:54:27 offine-stand-stor-0 [ 132.052413] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037: Setting exposed data uuid: 1E7B95B89CF2A5F2 Mar 17 01:54:27 offine-stand-stor-0 [ 132.054709] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-2: Preparing remote state change 541590944 Mar 17 01:54:27 offine-stand-stor-0 [ 132.056003] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.057990] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-379f [9981]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.059084] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.061395] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-379f [9981]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.061430] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.065256] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017: disk( Outdated -> Inconsistent ) [postponed-resync] Mar 17 01:54:27 offine-stand-stor-0 [ 132.066695] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-3: resync-susp( no -> connection dependency ) [postponed-resync] Mar 17 01:54:27 offine-stand-stor-0 [ 132.069755] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-1: repl( WFBitMapT -> SyncTarget ) [postponed-resync] Mar 17 01:54:27 offine-stand-stor-0 [ 132.072977] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.073377] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-1: Began resync as SyncTarget (will sync 3460 KB [865 bits set]). Mar 17 01:54:27 offine-stand-stor-0 [ 132.092656] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:27 offine-stand-stor-0 [ 132.093842] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046 offline-stand-stor-2: self 1061295464AC6E58:0000000000000000:F40A97AF5546DAAC:0000000000000000 bits:0 flags:20 Mar 17 01:54:27 offine-stand-stor-0 [ 132.095904] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046 offline-stand-stor-2: peer 1061295464AC6E58:0000000000000000:1BEBD14F1E49B978:1240FDBF90E119C8 bits:0 flags:1120 Mar 17 01:54:27 offine-stand-stor-0 [ 132.098237] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:27 offine-stand-stor-0 [ 132.113930] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-2: Committing remote state change 541590944 (primary_nodes=0) Mar 17 01:54:27 offine-stand-stor-0 [ 132.115925] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e: Starting worker thread (from drbdsetup [10013]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.116145] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186: susp-io( quorum -> no ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.118925] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.120579] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-1: Resync done (total 1 sec; paused 0 sec; 3460 K/sec) Mar 17 01:54:27 offine-stand-stor-0 [ 132.121030] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046: quorum( no -> yes ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.122875] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-1: updated UUIDs DBC41CCF4A24FB54:0000000000000000:E5B5A72B4D364D1E:A22571138AE395F6 Mar 17 01:54:27 offine-stand-stor-0 [ 132.124046] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.126092] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017: disk( Inconsistent -> UpToDate ) [resync-finished] Mar 17 01:54:27 offine-stand-stor-0 [ 132.128258] drbd pvc-3442a91a-0802-420a-b796-41c05e71f186/0 drbd1046 offline-stand-stor-2: cleared bm UUID and bitmap 1061295464AC6E58:0000000000000000:F40A97AF5546DAAC:0000000000000000 Mar 17 01:54:27 offine-stand-stor-0 [ 132.129820] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-3: resync-susp( connection dependency -> no ) [resync-finished] Mar 17 01:54:27 offine-stand-stor-0 [ 132.129825] drbd pvc-32f4834d-be61-4b1c-a0e8-ca16a43f5a00/0 drbd1017 offline-stand-stor-1: repl( SyncTarget -> Established ) [resync-finished] Mar 17 01:54:27 offine-stand-stor-0 [ 132.139772] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-2: Starting sender thread (from drbdsetup [10018]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.145679] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-3: Starting sender thread (from drbdsetup [10020]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.161362] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e: susp-io( no -> quorum ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.162491] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.163839] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-38cf [10014]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.165742] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.167780] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.167801] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-38cf [10014]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.173102] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.189463] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0: Starting worker thread (from drbdsetup [10035]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.193898] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:27 offine-stand-stor-0 [ 132.196899] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:27 offine-stand-stor-0 [ 132.201556] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-3: Starting sender thread (from drbdsetup [10040]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.205431] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-4: Starting sender thread (from drbdsetup [10042]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.212029] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0: susp-io( no -> quorum ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.213279] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.214956] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-38ed [10036]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.216462] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.225305] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:27 offine-stand-stor-0 [ 132.248694] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-3: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:27 offine-stand-stor-0 [ 132.248716] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:27 offine-stand-stor-0 [ 132.251852] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-2: Preparing remote state change 1816150974 Mar 17 01:54:27 offine-stand-stor-0 [ 132.252794] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-38ed [10036]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.252847] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.274768] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc: Starting worker thread (from drbdsetup [10057]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.279234] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:27 offine-stand-stor-0 [ 132.303131] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.315335] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-2: Starting sender thread (from drbdsetup [10064]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.325942] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-3: Starting sender thread (from drbdsetup [10066]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.334253] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc: susp-io( no -> quorum ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.335459] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.336792] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-3bb5 [10060]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.338535] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.340547] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.340577] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-3bb5 [10060]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.347216] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.350774] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:27 offine-stand-stor-0 [ 132.352068] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034 offline-stand-stor-2: self AC0CF9E913B9720E:0000000000000000:F345B12CB157938A:0000000000000000 bits:0 flags:20 Mar 17 01:54:27 offine-stand-stor-0 [ 132.353838] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034 offline-stand-stor-2: peer AC0CF9E913B9720E:0000000000000000:9B25A4E637743DEE:056511F18A54123E bits:0 flags:1120 Mar 17 01:54:27 offine-stand-stor-0 [ 132.355571] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:27 offine-stand-stor-0 [ 132.374007] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-2: Committing remote state change 1816150974 (primary_nodes=0) Mar 17 01:54:27 offine-stand-stor-0 [ 132.375690] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d: susp-io( quorum -> no ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.376572] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.378614] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034: quorum( no -> yes ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.379505] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.381306] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034 offline-stand-stor-2: cleared bm UUID and bitmap AC0CF9E913B9720E:0000000000000000:F345B12CB157938A:0000000000000000 Mar 17 01:54:27 offine-stand-stor-0 [ 132.383213] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d: Preparing cluster-wide state change 2743904927 (1->2 499/146) Mar 17 01:54:27 offine-stand-stor-0 [ 132.386766] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa: Starting worker thread (from drbdsetup [10089]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.392874] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-2: Starting sender thread (from drbdsetup [10094]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.397030] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-3: Starting sender thread (from drbdsetup [10096]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.413467] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011: meta-data IO uses: blk-bio Mar 17 01:54:27 offine-stand-stor-0 [ 132.415031] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa: susp-io( no -> quorum ) [attach] Mar 17 01:54:27 offine-stand-stor-0 [ 132.416192] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:27 offine-stand-stor-0 [ 132.417286] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011: Maximum number of peer devices = 7 Mar 17 01:54:27 offine-stand-stor-0 [ 132.418913] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa: Method to ensure write ordering: flush Mar 17 01:54:27 offine-stand-stor-0 [ 132.419915] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:27 offine-stand-stor-0 [ 132.421361] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:27 offine-stand-stor-0 [ 132.422291] drbd1011: detected capacity change from 0 to 10491632 Mar 17 01:54:27 offine-stand-stor-0 [ 132.423405] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011: size = 5123 MB (5245816 KB) Mar 17 01:54:27 offine-stand-stor-0 [ 132.425084] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:27 offine-stand-stor-0 [ 132.430509] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011: recounting of set bits took additional 0ms Mar 17 01:54:27 offine-stand-stor-0 [ 132.434233] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034 offline-stand-stor-3: self AC0CF9E913B9720E:0000000000000000:F345B12CB157938A:0000000000000000 bits:0 flags:0 Mar 17 01:54:27 offine-stand-stor-0 [ 132.434237] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034 offline-stand-stor-3: peer's exposed UUID: AC0CF9E913B9720E Mar 17 01:54:27 offine-stand-stor-0 [ 132.434244] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d: State change 2743904927: primary_nodes=0, weak_nodes=0 Mar 17 01:54:27 offine-stand-stor-0 [ 132.434247] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d: Committing cluster-wide state change 2743904927 (52ms) Mar 17 01:54:27 offine-stand-stor-0 [ 132.434294] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:27 offine-stand-stor-0 [ 132.434297] drbd pvc-351468e5-cc86-4626-91d1-dc7895a99e5d/0 drbd1034 offline-stand-stor-3: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:27 offine-stand-stor-0 [ 132.436641] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:27 offine-stand-stor-0 [ 132.436644] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:27 offine-stand-stor-0 [ 132.440109] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:27 offine-stand-stor-0 [ 132.467769] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:27 offine-stand-stor-0 [ 132.468878] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:27 offine-stand-stor-0 [ 132.468886] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011: attached to current UUID: C154CE3D3D869BF4 Mar 17 01:54:27 offine-stand-stor-0 [ 132.468891] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011: Setting exposed data uuid: C154CE3D3D869BF4 Mar 17 01:54:27 offine-stand-stor-0 [ 132.471176] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.472406] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-3d40 [10090]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.472839] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.499341] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915: Starting worker thread (from drbdsetup [10120]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.503337] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-1: Starting sender thread (from drbdsetup [10125]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.507869] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-4: Starting sender thread (from drbdsetup [10127]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.513726] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915: susp-io( no -> quorum ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.513729] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.513771] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-406d [10121]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.513842] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.514908] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.514969] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-406d [10121]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.524544] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.525969] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Preparing remote state change 1443164792 Mar 17 01:54:27 offine-stand-stor-0 [ 132.526140] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-3d40 [10090]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.526187] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.528192] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.530993] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:27 offine-stand-stor-0 [ 132.600635] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:27 offine-stand-stor-0 [ 132.600673] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:27 offine-stand-stor-0 [ 132.600967] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121 offline-stand-stor-4: drbd_sync_handshake: Mar 17 01:54:27 offine-stand-stor-0 [ 132.600970] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121 offline-stand-stor-4: self C87B173B63750456:0000000000000000:D71276FDDA4AF860:0000000000000000 bits:0 flags:20 Mar 17 01:54:27 offine-stand-stor-0 [ 132.600979] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121 offline-stand-stor-4: peer C87B173B63750456:0000000000000000:FB73D091075B51BE:CC16AA7A513322E0 bits:0 flags:1120 Mar 17 01:54:27 offine-stand-stor-0 [ 132.600983] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121 offline-stand-stor-4: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:27 offine-stand-stor-0 [ 132.603467] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:27 offine-stand-stor-0 [ 132.606290] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:27 offine-stand-stor-0 [ 132.609304] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Committing remote state change 1443164792 (primary_nodes=0) Mar 17 01:54:27 offine-stand-stor-0 [ 132.622805] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: susp-io( quorum -> no ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.623909] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.626560] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: quorum( no -> yes ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.627732] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.630551] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121 offline-stand-stor-4: cleared bm UUID and bitmap C87B173B63750456:0000000000000000:D71276FDDA4AF860:0000000000000000 Mar 17 01:54:27 offine-stand-stor-0 [ 132.631637] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:27 offine-stand-stor-0 [ 132.634396] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: Preparing cluster-wide state change 1208816473 (1->2 499/146) Mar 17 01:54:27 offine-stand-stor-0 [ 132.634420] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:27 offine-stand-stor-0 [ 132.640564] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5: Preparing cluster-wide state change 3001071726 (1->2 499/146) Mar 17 01:54:27 offine-stand-stor-0 [ 132.668764] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e: Starting worker thread (from drbdsetup [10147]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.676572] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037 offline-stand-stor-2: self 1E7B95B89CF2A5F2:50F7CFEAF080BF6E:74AEF42E0020D3CE:0000000000000000 bits:0 flags:0 Mar 17 01:54:27 offine-stand-stor-0 [ 132.676583] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121 offline-stand-stor-1: self C87B173B63750456:0000000000000000:D71276FDDA4AF860:0000000000000000 bits:0 flags:0 Mar 17 01:54:27 offine-stand-stor-0 [ 132.678788] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037 offline-stand-stor-2: peer's exposed UUID: 1E7B95B89CF2A5F2 Mar 17 01:54:27 offine-stand-stor-0 [ 132.681841] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5: State change 3001071726: primary_nodes=0, weak_nodes=0 Mar 17 01:54:27 offine-stand-stor-0 [ 132.682987] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121 offline-stand-stor-1: peer's exposed UUID: C87B173B63750456 Mar 17 01:54:27 offine-stand-stor-0 [ 132.684201] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5: Committing cluster-wide state change 3001071726 (40ms) Mar 17 01:54:27 offine-stand-stor-0 [ 132.686992] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: State change 1208816473: primary_nodes=0, weak_nodes=0 Mar 17 01:54:27 offine-stand-stor-0 [ 132.687003] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: Committing cluster-wide state change 1208816473 (52ms) Mar 17 01:54:27 offine-stand-stor-0 [ 132.687069] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:27 offine-stand-stor-0 [ 132.688656] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:27 offine-stand-stor-0 [ 132.690454] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121 offline-stand-stor-1: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:27 offine-stand-stor-0 [ 132.691472] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:27 offine-stand-stor-0 [ 132.705812] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-3: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:27 offine-stand-stor-0 [ 132.705919] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:27 offine-stand-stor-0 [ 132.707446] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-3: Preparing remote state change 1414498523 Mar 17 01:54:27 offine-stand-stor-0 [ 132.708737] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:27 offine-stand-stor-0 [ 132.708784] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-1: Starting sender thread (from drbdsetup [10152]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.711541] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:27 offine-stand-stor-0 [ 132.718596] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:27 offine-stand-stor-0 [ 132.719850] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:27 offine-stand-stor-0 [ 132.723884] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-3: Starting sender thread (from drbdsetup [10154]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.727242] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-2: Preparing remote state change 3013643400 Mar 17 01:54:27 offine-stand-stor-0 [ 132.730000] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-3: Rejecting concurrent remote state change 984175903 because of state change 3013643400 Mar 17 01:54:27 offine-stand-stor-0 [ 132.732758] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e: susp-io( no -> quorum ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.733901] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.736187] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.736643] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-40ac [10148]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.755732] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-40ac [10148]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.755766] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.757019] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30: Starting worker thread (from drbdsetup [10170]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.761013] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-1: Starting sender thread (from drbdsetup [10176]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.766221] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:27 offine-stand-stor-0 [ 132.768532] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037 offline-stand-stor-3: self 1E7B95B89CF2A5F2:0000000000000000:74AEF42E0020D3CE:0000000000000000 bits:0 flags:20 Mar 17 01:54:27 offine-stand-stor-0 [ 132.769007] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-3: Starting sender thread (from drbdsetup [10178]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.770706] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037 offline-stand-stor-3: peer 1E7B95B89CF2A5F2:0000000000000000:50F7CFEAF080BF6E:9D3D2C15E415E90A bits:0 flags:1120 Mar 17 01:54:27 offine-stand-stor-0 [ 132.774340] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.774994] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:27 offine-stand-stor-0 [ 132.776389] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30: susp-io( no -> quorum ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.776398] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.776430] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-414f [10171]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.777901] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.784588] drbd1069: detected capacity change from 0 to 10491632 Mar 17 01:54:27 offine-stand-stor-0 [ 132.784913] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.784939] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-414f [10171]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.785428] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-3: Committing remote state change 1414498523 (primary_nodes=0) Mar 17 01:54:27 offine-stand-stor-0 [ 132.785442] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5: susp-io( quorum -> no ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.785445] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.785447] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037: quorum( no -> yes ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.785449] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:27 offine-stand-stor-0 [ 132.785555] drbd pvc-379f71e5-a73f-491d-be54-ea6595076ec5/0 drbd1037 offline-stand-stor-3: cleared bm UUID and bitmap 1E7B95B89CF2A5F2:0000000000000000:74AEF42E0020D3CE:0000000000000000 Mar 17 01:54:27 offine-stand-stor-0 [ 132.786807] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e/0 drbd1069: size = 5123 MB (5245816 KB) Mar 17 01:54:27 offine-stand-stor-0 [ 132.790648] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.793041] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e/0 drbd1069 offline-stand-stor-2: my exposed UUID: 0000000000000000 Mar 17 01:54:27 offine-stand-stor-0 [ 132.809835] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e/0 drbd1069 offline-stand-stor-2: peer FF996E427762E6D0:0000000000000000:4BB222809E83B33A:0000000000000000 bits:0 flags:1120 Mar 17 01:54:27 offine-stand-stor-0 [ 132.811794] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800: Starting worker thread (from drbdsetup [10193]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.812048] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e/0 drbd1069: Setting exposed data uuid: FF996E427762E6D0 Mar 17 01:54:27 offine-stand-stor-0 [ 132.814938] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e/0 drbd1069 offline-stand-stor-3: my exposed UUID: FF996E427762E6D0 Mar 17 01:54:27 offine-stand-stor-0 [ 132.816198] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e/0 drbd1069 offline-stand-stor-3: peer FF996E427762E6D0:0000000000000000:91EF264BE04F6168:0000000000000000 bits:0 flags:1120 Mar 17 01:54:27 offine-stand-stor-0 [ 132.817570] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-2: Starting sender thread (from drbdsetup [10198]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.824060] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-3: Starting sender thread (from drbdsetup [10200]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.825575] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:27 offine-stand-stor-0 [ 132.829204] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:27 offine-stand-stor-0 [ 132.830833] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800: susp-io( no -> quorum ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.832473] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.833831] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-435e [10194]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.835141] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:27 offine-stand-stor-0 [ 132.837457] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.837477] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-435e [10194]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.842620] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:27 offine-stand-stor-0 [ 132.846725] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:27 offine-stand-stor-0 [ 132.853605] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:27 offine-stand-stor-0 [ 132.855943] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:27 offine-stand-stor-0 [ 132.856682] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:27 offine-stand-stor-0 [ 132.858599] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:27 offine-stand-stor-0 [ 132.860455] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:27 offine-stand-stor-0 [ 132.861937] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:27 offine-stand-stor-0 [ 132.864217] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-3: Preparing remote state change 2891576212 Mar 17 01:54:27 offine-stand-stor-0 [ 132.867570] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:27 offine-stand-stor-0 [ 132.874440] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d: Starting worker thread (from drbdsetup [10224]) Mar 17 01:54:27 offine-stand-stor-0 [ 132.876760] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 132.880560] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-2: Starting sender thread (from drbdsetup [10231]) Mar 17 01:54:28 offine-stand-stor-0 [ 132.882699] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-3: Preparing remote state change 3774945051 Mar 17 01:54:28 offine-stand-stor-0 [ 132.885448] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 132.886906] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-4: Starting sender thread (from drbdsetup [10233]) Mar 17 01:54:28 offine-stand-stor-0 [ 132.923420] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022: meta-data IO uses: blk-bio Mar 17 01:54:28 offine-stand-stor-0 [ 132.925052] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d: susp-io( no -> quorum ) [attach] Mar 17 01:54:28 offine-stand-stor-0 [ 132.926261] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:28 offine-stand-stor-0 [ 132.927353] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022: Maximum number of peer devices = 7 Mar 17 01:54:28 offine-stand-stor-0 [ 132.928961] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d: Method to ensure write ordering: flush Mar 17 01:54:28 offine-stand-stor-0 [ 132.930409] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:28 offine-stand-stor-0 [ 132.932231] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:28 offine-stand-stor-0 [ 132.933735] drbd1022: detected capacity change from 0 to 10491632 Mar 17 01:54:28 offine-stand-stor-0 [ 132.935029] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022: size = 5123 MB (5245816 KB) Mar 17 01:54:28 offine-stand-stor-0 [ 132.953172] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022: recounting of set bits took additional 0ms Mar 17 01:54:28 offine-stand-stor-0 [ 132.954242] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:28 offine-stand-stor-0 [ 132.955365] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022: attached to current UUID: F576DD2C3277F7D6 Mar 17 01:54:28 offine-stand-stor-0 [ 132.956213] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022: Setting exposed data uuid: F576DD2C3277F7D6 Mar 17 01:54:28 offine-stand-stor-0 [ 132.959282] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:28 offine-stand-stor-0 [ 132.961099] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-448e [10225]) Mar 17 01:54:28 offine-stand-stor-0 [ 132.962201] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:28 offine-stand-stor-0 [ 132.964187] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-448e [10225]) Mar 17 01:54:28 offine-stand-stor-0 [ 132.964195] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:28 offine-stand-stor-0 [ 132.968808] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:28 offine-stand-stor-0 [ 132.993573] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205: Starting worker thread (from drbdsetup [10258]) Mar 17 01:54:28 offine-stand-stor-0 [ 132.998339] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-1: Starting sender thread (from drbdsetup [10263]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.009613] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-4: Starting sender thread (from drbdsetup [10266]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.016654] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205: susp-io( no -> quorum ) [connect] Mar 17 01:54:28 offine-stand-stor-0 [ 133.017587] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:28 offine-stand-stor-0 [ 133.019069] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-4519 [10259]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.019716] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:28 offine-stand-stor-0 [ 133.044671] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.044678] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.044698] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.044702] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.045635] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-3: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.045637] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.048435] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 133.051517] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 133.056557] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa: Preparing cluster-wide state change 1870401232 (0->1 499/146) Mar 17 01:54:28 offine-stand-stor-0 [ 133.058142] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.058144] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.076884] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 133.077847] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:28 offine-stand-stor-0 [ 133.078629] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-4519 [10259]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.086894] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-1: Preparing remote state change 4202052073 Mar 17 01:54:28 offine-stand-stor-0 [ 133.092487] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 133.094674] drbd1047: detected capacity change from 0 to 10491632 Mar 17 01:54:28 offine-stand-stor-0 [ 133.095766] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc/0 drbd1047: size = 5123 MB (5245816 KB) Mar 17 01:54:28 offine-stand-stor-0 [ 133.096997] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc/0 drbd1047 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:28 offine-stand-stor-0 [ 133.098161] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc/0 drbd1047 offline-stand-stor-3: peer EB727071A50F975A:0000000000000000:E856E64AE6D75696:0000000000000000 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.100005] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc/0 drbd1047: Setting exposed data uuid: EB727071A50F975A Mar 17 01:54:28 offine-stand-stor-0 [ 133.103366] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-3: Committing remote state change 2891576212 (primary_nodes=0) Mar 17 01:54:28 offine-stand-stor-0 [ 133.105579] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc: susp-io( quorum -> no ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.106532] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.108603] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc/0 drbd1047: quorum( no -> yes ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.109622] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc/0 drbd1047 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.111606] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-2: Preparing remote state change 1999141528 Mar 17 01:54:28 offine-stand-stor-0 [ 133.128721] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:28 offine-stand-stor-0 [ 133.164562] drbd1094: detected capacity change from 0 to 10491632 Mar 17 01:54:28 offine-stand-stor-0 [ 133.164677] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:28 offine-stand-stor-0 [ 133.165467] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0/0 drbd1094: size = 5123 MB (5245816 KB) Mar 17 01:54:28 offine-stand-stor-0 [ 133.166310] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011 offline-stand-stor-3: self C154CE3D3D869BF4:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:20 Mar 17 01:54:28 offine-stand-stor-0 [ 133.167194] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0/0 drbd1094 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:28 offine-stand-stor-0 [ 133.168796] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011 offline-stand-stor-3: peer C154CE3D3D869BF4:0000000000000000:3DC10B18839DE6A4:F60BA9B56AE1C530 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.168816] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:28 offine-stand-stor-0 [ 133.169659] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0/0 drbd1094 offline-stand-stor-3: peer 80BC1151473CC0B8:0000000000000000:8EE3A721F7879E3C:0000000000000000 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.171447] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa: State change 1870401232: primary_nodes=0, weak_nodes=0 Mar 17 01:54:28 offine-stand-stor-0 [ 133.173127] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0/0 drbd1094: Setting exposed data uuid: 80BC1151473CC0B8 Mar 17 01:54:28 offine-stand-stor-0 [ 133.173611] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f: Starting worker thread (from drbdsetup [10293]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.175093] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa: Committing cluster-wide state change 1870401232 (116ms) Mar 17 01:54:28 offine-stand-stor-0 [ 133.177257] drbd1098: detected capacity change from 0 to 10491632 Mar 17 01:54:28 offine-stand-stor-0 [ 133.178406] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa: susp-io( quorum -> no ) [connected] Mar 17 01:54:28 offine-stand-stor-0 [ 133.179614] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-1: Starting sender thread (from drbdsetup [10298]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.180441] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915/0 drbd1098: size = 5123 MB (5245816 KB) Mar 17 01:54:28 offine-stand-stor-0 [ 133.181664] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:28 offine-stand-stor-0 [ 133.181666] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011: quorum( no -> yes ) [connected] Mar 17 01:54:28 offine-stand-stor-0 [ 133.181675] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [connected] Mar 17 01:54:28 offine-stand-stor-0 [ 133.183035] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915/0 drbd1098 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:28 offine-stand-stor-0 [ 133.185172] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011 offline-stand-stor-3: cleared bm UUID and bitmap C154CE3D3D869BF4:0000000000000000:0000000000000000:0000000000000000 Mar 17 01:54:28 offine-stand-stor-0 [ 133.186409] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915/0 drbd1098 offline-stand-stor-1: peer 70B52FA077CD0428:0000000000000000:4B9860BC0D302426:0000000000000000 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.186414] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915/0 drbd1098: Setting exposed data uuid: 70B52FA077CD0428 Mar 17 01:54:28 offine-stand-stor-0 [ 133.186606] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-2: Starting sender thread (from drbdsetup [10300]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.188736] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-1: Committing remote state change 4202052073 (primary_nodes=0) Mar 17 01:54:28 offine-stand-stor-0 [ 133.188755] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915: susp-io( quorum -> no ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.188758] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.188761] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915/0 drbd1098: quorum( no -> yes ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.188764] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915/0 drbd1098 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.201812] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-4: Preparing remote state change 2085963769 Mar 17 01:54:28 offine-stand-stor-0 [ 133.203091] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc/0 drbd1047 offline-stand-stor-2: my exposed UUID: EB727071A50F975A Mar 17 01:54:28 offine-stand-stor-0 [ 133.204593] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa: Preparing cluster-wide state change 2849239574 (0->2 499/146) Mar 17 01:54:28 offine-stand-stor-0 [ 133.206112] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc/0 drbd1047 offline-stand-stor-2: peer EB727071A50F975A:0000000000000000:8042470DE7E06AF4:0000000000000000 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.209622] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-3: Committing remote state change 3774945051 (primary_nodes=0) Mar 17 01:54:28 offine-stand-stor-0 [ 133.210196] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-4: Starting sender thread (from drbdsetup [10302]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.211061] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0: susp-io( quorum -> no ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.214397] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-2: Committing remote state change 1999141528 (primary_nodes=0) Mar 17 01:54:28 offine-stand-stor-0 [ 133.216075] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.216078] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0/0 drbd1094: quorum( no -> yes ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.216080] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0/0 drbd1094 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.216109] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-4: Preparing remote state change 2383028423 Mar 17 01:54:28 offine-stand-stor-0 [ 133.230044] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.232685] drbd pvc-3bb57791-2ed1-4051-a5c2-d4dc2f92c4fc/0 drbd1047 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.237144] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915/0 drbd1098 offline-stand-stor-4: my exposed UUID: 70B52FA077CD0428 Mar 17 01:54:28 offine-stand-stor-0 [ 133.239141] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915/0 drbd1098 offline-stand-stor-4: peer 70B52FA077CD0428:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.244236] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003: meta-data IO uses: blk-bio Mar 17 01:54:28 offine-stand-stor-0 [ 133.247319] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f: susp-io( no -> quorum ) [attach] Mar 17 01:54:28 offine-stand-stor-0 [ 133.249162] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:28 offine-stand-stor-0 [ 133.249558] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-2: Committing remote state change 3013643400 (primary_nodes=0) Mar 17 01:54:28 offine-stand-stor-0 [ 133.249816] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0/0 drbd1094 offline-stand-stor-4: my exposed UUID: 80BC1151473CC0B8 Mar 17 01:54:28 offine-stand-stor-0 [ 133.249819] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0/0 drbd1094 offline-stand-stor-4: peer 80BC1151473CC0B8:0000000000000000:B6CC20EEB0BF7F30:0000000000000000 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.250760] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003: Maximum number of peer devices = 7 Mar 17 01:54:28 offine-stand-stor-0 [ 133.253604] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e: susp-io( quorum -> no ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.256604] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011 offline-stand-stor-2: self C154CE3D3D869BF4:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:0 Mar 17 01:54:28 offine-stand-stor-0 [ 133.257601] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.259508] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011 offline-stand-stor-2: peer's exposed UUID: C154CE3D3D869BF4 Mar 17 01:54:28 offine-stand-stor-0 [ 133.261093] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e/0 drbd1069: quorum( no -> yes ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.261097] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e/0 drbd1069 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.261516] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f: Method to ensure write ordering: flush Mar 17 01:54:28 offine-stand-stor-0 [ 133.263748] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa: State change 2849239574: primary_nodes=0, weak_nodes=0 Mar 17 01:54:28 offine-stand-stor-0 [ 133.266777] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-4: Committing remote state change 2383028423 (primary_nodes=0) Mar 17 01:54:28 offine-stand-stor-0 [ 133.266790] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.266834] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-4: Committing remote state change 2085963769 (primary_nodes=0) Mar 17 01:54:28 offine-stand-stor-0 [ 133.266842] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.266845] drbd pvc-406d0c70-6af8-4b9f-8deb-ebb178704915/0 drbd1098 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.266936] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003: drbd_bm_resize called with capacity == 4201520 Mar 17 01:54:28 offine-stand-stor-0 [ 133.267115] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003: resync bitmap: bits=525190 words=57449 pages=113 Mar 17 01:54:28 offine-stand-stor-0 [ 133.267118] drbd1003: detected capacity change from 0 to 4201520 Mar 17 01:54:28 offine-stand-stor-0 [ 133.267120] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003: size = 2052 MB (2100760 KB) Mar 17 01:54:28 offine-stand-stor-0 [ 133.267846] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003: recounting of set bits took additional 0ms Mar 17 01:54:28 offine-stand-stor-0 [ 133.267855] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:28 offine-stand-stor-0 [ 133.267857] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003: attached to current UUID: 943793E333DA1018 Mar 17 01:54:28 offine-stand-stor-0 [ 133.267861] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003: Setting exposed data uuid: 943793E333DA1018 Mar 17 01:54:28 offine-stand-stor-0 [ 133.269015] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa: Committing cluster-wide state change 2849239574 (64ms) Mar 17 01:54:28 offine-stand-stor-0 [ 133.269597] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:28 offine-stand-stor-0 [ 133.269721] drbd pvc-38ed8752-9134-4d53-afbd-da5f49a0e8b0/0 drbd1094 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.270212] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-47c3 [10294]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.270241] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:28 offine-stand-stor-0 [ 133.270758] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:28 offine-stand-stor-0 [ 133.270778] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-47c3 [10294]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.270806] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:28 offine-stand-stor-0 [ 133.271618] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:28 offine-stand-stor-0 [ 133.271637] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-47c3 [10294]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.271710] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:28 offine-stand-stor-0 [ 133.271972] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:28 offine-stand-stor-0 [ 133.289182] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.289859] drbd pvc-3d4014ee-048d-40fb-96fb-544489b322aa/0 drbd1011 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:28 offine-stand-stor-0 [ 133.290803] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.299065] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-3: Preparing remote state change 2093211189 Mar 17 01:54:28 offine-stand-stor-0 [ 133.304621] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.304716] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.306225] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.308243] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.317212] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 133.319191] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 133.322163] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 133.324290] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-3: Preparing remote state change 1302120215 Mar 17 01:54:28 offine-stand-stor-0 [ 133.332890] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d: Starting worker thread (from drbdsetup [10344]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.335286] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-3: Preparing remote state change 2558364328 Mar 17 01:54:28 offine-stand-stor-0 [ 133.337683] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.337686] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.344953] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-1: Starting sender thread (from drbdsetup [10349]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.348513] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 133.376686] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e/0 drbd1069 offline-stand-stor-3: my exposed UUID: FF996E427762E6D0 Mar 17 01:54:28 offine-stand-stor-0 [ 133.376687] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.376690] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.379935] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-4: Starting sender thread (from drbdsetup [10352]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.380403] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e/0 drbd1069 offline-stand-stor-3: peer FF996E427762E6D0:0000000000000000:91EF264BE04F6168:0000000000000000 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.398771] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-3: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.400505] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132: meta-data IO uses: blk-bio Mar 17 01:54:28 offine-stand-stor-0 [ 133.400726] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d: susp-io( no -> quorum ) [attach] Mar 17 01:54:28 offine-stand-stor-0 [ 133.400736] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:28 offine-stand-stor-0 [ 133.400745] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132: Maximum number of peer devices = 7 Mar 17 01:54:28 offine-stand-stor-0 [ 133.401698] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d: Method to ensure write ordering: flush Mar 17 01:54:28 offine-stand-stor-0 [ 133.405431] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.409677] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:28 offine-stand-stor-0 [ 133.413902] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 133.414763] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:28 offine-stand-stor-0 [ 133.420610] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-3: Committing remote state change 2093211189 (primary_nodes=0) Mar 17 01:54:28 offine-stand-stor-0 [ 133.420969] drbd1132: detected capacity change from 0 to 10491632 Mar 17 01:54:28 offine-stand-stor-0 [ 133.422735] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-3: Preparing remote state change 2235611142 Mar 17 01:54:28 offine-stand-stor-0 [ 133.422891] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.423169] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 133.423950] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132: size = 5123 MB (5245816 KB) Mar 17 01:54:28 offine-stand-stor-0 [ 133.425865] drbd pvc-38cfa801-0651-46db-bd16-e7264a80556e/0 drbd1069 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.457865] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132: recounting of set bits took additional 0ms Mar 17 01:54:28 offine-stand-stor-0 [ 133.459942] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:28 offine-stand-stor-0 [ 133.461193] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132: attached to current UUID: C154BFEFC7DC8A7A Mar 17 01:54:28 offine-stand-stor-0 [ 133.462152] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132: Setting exposed data uuid: C154BFEFC7DC8A7A Mar 17 01:54:28 offine-stand-stor-0 [ 133.464614] drbd1107: detected capacity change from 0 to 10491632 Mar 17 01:54:28 offine-stand-stor-0 [ 133.484561] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30/0 drbd1107: size = 5123 MB (5245816 KB) Mar 17 01:54:28 offine-stand-stor-0 [ 133.492646] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-4: Handshake to peer 3 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.501946] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.501949] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.508580] drbd1101: detected capacity change from 0 to 10491632 Mar 17 01:54:28 offine-stand-stor-0 [ 133.508620] drbd1045: detected capacity change from 0 to 10491632 Mar 17 01:54:28 offine-stand-stor-0 [ 133.508623] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800/0 drbd1045: size = 5123 MB (5245816 KB) Mar 17 01:54:28 offine-stand-stor-0 [ 133.508675] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800/0 drbd1045 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:28 offine-stand-stor-0 [ 133.508684] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800/0 drbd1045 offline-stand-stor-3: peer F86AD3C427F25B42:0000000000000000:414D0E3C01F3A4F8:0000000000000000 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.508688] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800/0 drbd1045: Setting exposed data uuid: F86AD3C427F25B42 Mar 17 01:54:28 offine-stand-stor-0 [ 133.509727] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30/0 drbd1107 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:28 offine-stand-stor-0 [ 133.509751] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30/0 drbd1107 offline-stand-stor-3: peer 267CA4B1159D7246:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.509754] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30/0 drbd1107: Setting exposed data uuid: 267CA4B1159D7246 Mar 17 01:54:28 offine-stand-stor-0 [ 133.510616] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.511165] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:28 offine-stand-stor-0 [ 133.513557] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e/0 drbd1101: size = 5123 MB (5245816 KB) Mar 17 01:54:28 offine-stand-stor-0 [ 133.516147] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:28 offine-stand-stor-0 [ 133.516989] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-3: Committing remote state change 2235611142 (primary_nodes=0) Mar 17 01:54:28 offine-stand-stor-0 [ 133.517005] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e/0 drbd1101 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:28 offine-stand-stor-0 [ 133.517008] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e/0 drbd1101 offline-stand-stor-3: peer BA6C697C0D827EC8:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.517011] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e/0 drbd1101: Setting exposed data uuid: BA6C697C0D827EC8 Mar 17 01:54:28 offine-stand-stor-0 [ 133.526018] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-3: Committing remote state change 2558364328 (primary_nodes=0) Mar 17 01:54:28 offine-stand-stor-0 [ 133.526120] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 133.526433] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800: susp-io( quorum -> no ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.528186] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e: susp-io( quorum -> no ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.529178] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.530155] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.531190] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800/0 drbd1045: quorum( no -> yes ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.533867] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e/0 drbd1101: quorum( no -> yes ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.534929] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800/0 drbd1045 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.537317] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e/0 drbd1101 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.538272] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-2: Preparing remote state change 2113626965 Mar 17 01:54:28 offine-stand-stor-0 [ 133.540622] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-1: Preparing remote state change 4062996447 Mar 17 01:54:28 offine-stand-stor-0 [ 133.540865] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d: Preparing cluster-wide state change 173480956 (0->3 499/146) Mar 17 01:54:28 offine-stand-stor-0 [ 133.541067] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-3: Committing remote state change 1302120215 (primary_nodes=0) Mar 17 01:54:28 offine-stand-stor-0 [ 133.541077] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30: susp-io( quorum -> no ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.541080] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.541082] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30/0 drbd1107: quorum( no -> yes ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.541109] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30/0 drbd1107 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.549845] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-1: Preparing remote state change 2922046206 Mar 17 01:54:28 offine-stand-stor-0 [ 133.551250] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 133.555035] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d: Starting worker thread (from drbdsetup [10379]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.596625] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800/0 drbd1045 offline-stand-stor-2: my exposed UUID: F86AD3C427F25B42 Mar 17 01:54:28 offine-stand-stor-0 [ 133.597217] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-4b26 [10345]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.599485] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800/0 drbd1045 offline-stand-stor-2: peer F86AD3C427F25B42:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.600639] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:28 offine-stand-stor-0 [ 133.600664] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-4b26 [10345]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.604771] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-1: Starting sender thread (from drbdsetup [10386]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.613995] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:28 offine-stand-stor-0 [ 133.616557] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022 offline-stand-stor-4: self F576DD2C3277F7D6:5B3A6F88ABC5A871:1B50A99CF52DCC84:35D70D6E48625DEE bits:0 flags:0 Mar 17 01:54:28 offine-stand-stor-0 [ 133.616568] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022 offline-stand-stor-4: peer's exposed UUID: F576DD2C3277F7D7 Mar 17 01:54:28 offine-stand-stor-0 [ 133.616609] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d: State change 173480956: primary_nodes=0, weak_nodes=0 Mar 17 01:54:28 offine-stand-stor-0 [ 133.616612] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d: Committing cluster-wide state change 173480956 (64ms) Mar 17 01:54:28 offine-stand-stor-0 [ 133.616635] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:28 offine-stand-stor-0 [ 133.616637] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022 offline-stand-stor-4: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:28 offine-stand-stor-0 [ 133.617894] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e/0 drbd1101 offline-stand-stor-1: my exposed UUID: BA6C697C0D827EC8 Mar 17 01:54:28 offine-stand-stor-0 [ 133.620863] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-2: Committing remote state change 2113626965 (primary_nodes=0) Mar 17 01:54:28 offine-stand-stor-0 [ 133.623014] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e/0 drbd1101 offline-stand-stor-1: peer BA6C697C0D827EC8:0000000000000000:CC8EF47CA86AB84E:0000000000000000 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.623946] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-4: Starting sender thread (from drbdsetup [10388]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.624600] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.624603] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.625917] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.625924] drbd pvc-435edc0a-b961-47b1-b078-7ac8a486c800/0 drbd1045 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.629359] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 133.634107] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-1: Committing remote state change 4062996447 (primary_nodes=0) Mar 17 01:54:28 offine-stand-stor-0 [ 133.636229] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d: susp-io( no -> quorum ) [connect] Mar 17 01:54:28 offine-stand-stor-0 [ 133.637051] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.638998] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:28 offine-stand-stor-0 [ 133.639954] drbd pvc-40ac8e97-0b2a-4140-904f-9604263bb84e/0 drbd1101 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.641854] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-4bda [10382]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.643281] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:28 offine-stand-stor-0 [ 133.656557] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d: Preparing cluster-wide state change 3663386982 (0->1 499/146) Mar 17 01:54:28 offine-stand-stor-0 [ 133.658836] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.675325] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.678292] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:28 offine-stand-stor-0 [ 133.678314] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-4bda [10382]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.680085] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:28 offine-stand-stor-0 [ 133.682843] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30/0 drbd1107 offline-stand-stor-1: my exposed UUID: 267CA4B1159D7246 Mar 17 01:54:28 offine-stand-stor-0 [ 133.684823] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:28 offine-stand-stor-0 [ 133.687868] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-1: Preparing remote state change 1891445080 Mar 17 01:54:28 offine-stand-stor-0 [ 133.700366] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30/0 drbd1107 offline-stand-stor-1: peer 267CA4B1159D7246:0000000000000000:211C8E502CF51D5E:0000000000000000 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.714496] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057: Starting worker thread (from drbdsetup [10413]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.750836] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:28 offine-stand-stor-0 [ 133.752680] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022 offline-stand-stor-2: self F576DD2C3277F7D6:0000000000000000:1B50A99CF52DCC84:35D70D6E48625DEE bits:0 flags:20 Mar 17 01:54:28 offine-stand-stor-0 [ 133.755835] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022 offline-stand-stor-2: peer F576DD2C3277F7D6:0000000000000000:6F68F0161169C2D6:1B50A99CF52DCC84 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.758820] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:28 offine-stand-stor-0 [ 133.762622] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-1: Committing remote state change 2922046206 (primary_nodes=0) Mar 17 01:54:28 offine-stand-stor-0 [ 133.762628] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-2: Starting sender thread (from drbdsetup [10418]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.762675] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d: State change 3663386982: primary_nodes=0, weak_nodes=0 Mar 17 01:54:28 offine-stand-stor-0 [ 133.762681] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d: Committing cluster-wide state change 3663386982 (104ms) Mar 17 01:54:28 offine-stand-stor-0 [ 133.762747] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d: susp-io( quorum -> no ) [connected] Mar 17 01:54:28 offine-stand-stor-0 [ 133.762751] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:28 offine-stand-stor-0 [ 133.762754] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022: quorum( no -> yes ) [connected] Mar 17 01:54:28 offine-stand-stor-0 [ 133.762762] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [connected] Mar 17 01:54:28 offine-stand-stor-0 [ 133.762978] drbd pvc-448e2e77-ecd3-428d-920f-8ec129c3373d/0 drbd1022 offline-stand-stor-2: cleared bm UUID and bitmap F576DD2C3277F7D6:0000000000000000:1B50A99CF52DCC84:35D70D6E48625DEE Mar 17 01:54:28 offine-stand-stor-0 [ 133.768181] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-3: Starting sender thread (from drbdsetup [10420]) Mar 17 01:54:28 offine-stand-stor-0 [ 133.802549] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.804626] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.816628] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-4: Handshake to peer 3 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.816632] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.817100] drbd pvc-414f5b5f-39ff-4107-8b04-f6df0da70f30/0 drbd1107 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.820648] drbd1131: detected capacity change from 0 to 10491632 Mar 17 01:54:28 offine-stand-stor-0 [ 133.820823] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.822081] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:28 offine-stand-stor-0 [ 133.822084] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:28 offine-stand-stor-0 [ 133.822686] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205/0 drbd1131: size = 5123 MB (5245816 KB) Mar 17 01:54:28 offine-stand-stor-0 [ 133.836093] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f: Preparing cluster-wide state change 518908989 (1->3 499/146) Mar 17 01:54:28 offine-stand-stor-0 [ 133.836351] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205/0 drbd1131 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:28 offine-stand-stor-0 [ 133.838186] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-1: Aborting local state change 518908989 to yield to remote state change 146382390. Mar 17 01:54:28 offine-stand-stor-0 [ 133.839259] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205/0 drbd1131 offline-stand-stor-1: peer 8606931ADE358F50:0000000000000000:404FD91C484A074E:0000000000000000 bits:0 flags:1120 Mar 17 01:54:28 offine-stand-stor-0 [ 133.852509] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205/0 drbd1131: Setting exposed data uuid: 8606931ADE358F50 Mar 17 01:54:28 offine-stand-stor-0 [ 133.858083] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-1: Committing remote state change 1891445080 (primary_nodes=0) Mar 17 01:54:28 offine-stand-stor-0 [ 133.860333] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205: susp-io( quorum -> no ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.861998] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.863967] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205/0 drbd1131: quorum( no -> yes ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.865143] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205/0 drbd1131 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:28 offine-stand-stor-0 [ 133.867773] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-4: Preparing remote state change 316131243 Mar 17 01:54:29 offine-stand-stor-0 [ 133.893039] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083: meta-data IO uses: blk-bio Mar 17 01:54:29 offine-stand-stor-0 [ 133.896706] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205/0 drbd1131 offline-stand-stor-4: my exposed UUID: 8606931ADE358F50 Mar 17 01:54:29 offine-stand-stor-0 [ 133.896890] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057: susp-io( no -> quorum ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 133.898096] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205/0 drbd1131 offline-stand-stor-4: peer 8606931ADE358F50:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:29 offine-stand-stor-0 [ 133.899576] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 133.904007] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083: Maximum number of peer devices = 7 Mar 17 01:54:29 offine-stand-stor-0 [ 133.905873] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057: Method to ensure write ordering: flush Mar 17 01:54:29 offine-stand-stor-0 [ 133.906919] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:29 offine-stand-stor-0 [ 133.908763] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:29 offine-stand-stor-0 [ 133.910064] drbd1083: detected capacity change from 0 to 10491632 Mar 17 01:54:29 offine-stand-stor-0 [ 133.911299] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083: size = 5123 MB (5245816 KB) Mar 17 01:54:29 offine-stand-stor-0 [ 133.919678] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083: recounting of set bits took additional 0ms Mar 17 01:54:29 offine-stand-stor-0 [ 133.920809] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 133.921824] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083: attached to current UUID: 289ABC7C8B3C8784 Mar 17 01:54:29 offine-stand-stor-0 [ 133.922780] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083: Setting exposed data uuid: 289ABC7C8B3C8784 Mar 17 01:54:29 offine-stand-stor-0 [ 133.926177] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 133.927799] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-4dfb [10414]) Mar 17 01:54:29 offine-stand-stor-0 [ 133.929602] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-4: Committing remote state change 316131243 (primary_nodes=0) Mar 17 01:54:29 offine-stand-stor-0 [ 133.929970] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 133.932094] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 133.933991] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 133.936936] drbd pvc-45194627-7a17-4d7c-be9d-f36ee7665205/0 drbd1131 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 133.938512] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-4dfb [10414]) Mar 17 01:54:29 offine-stand-stor-0 [ 133.942904] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 133.973000] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb: Starting worker thread (from drbdsetup [10457]) Mar 17 01:54:29 offine-stand-stor-0 [ 133.978419] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-2: Starting sender thread (from drbdsetup [10462]) Mar 17 01:54:29 offine-stand-stor-0 [ 133.984936] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-3: Starting sender thread (from drbdsetup [10464]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.004445] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049: meta-data IO uses: blk-bio Mar 17 01:54:29 offine-stand-stor-0 [ 134.006422] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb: susp-io( no -> quorum ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 134.007407] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 134.008300] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049: Maximum number of peer devices = 7 Mar 17 01:54:29 offine-stand-stor-0 [ 134.009951] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb: Method to ensure write ordering: flush Mar 17 01:54:29 offine-stand-stor-0 [ 134.010941] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:29 offine-stand-stor-0 [ 134.012629] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:29 offine-stand-stor-0 [ 134.013594] drbd1049: detected capacity change from 0 to 10491632 Mar 17 01:54:29 offine-stand-stor-0 [ 134.014526] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049: size = 5123 MB (5245816 KB) Mar 17 01:54:29 offine-stand-stor-0 [ 134.027271] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049: recounting of set bits took additional 0ms Mar 17 01:54:29 offine-stand-stor-0 [ 134.028241] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 134.029428] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049: attached to current UUID: AE9D2A3FF8F038CC Mar 17 01:54:29 offine-stand-stor-0 [ 134.030362] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049: Setting exposed data uuid: AE9D2A3FF8F038CC Mar 17 01:54:29 offine-stand-stor-0 [ 134.033698] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.035480] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-514e [10458]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.036261] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.038520] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 134.038534] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-514e [10458]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.042776] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 134.070353] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f: Starting worker thread (from drbdsetup [10489]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.075357] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-1: Starting sender thread (from drbdsetup [10494]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.081031] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-4: Starting sender thread (from drbdsetup [10496]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.087202] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f: susp-io( no -> quorum ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.088191] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.089366] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-55c6 [10490]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.090305] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.092165] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-55c6 [10490]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.092228] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 134.097529] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 134.132470] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611: Starting worker thread (from drbdsetup [10519]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.132614] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:29 offine-stand-stor-0 [ 134.133450] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-1: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:29 offine-stand-stor-0 [ 134.135396] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:29 offine-stand-stor-0 [ 134.139268] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:29 offine-stand-stor-0 [ 134.141012] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:29 offine-stand-stor-0 [ 134.147454] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-2: Starting sender thread (from drbdsetup [10525]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.151508] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-3: Starting sender thread (from drbdsetup [10527]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.166509] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:29 offine-stand-stor-0 [ 134.168577] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d: Preparing cluster-wide state change 3499204842 (1->2 499/146) Mar 17 01:54:29 offine-stand-stor-0 [ 134.175465] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027: meta-data IO uses: blk-bio Mar 17 01:54:29 offine-stand-stor-0 [ 134.177028] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611: susp-io( no -> quorum ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 134.178262] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 134.179130] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-4: Aborting local state change 3499204842 to yield to remote state change 3872885961. Mar 17 01:54:29 offine-stand-stor-0 [ 134.179289] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027: Maximum number of peer devices = 7 Mar 17 01:54:29 offine-stand-stor-0 [ 134.183581] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611: Method to ensure write ordering: flush Mar 17 01:54:29 offine-stand-stor-0 [ 134.185273] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:29 offine-stand-stor-0 [ 134.187246] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:29 offine-stand-stor-0 [ 134.188581] drbd1027: detected capacity change from 0 to 10491632 Mar 17 01:54:29 offine-stand-stor-0 [ 134.190047] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027: size = 5123 MB (5245816 KB) Mar 17 01:54:29 offine-stand-stor-0 [ 134.196670] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:29 offine-stand-stor-0 [ 134.199683] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:29 offine-stand-stor-0 [ 134.202572] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:29 offine-stand-stor-0 [ 134.210192] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027: recounting of set bits took additional 0ms Mar 17 01:54:29 offine-stand-stor-0 [ 134.211368] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 134.212529] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027: attached to current UUID: D9052551758946D2 Mar 17 01:54:29 offine-stand-stor-0 [ 134.213898] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027: Setting exposed data uuid: D9052551758946D2 Mar 17 01:54:29 offine-stand-stor-0 [ 134.216825] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-1: Preparing remote state change 63615463 Mar 17 01:54:29 offine-stand-stor-0 [ 134.217875] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.220370] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.221758] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-5704 [10520]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.272936] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 134.274263] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-5704 [10520]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.283130] drbd1113: detected capacity change from 0 to 10491632 Mar 17 01:54:29 offine-stand-stor-0 [ 134.284959] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 134.285670] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d/0 drbd1113: size = 5123 MB (5245816 KB) Mar 17 01:54:29 offine-stand-stor-0 [ 134.288105] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d/0 drbd1113 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:29 offine-stand-stor-0 [ 134.288920] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d/0 drbd1113 offline-stand-stor-1: peer 705CBA82B8024046:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:29 offine-stand-stor-0 [ 134.290476] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d/0 drbd1113: Setting exposed data uuid: 705CBA82B8024046 Mar 17 01:54:29 offine-stand-stor-0 [ 134.292667] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:29 offine-stand-stor-0 [ 134.296182] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:29 offine-stand-stor-0 [ 134.304286] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc: Starting worker thread (from drbdsetup [10562]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.309059] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-1: Starting sender thread (from drbdsetup [10567]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.314541] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-2: Starting sender thread (from drbdsetup [10569]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.324703] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-1: Committing remote state change 63615463 (primary_nodes=0) Mar 17 01:54:29 offine-stand-stor-0 [ 134.326323] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d: susp-io( quorum -> no ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.327076] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.328583] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d/0 drbd1113: quorum( no -> yes ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.329338] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d/0 drbd1113 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.330150] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:29 offine-stand-stor-0 [ 134.330906] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124: meta-data IO uses: blk-bio Mar 17 01:54:29 offine-stand-stor-0 [ 134.334459] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc: susp-io( no -> quorum ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 134.335687] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 134.336911] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124: Maximum number of peer devices = 7 Mar 17 01:54:29 offine-stand-stor-0 [ 134.338369] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc: Method to ensure write ordering: flush Mar 17 01:54:29 offine-stand-stor-0 [ 134.339520] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:29 offine-stand-stor-0 [ 134.341595] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:29 offine-stand-stor-0 [ 134.343423] drbd1124: detected capacity change from 0 to 10491632 Mar 17 01:54:29 offine-stand-stor-0 [ 134.345063] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124: size = 5123 MB (5245816 KB) Mar 17 01:54:29 offine-stand-stor-0 [ 134.347597] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f: Aborting cluster-wide state change 518908989 (512ms) rv = -19 Mar 17 01:54:29 offine-stand-stor-0 [ 134.349349] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-1: Preparing remote state change 146382390 Mar 17 01:54:29 offine-stand-stor-0 [ 134.354463] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124: recounting of set bits took additional 0ms Mar 17 01:54:29 offine-stand-stor-0 [ 134.355460] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 134.356393] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124: attached to current UUID: A9B853CAD8DC4CEC Mar 17 01:54:29 offine-stand-stor-0 [ 134.357396] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124: Setting exposed data uuid: A9B853CAD8DC4CEC Mar 17 01:54:29 offine-stand-stor-0 [ 134.363101] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.364511] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-5759 [10563]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.365604] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.367607] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 134.367608] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-5759 [10563]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.373668] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 134.381045] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-4: Preparing remote state change 3976321392 Mar 17 01:54:29 offine-stand-stor-0 [ 134.388621] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-1: drbd_sync_handshake: Mar 17 01:54:29 offine-stand-stor-0 [ 134.390479] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-1: self 943793E333DA1018:0000000000000000:530055A62D061548:674FD9162CD141EE bits:0 flags:20 Mar 17 01:54:29 offine-stand-stor-0 [ 134.393802] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-1: peer D411E25C7ABB29E3:943793E333DA1019:27F00A579283FB24:E1507556F15948E8 bits:892 flags:1120 Mar 17 01:54:29 offine-stand-stor-0 [ 134.397243] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-1: uuid_compare()=target-use-bitmap by rule=bitmap-peer Mar 17 01:54:29 offine-stand-stor-0 [ 134.404856] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84: Starting worker thread (from drbdsetup [10595]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.410140] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-2: Starting sender thread (from drbdsetup [10600]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.415765] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-3: Starting sender thread (from drbdsetup [10602]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.419779] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-1: Committing remote state change 146382390 (primary_nodes=1) Mar 17 01:54:29 offine-stand-stor-0 [ 134.421777] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f: susp-io( quorum -> no ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.422644] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Primary ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.424489] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003: disk( UpToDate -> Outdated ) quorum( no -> yes ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.425521] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84: susp-io( no -> quorum ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.426335] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> WFBitMapT ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.427347] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.429032] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003: Setting exposed data uuid: D411E25C7ABB29E2 Mar 17 01:54:29 offine-stand-stor-0 [ 134.431932] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.432010] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d/0 drbd1113 offline-stand-stor-4: my exposed UUID: 705CBA82B8024046 Mar 17 01:54:29 offine-stand-stor-0 [ 134.432024] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-5903 [10596]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.432098] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f: Preparing cluster-wide state change 1814687433 (1->2 499/146) Mar 17 01:54:29 offine-stand-stor-0 [ 134.432891] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-5903 [10596]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.432970] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 134.434294] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d/0 drbd1113 offline-stand-stor-4: peer 705CBA82B8024046:0000000000000000:606430B9DAB02DFC:0000000000000000 bits:0 flags:1120 Mar 17 01:54:29 offine-stand-stor-0 [ 134.436166] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 134.440826] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-1: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 39(1), total 39; compression: 100.0% Mar 17 01:54:29 offine-stand-stor-0 [ 134.450828] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-1: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 39(1), total 39; compression: 100.0% Mar 17 01:54:29 offine-stand-stor-0 [ 134.453782] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-3: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:29 offine-stand-stor-0 [ 134.454312] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-4: Committing remote state change 3976321392 (primary_nodes=0) Mar 17 01:54:29 offine-stand-stor-0 [ 134.456062] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:29 offine-stand-stor-0 [ 134.459235] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.459240] drbd pvc-4bdabbcd-1efd-4806-802d-7b041fc47b2d/0 drbd1113 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.466992] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:29 offine-stand-stor-0 [ 134.469740] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:29 offine-stand-stor-0 [ 134.473648] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:29 offine-stand-stor-0 [ 134.476880] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd: Starting worker thread (from drbdsetup [10626]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.482435] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-1: Starting sender thread (from drbdsetup [10631]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.486395] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-2: Preparing remote state change 116062068 Mar 17 01:54:29 offine-stand-stor-0 [ 134.489059] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-4: Starting sender thread (from drbdsetup [10633]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.505431] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129: meta-data IO uses: blk-bio Mar 17 01:54:29 offine-stand-stor-0 [ 134.506316] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:29 offine-stand-stor-0 [ 134.506971] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd: susp-io( no -> quorum ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 134.509393] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 134.510503] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129: Maximum number of peer devices = 7 Mar 17 01:54:29 offine-stand-stor-0 [ 134.512377] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd: Method to ensure write ordering: flush Mar 17 01:54:29 offine-stand-stor-0 [ 134.513648] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:29 offine-stand-stor-0 [ 134.515219] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:29 offine-stand-stor-0 [ 134.516757] drbd1129: detected capacity change from 0 to 10491632 Mar 17 01:54:29 offine-stand-stor-0 [ 134.517926] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129: size = 5123 MB (5245816 KB) Mar 17 01:54:29 offine-stand-stor-0 [ 134.535317] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129: recounting of set bits took additional 0ms Mar 17 01:54:29 offine-stand-stor-0 [ 134.536379] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 134.536573] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-2: self 943793E333DA1018:61F43F3BE0427524:530055A62D061548:674FD9162CD141EE bits:0 flags:0 Mar 17 01:54:29 offine-stand-stor-0 [ 134.537454] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129: attached to current UUID: 664724BD5E7F963A Mar 17 01:54:29 offine-stand-stor-0 [ 134.537459] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129: Setting exposed data uuid: 664724BD5E7F963A Mar 17 01:54:29 offine-stand-stor-0 [ 134.542422] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-2: peer's exposed UUID: D411E25C7ABB29E2 Mar 17 01:54:29 offine-stand-stor-0 [ 134.545124] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f: State change 1814687433: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFF0 Mar 17 01:54:29 offine-stand-stor-0 [ 134.547526] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f: Committing cluster-wide state change 1814687433 (116ms) Mar 17 01:54:29 offine-stand-stor-0 [ 134.549160] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:29 offine-stand-stor-0 [ 134.551668] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:29 offine-stand-stor-0 [ 134.552665] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-3: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:29 offine-stand-stor-0 [ 134.555914] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.556285] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:29 offine-stand-stor-0 [ 134.558579] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:29 offine-stand-stor-0 [ 134.559882] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.560055] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-5b1f [10627]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.561364] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 134.561391] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-5b1f [10627]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.561477] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 134.564648] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f: Preparing cluster-wide state change 3773874179 (1->3 499/146) Mar 17 01:54:29 offine-stand-stor-0 [ 134.565358] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:29 offine-stand-stor-0 [ 134.573109] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:29 offine-stand-stor-0 [ 134.574869] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:29 offine-stand-stor-0 [ 134.576609] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb: Preparing cluster-wide state change 1169549792 (0->2 499/146) Mar 17 01:54:29 offine-stand-stor-0 [ 134.594634] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448: Starting worker thread (from drbdsetup [10661]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.600194] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-1: Starting sender thread (from drbdsetup [10666]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.606227] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-4: Starting sender thread (from drbdsetup [10668]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.612617] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:29 offine-stand-stor-0 [ 134.612884] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448: susp-io( no -> quorum ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.615023] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:29 offine-stand-stor-0 [ 134.616133] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.619926] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:29 offine-stand-stor-0 [ 134.621268] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083 offline-stand-stor-2: self 289ABC7C8B3C8784:0000000000000000:148F0DD877052CFC:0000000000000000 bits:0 flags:20 Mar 17 01:54:29 offine-stand-stor-0 [ 134.621987] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:29 offine-stand-stor-0 [ 134.623329] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083 offline-stand-stor-2: peer 289ABC7C8B3C8784:0000000000000000:5236F7A7C603B9FC:3D9924FB1349E8B6 bits:34 flags:1120 Mar 17 01:54:29 offine-stand-stor-0 [ 134.626087] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-5b37 [10662]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.627378] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:29 offine-stand-stor-0 [ 134.628374] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.630598] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 134.630663] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-5b37 [10662]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.638282] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-2: Committing remote state change 116062068 (primary_nodes=0) Mar 17 01:54:29 offine-stand-stor-0 [ 134.639478] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049 offline-stand-stor-3: self AE9D2A3FF8F038CC:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:0 Mar 17 01:54:29 offine-stand-stor-0 [ 134.642993] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057: susp-io( quorum -> no ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.645942] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049 offline-stand-stor-3: peer's exposed UUID: AE9D2A3FF8F038CC Mar 17 01:54:29 offine-stand-stor-0 [ 134.647498] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:29 offine-stand-stor-0 [ 134.647501] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:29 offine-stand-stor-0 [ 134.647793] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.649839] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb: State change 1169549792: primary_nodes=0, weak_nodes=0 Mar 17 01:54:29 offine-stand-stor-0 [ 134.650122] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 134.652921] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-4: self 943793E333DA1018:61F43F3BE0427524:530055A62D061548:674FD9162CD141EE bits:0 flags:0 Mar 17 01:54:29 offine-stand-stor-0 [ 134.652925] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-4: peer's exposed UUID: D411E25C7ABB29E2 Mar 17 01:54:29 offine-stand-stor-0 [ 134.652938] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f: State change 3773874179: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFF0 Mar 17 01:54:29 offine-stand-stor-0 [ 134.652941] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f: Committing cluster-wide state change 3773874179 (76ms) Mar 17 01:54:29 offine-stand-stor-0 [ 134.653026] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:29 offine-stand-stor-0 [ 134.653029] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-4: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:29 offine-stand-stor-0 [ 134.653739] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083: quorum( no -> yes ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.653744] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.653891] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083 offline-stand-stor-2: cleared bm UUID and bitmap 289ABC7C8B3C8784:0000000000000000:148F0DD877052CFC:0000000000000000 Mar 17 01:54:29 offine-stand-stor-0 [ 134.658382] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb: Committing cluster-wide state change 1169549792 (80ms) Mar 17 01:54:29 offine-stand-stor-0 [ 134.660581] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003: disk( Outdated -> Inconsistent ) [postponed-resync] Mar 17 01:54:29 offine-stand-stor-0 [ 134.660585] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-4: resync-susp( no -> connection dependency ) [postponed-resync] Mar 17 01:54:29 offine-stand-stor-0 [ 134.660588] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-2: resync-susp( no -> connection dependency ) [postponed-resync] Mar 17 01:54:29 offine-stand-stor-0 [ 134.660595] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-1: repl( WFBitMapT -> SyncTarget ) [postponed-resync] Mar 17 01:54:29 offine-stand-stor-0 [ 134.660943] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-1: Began resync as SyncTarget (will sync 3580 KB [895 bits set]). Mar 17 01:54:29 offine-stand-stor-0 [ 134.661967] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-4: Preparing remote state change 512951727 Mar 17 01:54:29 offine-stand-stor-0 [ 134.662919] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057: Preparing cluster-wide state change 3596943050 (1->2 499/146) Mar 17 01:54:29 offine-stand-stor-0 [ 134.665658] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:29 offine-stand-stor-0 [ 134.668390] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:29 offine-stand-stor-0 [ 134.670075] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049 offline-stand-stor-3: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:29 offine-stand-stor-0 [ 134.680453] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f: Starting worker thread (from drbdsetup [10694]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.688581] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d: Aborting cluster-wide state change 3499204842 (520ms) rv = -19 Mar 17 01:54:29 offine-stand-stor-0 [ 134.690140] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb: Preparing cluster-wide state change 2444159282 (0->1 499/146) Mar 17 01:54:29 offine-stand-stor-0 [ 134.691427] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-4: Preparing remote state change 3872885961 Mar 17 01:54:29 offine-stand-stor-0 [ 134.697914] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-2: Starting sender thread (from drbdsetup [10700]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.702627] drbd1116: detected capacity change from 0 to 10491632 Mar 17 01:54:29 offine-stand-stor-0 [ 134.706316] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-3: Starting sender thread (from drbdsetup [10702]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.706768] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f/0 drbd1116: size = 5123 MB (5245816 KB) Mar 17 01:54:29 offine-stand-stor-0 [ 134.716588] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083 offline-stand-stor-3: self 289ABC7C8B3C8784:0000000000000000:148F0DD877052CFC:0000000000000000 bits:0 flags:0 Mar 17 01:54:29 offine-stand-stor-0 [ 134.717010] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f/0 drbd1116 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:29 offine-stand-stor-0 [ 134.718313] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083 offline-stand-stor-3: peer's exposed UUID: 289ABC7C8B3C8784 Mar 17 01:54:29 offine-stand-stor-0 [ 134.719463] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f/0 drbd1116 offline-stand-stor-4: peer 9A65B38347CC6FEC:0000000000000000:2CD940635985FB10:0000000000000000 bits:0 flags:1120 Mar 17 01:54:29 offine-stand-stor-0 [ 134.720475] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057: State change 3596943050: primary_nodes=0, weak_nodes=0 Mar 17 01:54:29 offine-stand-stor-0 [ 134.725293] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f/0 drbd1116: Setting exposed data uuid: 9A65B38347CC6FEC Mar 17 01:54:29 offine-stand-stor-0 [ 134.727262] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057: Committing cluster-wide state change 3596943050 (64ms) Mar 17 01:54:29 offine-stand-stor-0 [ 134.727333] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:29 offine-stand-stor-0 [ 134.728628] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:29 offine-stand-stor-0 [ 134.728632] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049 offline-stand-stor-2: self AE9D2A3FF8F038CC:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:20 Mar 17 01:54:29 offine-stand-stor-0 [ 134.728635] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049 offline-stand-stor-2: peer AE9D2A3FF8F038CC:0000000000000000:BEFD459E14C42C8A:45BC6FF9A5FE1FB6 bits:0 flags:1120 Mar 17 01:54:29 offine-stand-stor-0 [ 134.728639] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:29 offine-stand-stor-0 [ 134.736586] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-4: Committing remote state change 512951727 (primary_nodes=0) Mar 17 01:54:29 offine-stand-stor-0 [ 134.736904] drbd pvc-4dfba9ef-c102-4f15-9af6-771261602057/0 drbd1083 offline-stand-stor-3: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:29 offine-stand-stor-0 [ 134.740689] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132 offline-stand-stor-4: drbd_sync_handshake: Mar 17 01:54:29 offine-stand-stor-0 [ 134.741437] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb: State change 2444159282: primary_nodes=0, weak_nodes=0 Mar 17 01:54:29 offine-stand-stor-0 [ 134.741441] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb: Committing cluster-wide state change 2444159282 (52ms) Mar 17 01:54:29 offine-stand-stor-0 [ 134.741484] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb: susp-io( quorum -> no ) [connected] Mar 17 01:54:29 offine-stand-stor-0 [ 134.741487] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:29 offine-stand-stor-0 [ 134.741488] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049: quorum( no -> yes ) [connected] Mar 17 01:54:29 offine-stand-stor-0 [ 134.741491] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [connected] Mar 17 01:54:29 offine-stand-stor-0 [ 134.741580] drbd pvc-514e809c-bc87-4fb9-9045-dbbcb43ffbdb/0 drbd1049 offline-stand-stor-2: cleared bm UUID and bitmap AE9D2A3FF8F038CC:0000000000000000:0000000000000000:0000000000000000 Mar 17 01:54:29 offine-stand-stor-0 [ 134.742455] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f: susp-io( quorum -> no ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.743887] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132 offline-stand-stor-4: self C154BFEFC7DC8A7A:0000000000000000:027262B2F21741B6:0000000000000000 bits:0 flags:20 Mar 17 01:54:29 offine-stand-stor-0 [ 134.745602] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.747207] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132 offline-stand-stor-4: peer C154BFEFC7DC8A7A:0000000000000000:6C6CA8ED72DAB7F2:BE4FD9F453A2E06A bits:0 flags:1120 Mar 17 01:54:29 offine-stand-stor-0 [ 134.750418] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f/0 drbd1116: quorum( no -> yes ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.752103] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132 offline-stand-stor-4: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:29 offine-stand-stor-0 [ 134.755455] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f/0 drbd1116 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.755590] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-1: Preparing remote state change 271932206 Mar 17 01:54:29 offine-stand-stor-0 [ 134.762919] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021: meta-data IO uses: blk-bio Mar 17 01:54:29 offine-stand-stor-0 [ 134.778810] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-4: Committing remote state change 3872885961 (primary_nodes=0) Mar 17 01:54:29 offine-stand-stor-0 [ 134.779894] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f: susp-io( no -> quorum ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 134.781803] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-1: Resync done (total 1 sec; paused 0 sec; 3580 K/sec) Mar 17 01:54:29 offine-stand-stor-0 [ 134.781819] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-1: updated UUIDs D411E25C7ABB29E2:0000000000000000:530055A62D061548:674FD9162CD141EE Mar 17 01:54:29 offine-stand-stor-0 [ 134.781826] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003: disk( Inconsistent -> UpToDate ) [resync-finished] Mar 17 01:54:29 offine-stand-stor-0 [ 134.781828] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-4: resync-susp( connection dependency -> no ) [resync-finished] Mar 17 01:54:29 offine-stand-stor-0 [ 134.781830] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-2: resync-susp( connection dependency -> no ) [resync-finished] Mar 17 01:54:29 offine-stand-stor-0 [ 134.781832] drbd pvc-47c3004d-fd9c-46c0-a06e-0ed0a4d9611f/0 drbd1003 offline-stand-stor-1: repl( SyncTarget -> Established ) [resync-finished] Mar 17 01:54:29 offine-stand-stor-0 [ 134.782108] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d: susp-io( quorum -> no ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.783128] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 134.785045] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.786796] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021: Maximum number of peer devices = 7 Mar 17 01:54:29 offine-stand-stor-0 [ 134.788666] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132: quorum( no -> yes ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.788672] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:29 offine-stand-stor-0 [ 134.788825] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132 offline-stand-stor-4: cleared bm UUID and bitmap C154BFEFC7DC8A7A:0000000000000000:027262B2F21741B6:0000000000000000 Mar 17 01:54:29 offine-stand-stor-0 [ 134.790502] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f: Method to ensure write ordering: flush Mar 17 01:54:29 offine-stand-stor-0 [ 134.822812] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d: Preparing cluster-wide state change 3438505659 (1->2 499/146) Mar 17 01:54:29 offine-stand-stor-0 [ 134.822958] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:29 offine-stand-stor-0 [ 134.824630] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-3: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:29 offine-stand-stor-0 [ 134.825347] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:29 offine-stand-stor-0 [ 134.825937] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:29 offine-stand-stor-0 [ 134.825940] drbd1021: detected capacity change from 0 to 10491632 Mar 17 01:54:29 offine-stand-stor-0 [ 134.825942] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021: size = 5123 MB (5245816 KB) Mar 17 01:54:29 offine-stand-stor-0 [ 134.828310] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:29 offine-stand-stor-0 [ 134.836620] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f/0 drbd1116 offline-stand-stor-1: my exposed UUID: 9A65B38347CC6FEC Mar 17 01:54:29 offine-stand-stor-0 [ 134.838471] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:29 offine-stand-stor-0 [ 134.842248] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f/0 drbd1116 offline-stand-stor-1: peer 9A65B38347CC6FEC:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:29 offine-stand-stor-0 [ 134.844497] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021: recounting of set bits took additional 0ms Mar 17 01:54:29 offine-stand-stor-0 [ 134.844978] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:29 offine-stand-stor-0 [ 134.848212] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:29 offine-stand-stor-0 [ 134.849482] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611: Preparing cluster-wide state change 3496478978 (0->1 499/146) Mar 17 01:54:29 offine-stand-stor-0 [ 134.851039] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:29 offine-stand-stor-0 [ 134.858020] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021: attached to current UUID: 66983858224E6878 Mar 17 01:54:29 offine-stand-stor-0 [ 134.859106] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021: Setting exposed data uuid: 66983858224E6878 Mar 17 01:54:29 offine-stand-stor-0 [ 134.863077] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.864999] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-5d49 [10696]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.866088] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:29 offine-stand-stor-0 [ 134.868385] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:29 offine-stand-stor-0 [ 134.868861] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-5d49 [10696]) Mar 17 01:54:29 offine-stand-stor-0 [ 134.873221] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:30 offine-stand-stor-0 [ 134.900602] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:30 offine-stand-stor-0 [ 134.900617] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:30 offine-stand-stor-0 [ 134.902232] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:30 offine-stand-stor-0 [ 134.902479] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:30 offine-stand-stor-0 [ 134.904367] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:30 offine-stand-stor-0 [ 134.912275] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-1: Preparing remote state change 3057072252 Mar 17 01:54:30 offine-stand-stor-0 [ 134.922578] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:30 offine-stand-stor-0 [ 134.935725] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-1: Committing remote state change 271932206 (primary_nodes=0) Mar 17 01:54:30 offine-stand-stor-0 [ 134.938020] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 134.939639] drbd pvc-55c6870c-10b1-497a-877f-04d4fb045b7f/0 drbd1116 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 134.940354] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4: Starting worker thread (from drbdsetup [10741]) Mar 17 01:54:30 offine-stand-stor-0 [ 134.940600] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132 offline-stand-stor-1: self C154BFEFC7DC8A7A:0000000000000000:027262B2F21741B6:0000000000000000 bits:0 flags:0 Mar 17 01:54:30 offine-stand-stor-0 [ 134.940604] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132 offline-stand-stor-1: peer's exposed UUID: C154BFEFC7DC8A7A Mar 17 01:54:30 offine-stand-stor-0 [ 134.948812] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d: State change 3438505659: primary_nodes=0, weak_nodes=0 Mar 17 01:54:30 offine-stand-stor-0 [ 134.952780] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:30 offine-stand-stor-0 [ 134.953835] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-2: Starting sender thread (from drbdsetup [10746]) Mar 17 01:54:30 offine-stand-stor-0 [ 134.956493] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: Starting sender thread (from drbdsetup [10748]) Mar 17 01:54:30 offine-stand-stor-0 [ 134.973931] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:30 offine-stand-stor-0 [ 134.973935] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:30 offine-stand-stor-0 [ 134.975819] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-3: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:30 offine-stand-stor-0 [ 134.976292] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027 offline-stand-stor-3: self D9052551758946D2:0000000000000000:437E0C884845A7A6:0000000000000000 bits:0 flags:20 Mar 17 01:54:30 offine-stand-stor-0 [ 134.978065] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d: Committing cluster-wide state change 3438505659 (184ms) Mar 17 01:54:30 offine-stand-stor-0 [ 134.978391] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 134.978477] drbd pvc-4b26ebac-d929-46bd-923f-16b31b4aa94d/0 drbd1132 offline-stand-stor-1: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 134.979592] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:30 offine-stand-stor-0 [ 134.981629] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027 offline-stand-stor-3: peer D9052551758946D2:0000000000000000:D40181D354A2B1CC:54EF61B59ECBF042 bits:0 flags:1120 Mar 17 01:54:30 offine-stand-stor-0 [ 134.981727] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:30 offine-stand-stor-0 [ 134.985163] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:30 offine-stand-stor-0 [ 134.986706] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611: State change 3496478978: primary_nodes=0, weak_nodes=0 Mar 17 01:54:30 offine-stand-stor-0 [ 134.992660] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124 offline-stand-stor-1: drbd_sync_handshake: Mar 17 01:54:30 offine-stand-stor-0 [ 134.994755] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611: Committing cluster-wide state change 3496478978 (148ms) Mar 17 01:54:30 offine-stand-stor-0 [ 134.997714] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124 offline-stand-stor-1: self A9B853CAD8DC4CEC:0000000000000000:BFA874C19EE380E6:0000000000000000 bits:0 flags:20 Mar 17 01:54:30 offine-stand-stor-0 [ 134.997719] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124 offline-stand-stor-1: peer A9B853CAD8DC4CEC:0000000000000000:1D15F2D0D3705318:6494300DE93E21D0 bits:0 flags:1120 Mar 17 01:54:30 offine-stand-stor-0 [ 135.001088] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611: susp-io( quorum -> no ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.003303] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124 offline-stand-stor-1: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:30 offine-stand-stor-0 [ 135.005832] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.012145] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-1: Committing remote state change 3057072252 (primary_nodes=0) Mar 17 01:54:30 offine-stand-stor-0 [ 135.012904] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027: quorum( no -> yes ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.012908] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.013044] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027 offline-stand-stor-3: cleared bm UUID and bitmap D9052551758946D2:0000000000000000:437E0C884845A7A6:0000000000000000 Mar 17 01:54:30 offine-stand-stor-0 [ 135.015321] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc: susp-io( quorum -> no ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.026544] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:30 offine-stand-stor-0 [ 135.026711] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.030602] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-2: Preparing remote state change 2969576523 Mar 17 01:54:30 offine-stand-stor-0 [ 135.031135] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124: quorum( no -> yes ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.031139] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.031334] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124 offline-stand-stor-1: cleared bm UUID and bitmap A9B853CAD8DC4CEC:0000000000000000:BFA874C19EE380E6:0000000000000000 Mar 17 01:54:30 offine-stand-stor-0 [ 135.036580] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611: Preparing cluster-wide state change 3184840302 (0->2 499/146) Mar 17 01:54:30 offine-stand-stor-0 [ 135.037724] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc: Preparing cluster-wide state change 4177658805 (1->2 499/146) Mar 17 01:54:30 offine-stand-stor-0 [ 135.046693] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065: meta-data IO uses: blk-bio Mar 17 01:54:30 offine-stand-stor-0 [ 135.076138] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4: susp-io( no -> quorum ) [attach] Mar 17 01:54:30 offine-stand-stor-0 [ 135.092592] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:30 offine-stand-stor-0 [ 135.100477] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:30 offine-stand-stor-0 [ 135.102868] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:30 offine-stand-stor-0 [ 135.127567] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065: Maximum number of peer devices = 7 Mar 17 01:54:30 offine-stand-stor-0 [ 135.130310] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:30 offine-stand-stor-0 [ 135.155500] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4: Method to ensure write ordering: flush Mar 17 01:54:30 offine-stand-stor-0 [ 135.157037] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-1: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:30 offine-stand-stor-0 [ 135.157534] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:30 offine-stand-stor-0 [ 135.159431] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-4: Preparing remote state change 1483652574 Mar 17 01:54:30 offine-stand-stor-0 [ 135.160002] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:30 offine-stand-stor-0 [ 135.162464] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:30 offine-stand-stor-0 [ 135.166136] drbd1065: detected capacity change from 0 to 10491632 Mar 17 01:54:30 offine-stand-stor-0 [ 135.167003] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065: size = 5123 MB (5245816 KB) Mar 17 01:54:30 offine-stand-stor-0 [ 135.173369] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:30 offine-stand-stor-0 [ 135.180003] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065: recounting of set bits took additional 0ms Mar 17 01:54:30 offine-stand-stor-0 [ 135.180679] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:30 offine-stand-stor-0 [ 135.181387] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:30 offine-stand-stor-0 [ 135.183307] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:30 offine-stand-stor-0 [ 135.184162] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065: attached to current UUID: AA7F5109ED3C0C52 Mar 17 01:54:30 offine-stand-stor-0 [ 135.187908] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065: Setting exposed data uuid: AA7F5109ED3C0C52 Mar 17 01:54:30 offine-stand-stor-0 [ 135.189337] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:30 offine-stand-stor-0 [ 135.192635] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:30 offine-stand-stor-0 [ 135.193243] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:30 offine-stand-stor-0 [ 135.195174] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:30 offine-stand-stor-0 [ 135.197695] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:30 offine-stand-stor-0 [ 135.199179] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-5ee4 [10742]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.202429] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-5ee4 [10742]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.204801] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:30 offine-stand-stor-0 [ 135.208193] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:30 offine-stand-stor-0 [ 135.216066] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:30 offine-stand-stor-0 [ 135.224586] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027 offline-stand-stor-2: self D9052551758946D2:0000000000000000:437E0C884845A7A6:0000000000000000 bits:0 flags:0 Mar 17 01:54:30 offine-stand-stor-0 [ 135.224586] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124 offline-stand-stor-2: self A9B853CAD8DC4CEC:0000000000000000:BFA874C19EE380E6:0000000000000000 bits:0 flags:0 Mar 17 01:54:30 offine-stand-stor-0 [ 135.224592] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124 offline-stand-stor-2: peer's exposed UUID: A9B853CAD8DC4CEC Mar 17 01:54:30 offine-stand-stor-0 [ 135.225951] drbd1072: detected capacity change from 0 to 10491632 Mar 17 01:54:30 offine-stand-stor-0 [ 135.225954] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84/0 drbd1072: size = 5123 MB (5245816 KB) Mar 17 01:54:30 offine-stand-stor-0 [ 135.226000] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84/0 drbd1072 offline-stand-stor-2: my exposed UUID: 0000000000000000 Mar 17 01:54:30 offine-stand-stor-0 [ 135.226003] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84/0 drbd1072 offline-stand-stor-2: peer F9C361999ECC2202:0000000000000000:E5DEBFAAE5034182:0000000000000000 bits:0 flags:1120 Mar 17 01:54:30 offine-stand-stor-0 [ 135.226006] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84/0 drbd1072: Setting exposed data uuid: F9C361999ECC2202 Mar 17 01:54:30 offine-stand-stor-0 [ 135.226895] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027 offline-stand-stor-2: peer's exposed UUID: D9052551758946D2 Mar 17 01:54:30 offine-stand-stor-0 [ 135.226949] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611: State change 3184840302: primary_nodes=0, weak_nodes=0 Mar 17 01:54:30 offine-stand-stor-0 [ 135.228048] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-2: Committing remote state change 2969576523 (primary_nodes=0) Mar 17 01:54:30 offine-stand-stor-0 [ 135.228064] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84: susp-io( quorum -> no ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.228066] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.228068] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84/0 drbd1072: quorum( no -> yes ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.228070] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84/0 drbd1072 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.231082] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc: State change 4177658805: primary_nodes=0, weak_nodes=0 Mar 17 01:54:30 offine-stand-stor-0 [ 135.232065] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129 offline-stand-stor-4: drbd_sync_handshake: Mar 17 01:54:30 offine-stand-stor-0 [ 135.232151] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129 offline-stand-stor-4: self 664724BD5E7F963A:0000000000000000:9A29777BF115636A:0000000000000000 bits:0 flags:20 Mar 17 01:54:30 offine-stand-stor-0 [ 135.232216] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129 offline-stand-stor-4: peer 664724BD5E7F963A:0000000000000000:3FAB0D7E1A1A5DC0:AA882500E35C61D8 bits:0 flags:1120 Mar 17 01:54:30 offine-stand-stor-0 [ 135.232282] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129 offline-stand-stor-4: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:30 offine-stand-stor-0 [ 135.234176] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-1: Preparing remote state change 1291459557 Mar 17 01:54:30 offine-stand-stor-0 [ 135.234285] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611: Committing cluster-wide state change 3184840302 (196ms) Mar 17 01:54:30 offine-stand-stor-0 [ 135.234334] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.234337] drbd pvc-570466ff-b5b4-427b-b7c6-0705694ac611/0 drbd1027 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.236402] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc: Committing cluster-wide state change 4177658805 (196ms) Mar 17 01:54:30 offine-stand-stor-0 [ 135.245819] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-4: Rejecting concurrent remote state change 2243263092 because of state change 1291459557 Mar 17 01:54:30 offine-stand-stor-0 [ 135.256566] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-4: Committing remote state change 1483652574 (primary_nodes=0) Mar 17 01:54:30 offine-stand-stor-0 [ 135.257626] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.257861] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-3: Preparing remote state change 3657090998 Mar 17 01:54:30 offine-stand-stor-0 [ 135.309393] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd: susp-io( quorum -> no ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.310878] drbd pvc-5759ad02-7c80-4da8-b793-e6b2f037d9dc/0 drbd1124 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.334594] drbd pvc-5fa1f16e-919d-4427-9b06-7ed00b4a6d5f: Starting worker thread (from drbdsetup [10798]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.336495] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.341396] drbd pvc-5fa1f16e-919d-4427-9b06-7ed00b4a6d5f offline-stand-stor-1: Starting sender thread (from drbdsetup [10803]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.381609] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129: quorum( no -> yes ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.381653] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-3: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:30 offine-stand-stor-0 [ 135.381656] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:30 offine-stand-stor-0 [ 135.385373] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:30 offine-stand-stor-0 [ 135.432147] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.433569] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:30 offine-stand-stor-0 [ 135.433572] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:30 offine-stand-stor-0 [ 135.437036] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129 offline-stand-stor-4: cleared bm UUID and bitmap 664724BD5E7F963A:0000000000000000:9A29777BF115636A:0000000000000000 Mar 17 01:54:30 offine-stand-stor-0 [ 135.440569] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f: Preparing cluster-wide state change 1194802330 (0->1 499/146) Mar 17 01:54:30 offine-stand-stor-0 [ 135.455508] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:30 offine-stand-stor-0 [ 135.491763] drbd1122: detected capacity change from 0 to 10491632 Mar 17 01:54:30 offine-stand-stor-0 [ 135.491879] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd: Preparing cluster-wide state change 2345489025 (1->2 499/146) Mar 17 01:54:30 offine-stand-stor-0 [ 135.492729] drbd pvc-5fa1f16e-919d-4427-9b06-7ed00b4a6d5f/0 drbd1079: meta-data IO uses: blk-bio Mar 17 01:54:30 offine-stand-stor-0 [ 135.493904] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448/0 drbd1122: size = 5123 MB (5245816 KB) Mar 17 01:54:30 offine-stand-stor-0 [ 135.507888] drbd pvc-5fa1f16e-919d-4427-9b06-7ed00b4a6d5f/0 drbd1079: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:30 offine-stand-stor-0 [ 135.507896] drbd pvc-5fa1f16e-919d-4427-9b06-7ed00b4a6d5f/0 drbd1079: Maximum number of peer devices = 7 Mar 17 01:54:30 offine-stand-stor-0 [ 135.522369] drbd pvc-5fa1f16e-919d-4427-9b06-7ed00b4a6d5f: Method to ensure write ordering: flush Mar 17 01:54:30 offine-stand-stor-0 [ 135.523380] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448/0 drbd1122 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:30 offine-stand-stor-0 [ 135.524978] drbd pvc-5fa1f16e-919d-4427-9b06-7ed00b4a6d5f/0 drbd1079: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:30 offine-stand-stor-0 [ 135.525040] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84/0 drbd1072 offline-stand-stor-3: my exposed UUID: F9C361999ECC2202 Mar 17 01:54:30 offine-stand-stor-0 [ 135.525044] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84/0 drbd1072 offline-stand-stor-3: peer F9C361999ECC2202:F9C361999ECC2202:68E3D79C4AAA1A76:0000000000000000 bits:0 flags:1120 Mar 17 01:54:30 offine-stand-stor-0 [ 135.526287] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448/0 drbd1122 offline-stand-stor-1: peer B70C316676A29C2C:0000000000000000:85467AB5B15FE4BC:0000000000000000 bits:0 flags:1120 Mar 17 01:54:30 offine-stand-stor-0 [ 135.529099] drbd pvc-5fa1f16e-919d-4427-9b06-7ed00b4a6d5f/0 drbd1079: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:30 offine-stand-stor-0 [ 135.529445] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448/0 drbd1122: Setting exposed data uuid: B70C316676A29C2C Mar 17 01:54:30 offine-stand-stor-0 [ 135.530733] drbd1079: detected capacity change from 0 to 10491632 Mar 17 01:54:30 offine-stand-stor-0 [ 135.532060] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448/0 drbd1122 offline-stand-stor-4: my exposed UUID: B70C316676A29C2C Mar 17 01:54:30 offine-stand-stor-0 [ 135.533176] drbd pvc-5fa1f16e-919d-4427-9b06-7ed00b4a6d5f/0 drbd1079: size = 5123 MB (5245816 KB) Mar 17 01:54:30 offine-stand-stor-0 [ 135.535555] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448/0 drbd1122 offline-stand-stor-4: peer B70C316676A29C2C:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:30 offine-stand-stor-0 [ 135.545771] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-3: Committing remote state change 3657090998 (primary_nodes=0) Mar 17 01:54:30 offine-stand-stor-0 [ 135.545815] drbd pvc-5fa1f16e-919d-4427-9b06-7ed00b4a6d5f/0 drbd1079: recounting of set bits took additional 0ms Mar 17 01:54:30 offine-stand-stor-0 [ 135.545921] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-1: Aborting remote state change 1291459557 Mar 17 01:54:30 offine-stand-stor-0 [ 135.548446] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.550110] drbd pvc-5fa1f16e-919d-4427-9b06-7ed00b4a6d5f/0 drbd1079: disk( Attaching -> Inconsistent ) [attach] Mar 17 01:54:30 offine-stand-stor-0 [ 135.551497] drbd pvc-59037bb7-37f1-45c0-ae58-1299ac413e84/0 drbd1072 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.553536] drbd pvc-5fa1f16e-919d-4427-9b06-7ed00b4a6d5f/0 drbd1079: attached to current UUID: 55A39C16587916E2 Mar 17 01:54:30 offine-stand-stor-0 [ 135.560492] drbd pvc-5fa1f16e-919d-4427-9b06-7ed00b4a6d5f offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:30 offine-stand-stor-0 [ 135.580614] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:30 offine-stand-stor-0 [ 135.581870] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021 offline-stand-stor-3: self 66983858224E6878:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:20 Mar 17 01:54:30 offine-stand-stor-0 [ 135.584323] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021 offline-stand-stor-3: peer 66983858224E6878:0000000000000000:20850D6C3A244B44:DE5463EF671444DC bits:0 flags:1120 Mar 17 01:54:30 offine-stand-stor-0 [ 135.586854] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:30 offine-stand-stor-0 [ 135.589388] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f: State change 1194802330: primary_nodes=0, weak_nodes=0 Mar 17 01:54:30 offine-stand-stor-0 [ 135.591174] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f: Committing cluster-wide state change 1194802330 (148ms) Mar 17 01:54:30 offine-stand-stor-0 [ 135.591454] drbd pvc-5fa1f16e-919d-4427-9b06-7ed00b4a6d5f offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-5fa1 [10799]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.592624] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f: susp-io( quorum -> no ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.594701] drbd pvc-5fa1f16e-919d-4427-9b06-7ed00b4a6d5f offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:30 offine-stand-stor-0 [ 135.596712] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.598156] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129 offline-stand-stor-1: self 664724BD5E7F963A:0000000000000000:9A29777BF115636A:0000000000000000 bits:0 flags:0 Mar 17 01:54:30 offine-stand-stor-0 [ 135.598286] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129 offline-stand-stor-1: peer's exposed UUID: 664724BD5E7F963A Mar 17 01:54:30 offine-stand-stor-0 [ 135.600132] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd: State change 2345489025: primary_nodes=0, weak_nodes=0 Mar 17 01:54:30 offine-stand-stor-0 [ 135.600326] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd: Committing cluster-wide state change 2345489025 (104ms) Mar 17 01:54:30 offine-stand-stor-0 [ 135.602370] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.603765] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021: quorum( no -> yes ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.603769] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.603883] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021 offline-stand-stor-3: cleared bm UUID and bitmap 66983858224E6878:0000000000000000:0000000000000000:0000000000000000 Mar 17 01:54:30 offine-stand-stor-0 [ 135.619335] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f: Starting worker thread (from drbdsetup [10834]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.648242] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-2: Starting sender thread (from drbdsetup [10839]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.654954] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-3: Starting sender thread (from drbdsetup [10841]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.655967] drbd pvc-5b1fc02d-5bcb-444f-9f2d-dbfa428337dd/0 drbd1129 offline-stand-stor-1: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.658364] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f: Preparing cluster-wide state change 2085367133 (0->2 499/146) Mar 17 01:54:30 offine-stand-stor-0 [ 135.715394] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036: meta-data IO uses: blk-bio Mar 17 01:54:30 offine-stand-stor-0 [ 135.718070] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f: susp-io( no -> quorum ) [attach] Mar 17 01:54:30 offine-stand-stor-0 [ 135.719673] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:30 offine-stand-stor-0 [ 135.721199] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036: Maximum number of peer devices = 7 Mar 17 01:54:30 offine-stand-stor-0 [ 135.723869] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f: Method to ensure write ordering: flush Mar 17 01:54:30 offine-stand-stor-0 [ 135.725847] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:30 offine-stand-stor-0 [ 135.727679] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:30 offine-stand-stor-0 [ 135.728871] drbd1036: detected capacity change from 0 to 10491632 Mar 17 01:54:30 offine-stand-stor-0 [ 135.730100] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036: size = 5123 MB (5245816 KB) Mar 17 01:54:30 offine-stand-stor-0 [ 135.736711] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:30 offine-stand-stor-0 [ 135.738834] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:30 offine-stand-stor-0 [ 135.742011] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:30 offine-stand-stor-0 [ 135.743381] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036: recounting of set bits took additional 0ms Mar 17 01:54:30 offine-stand-stor-0 [ 135.744046] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:30 offine-stand-stor-0 [ 135.745071] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:30 offine-stand-stor-0 [ 135.747882] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036: attached to current UUID: 32B95DB1EDA92EBC Mar 17 01:54:30 offine-stand-stor-0 [ 135.748197] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:30 offine-stand-stor-0 [ 135.748861] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036: Setting exposed data uuid: 32B95DB1EDA92EBC Mar 17 01:54:30 offine-stand-stor-0 [ 135.751372] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:30 offine-stand-stor-0 [ 135.751693] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021 offline-stand-stor-2: self 66983858224E6878:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:0 Mar 17 01:54:30 offine-stand-stor-0 [ 135.753240] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-60dc [10835]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.754365] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:30 offine-stand-stor-0 [ 135.754773] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021 offline-stand-stor-2: peer's exposed UUID: 66983858224E6878 Mar 17 01:54:30 offine-stand-stor-0 [ 135.756935] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:30 offine-stand-stor-0 [ 135.757624] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:30 offine-stand-stor-0 [ 135.757647] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-60dc [10835]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.758882] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f: State change 2085367133: primary_nodes=0, weak_nodes=0 Mar 17 01:54:30 offine-stand-stor-0 [ 135.761218] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:30 offine-stand-stor-0 [ 135.762432] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4: Preparing cluster-wide state change 2140863277 (1->2 499/146) Mar 17 01:54:30 offine-stand-stor-0 [ 135.762500] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f: Committing cluster-wide state change 2085367133 (104ms) Mar 17 01:54:30 offine-stand-stor-0 [ 135.767077] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-1: Preparing remote state change 2985558124 Mar 17 01:54:30 offine-stand-stor-0 [ 135.767771] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.775951] drbd pvc-5d492198-fcd5-4c56-bb56-db5c9f37248f/0 drbd1021 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:30 offine-stand-stor-0 [ 135.792076] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: Aborting local state change 2140863277 to yield to remote state change 3429499965. Mar 17 01:54:30 offine-stand-stor-0 [ 135.796322] drbd pvc-61142752-4847-46e1-beab-29fd57555424: Starting worker thread (from drbdsetup [10868]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.800625] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448/0 drbd1122 offline-stand-stor-1: my exposed UUID: B70C316676A29C2C Mar 17 01:54:30 offine-stand-stor-0 [ 135.801605] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-3: Starting sender thread (from drbdsetup [10873]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.802266] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448/0 drbd1122 offline-stand-stor-1: peer B70C316676A29C2C:0000000000000000:85467AB5B15FE4BC:0000000000000000 bits:0 flags:1120 Mar 17 01:54:30 offine-stand-stor-0 [ 135.807049] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-4: Starting sender thread (from drbdsetup [10875]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.814341] drbd pvc-61142752-4847-46e1-beab-29fd57555424: susp-io( no -> quorum ) [connect] Mar 17 01:54:30 offine-stand-stor-0 [ 135.815484] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:30 offine-stand-stor-0 [ 135.816666] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-6114 [10869]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.817906] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:30 offine-stand-stor-0 [ 135.820312] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-6114 [10869]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.820317] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:30 offine-stand-stor-0 [ 135.825341] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:30 offine-stand-stor-0 [ 135.825380] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065 offline-stand-stor-2: self AA7F5109ED3C0C52:0000000000000000:A857EECF53B907E2:0000000000000000 bits:0 flags:0 Mar 17 01:54:30 offine-stand-stor-0 [ 135.827863] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-4: Rejecting concurrent remote state change 1864095738 because of state change 2985558124 Mar 17 01:54:30 offine-stand-stor-0 [ 135.831694] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065 offline-stand-stor-2: peer's exposed UUID: AA7F5109ED3C0C52 Mar 17 01:54:30 offine-stand-stor-0 [ 135.835021] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-1: Committing remote state change 2985558124 (primary_nodes=0) Mar 17 01:54:30 offine-stand-stor-0 [ 135.839142] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4: Aborting cluster-wide state change 2140863277 (76ms) rv = -19 Mar 17 01:54:30 offine-stand-stor-0 [ 135.843160] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448: susp-io( quorum -> no ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.843164] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.843167] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448/0 drbd1122: quorum( no -> yes ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.843172] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448/0 drbd1122 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:30 offine-stand-stor-0 [ 135.851883] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: Preparing remote state change 3429499965 Mar 17 01:54:30 offine-stand-stor-0 [ 135.855441] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577: Starting worker thread (from drbdsetup [10890]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.865091] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-1: Starting sender thread (from drbdsetup [10895]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.868705] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448/0 drbd1122 offline-stand-stor-4: my exposed UUID: B70C316676A29C2C Mar 17 01:54:30 offine-stand-stor-0 [ 135.869560] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-2: Starting sender thread (from drbdsetup [10897]) Mar 17 01:54:30 offine-stand-stor-0 [ 135.870779] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448/0 drbd1122 offline-stand-stor-4: peer B70C316676A29C2C:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:31 offine-stand-stor-0 [ 135.884210] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577: susp-io( no -> quorum ) [connect] Mar 17 01:54:31 offine-stand-stor-0 [ 135.885414] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:31 offine-stand-stor-0 [ 135.886654] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-6139 [10891]) Mar 17 01:54:31 offine-stand-stor-0 [ 135.888432] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:31 offine-stand-stor-0 [ 135.888637] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:31 offine-stand-stor-0 [ 135.888647] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065 offline-stand-stor-3: self AA7F5109ED3C0C52:0000000000000000:A857EECF53B907E2:0000000000000000 bits:0 flags:20 Mar 17 01:54:31 offine-stand-stor-0 [ 135.888651] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065 offline-stand-stor-3: peer AA7F5109ED3C0C52:0000000000000000:4A95984E8FA68882:D9911FB274FAC0F4 bits:0 flags:1120 Mar 17 01:54:31 offine-stand-stor-0 [ 135.888654] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:31 offine-stand-stor-0 [ 135.892718] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: Aborting remote state change 3429499965 Mar 17 01:54:31 offine-stand-stor-0 [ 135.894093] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-6139 [10891]) Mar 17 01:54:31 offine-stand-stor-0 [ 135.894167] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:31 offine-stand-stor-0 [ 135.894855] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:31 offine-stand-stor-0 [ 135.913244] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4: Preparing cluster-wide state change 2641701798 (1->2 499/146) Mar 17 01:54:31 offine-stand-stor-0 [ 135.948208] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab: Starting worker thread (from drbdsetup [10920]) Mar 17 01:54:31 offine-stand-stor-0 [ 135.952575] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065 offline-stand-stor-2: self AA7F5109ED3C0C52:0000000000000000:A857EECF53B907E2:0000000000000000 bits:0 flags:0 Mar 17 01:54:31 offine-stand-stor-0 [ 135.954669] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065 offline-stand-stor-2: peer's exposed UUID: AA7F5109ED3C0C52 Mar 17 01:54:31 offine-stand-stor-0 [ 135.957376] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4: State change 2641701798: primary_nodes=0, weak_nodes=0 Mar 17 01:54:31 offine-stand-stor-0 [ 135.958775] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4: Committing cluster-wide state change 2641701798 (44ms) Mar 17 01:54:31 offine-stand-stor-0 [ 135.960473] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:31 offine-stand-stor-0 [ 135.962853] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:31 offine-stand-stor-0 [ 135.975373] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-1: Starting sender thread (from drbdsetup [10925]) Mar 17 01:54:31 offine-stand-stor-0 [ 135.979502] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-4: Starting sender thread (from drbdsetup [10927]) Mar 17 01:54:31 offine-stand-stor-0 [ 135.992283] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: Preparing remote state change 2521352869 Mar 17 01:54:31 offine-stand-stor-0 [ 136.000706] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018: meta-data IO uses: blk-bio Mar 17 01:54:31 offine-stand-stor-0 [ 136.002245] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab: susp-io( no -> quorum ) [attach] Mar 17 01:54:31 offine-stand-stor-0 [ 136.003476] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:31 offine-stand-stor-0 [ 136.004457] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018: Maximum number of peer devices = 7 Mar 17 01:54:31 offine-stand-stor-0 [ 136.006886] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab: Method to ensure write ordering: flush Mar 17 01:54:31 offine-stand-stor-0 [ 136.007923] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018: drbd_bm_resize called with capacity == 4201520 Mar 17 01:54:31 offine-stand-stor-0 [ 136.009176] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018: resync bitmap: bits=525190 words=57449 pages=113 Mar 17 01:54:31 offine-stand-stor-0 [ 136.010174] drbd1018: detected capacity change from 0 to 4201520 Mar 17 01:54:31 offine-stand-stor-0 [ 136.011106] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018: size = 2052 MB (2100760 KB) Mar 17 01:54:31 offine-stand-stor-0 [ 136.012932] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018: recounting of set bits took additional 0ms Mar 17 01:54:31 offine-stand-stor-0 [ 136.013870] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:31 offine-stand-stor-0 [ 136.014839] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018: attached to current UUID: 1F999BE9AC02FE8C Mar 17 01:54:31 offine-stand-stor-0 [ 136.015730] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018: Setting exposed data uuid: 1F999BE9AC02FE8C Mar 17 01:54:31 offine-stand-stor-0 [ 136.019937] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:31 offine-stand-stor-0 [ 136.022397] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-61f4 [10921]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.022420] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:31 offine-stand-stor-0 [ 136.025404] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-61f4 [10921]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.025405] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:31 offine-stand-stor-0 [ 136.029962] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:31 offine-stand-stor-0 [ 136.060614] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:31 offine-stand-stor-0 [ 136.061368] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065 offline-stand-stor-3: self AA7F5109ED3C0C52:0000000000000000:A857EECF53B907E2:0000000000000000 bits:0 flags:20 Mar 17 01:54:31 offine-stand-stor-0 [ 136.062876] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065 offline-stand-stor-3: peer AA7F5109ED3C0C52:0000000000000000:4A95984E8FA68882:D9911FB274FAC0F4 bits:0 flags:1120 Mar 17 01:54:31 offine-stand-stor-0 [ 136.064380] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:31 offine-stand-stor-0 [ 136.065079] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b: Starting worker thread (from drbdsetup [10952]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.070776] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-1: Starting sender thread (from drbdsetup [10957]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.076387] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-4: Starting sender thread (from drbdsetup [10959]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.082438] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b: susp-io( no -> quorum ) [connect] Mar 17 01:54:31 offine-stand-stor-0 [ 136.082640] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: Committing remote state change 2521352869 (primary_nodes=0) Mar 17 01:54:31 offine-stand-stor-0 [ 136.083224] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:31 offine-stand-stor-0 [ 136.084721] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4: susp-io( quorum -> no ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.085532] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-681c [10953]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.086275] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.088554] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:31 offine-stand-stor-0 [ 136.090147] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065: quorum( no -> yes ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.091719] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:31 offine-stand-stor-0 [ 136.092483] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.093334] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-681c [10953]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.095341] drbd pvc-5ee461f2-003b-48f7-8572-992928777ad4/0 drbd1065 offline-stand-stor-3: cleared bm UUID and bitmap AA7F5109ED3C0C52:0000000000000000:A857EECF53B907E2:0000000000000000 Mar 17 01:54:31 offine-stand-stor-0 [ 136.097039] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:31 offine-stand-stor-0 [ 136.123852] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505: Starting worker thread (from drbdsetup [10974]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.128515] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-1: Starting sender thread (from drbdsetup [10979]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.132549] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-4: Starting sender thread (from drbdsetup [10981]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.138724] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505: susp-io( no -> quorum ) [connect] Mar 17 01:54:31 offine-stand-stor-0 [ 136.139848] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:31 offine-stand-stor-0 [ 136.141143] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-6e75 [10975]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.142261] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:31 offine-stand-stor-0 [ 136.144604] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-6e75 [10975]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.144611] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:31 offine-stand-stor-0 [ 136.150762] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:31 offine-stand-stor-0 [ 136.183585] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17: Starting worker thread (from drbdsetup [11004]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.189113] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-1: Starting sender thread (from drbdsetup [11009]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.196763] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-2: Starting sender thread (from drbdsetup [11011]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.218221] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117: meta-data IO uses: blk-bio Mar 17 01:54:31 offine-stand-stor-0 [ 136.225391] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17: susp-io( no -> quorum ) [attach] Mar 17 01:54:31 offine-stand-stor-0 [ 136.226855] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:31 offine-stand-stor-0 [ 136.228097] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117: Maximum number of peer devices = 7 Mar 17 01:54:31 offine-stand-stor-0 [ 136.230491] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17: Method to ensure write ordering: flush Mar 17 01:54:31 offine-stand-stor-0 [ 136.231661] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:31 offine-stand-stor-0 [ 136.233561] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:31 offine-stand-stor-0 [ 136.234742] drbd1117: detected capacity change from 0 to 10491632 Mar 17 01:54:31 offine-stand-stor-0 [ 136.236028] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117: size = 5123 MB (5245816 KB) Mar 17 01:54:31 offine-stand-stor-0 [ 136.255692] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117: recounting of set bits took additional 0ms Mar 17 01:54:31 offine-stand-stor-0 [ 136.256714] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:31 offine-stand-stor-0 [ 136.257669] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117: attached to current UUID: 93D999028EC7A64C Mar 17 01:54:31 offine-stand-stor-0 [ 136.258737] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117: Setting exposed data uuid: 93D999028EC7A64C Mar 17 01:54:31 offine-stand-stor-0 [ 136.262849] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:31 offine-stand-stor-0 [ 136.265673] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-715d [11005]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.266262] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:31 offine-stand-stor-0 [ 136.276964] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-715d [11005]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.281119] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:31 offine-stand-stor-0 [ 136.285013] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-3: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:31 offine-stand-stor-0 [ 136.286420] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:31 offine-stand-stor-0 [ 136.287804] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:31 offine-stand-stor-0 [ 136.290202] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:31 offine-stand-stor-0 [ 136.291437] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:31 offine-stand-stor-0 [ 136.305253] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:31 offine-stand-stor-0 [ 136.306157] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:31 offine-stand-stor-0 [ 136.312576] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f: Preparing cluster-wide state change 2691359173 (1->2 499/146) Mar 17 01:54:31 offine-stand-stor-0 [ 136.341616] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:31 offine-stand-stor-0 [ 136.343066] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:31 offine-stand-stor-0 [ 136.345291] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:31 offine-stand-stor-0 [ 136.349346] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a: Starting worker thread (from drbdsetup [11049]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.355403] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-2: Starting sender thread (from drbdsetup [11054]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.361184] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-3: Starting sender thread (from drbdsetup [11056]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.364558] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:31 offine-stand-stor-0 [ 136.366718] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:31 offine-stand-stor-0 [ 136.382350] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032: meta-data IO uses: blk-bio Mar 17 01:54:31 offine-stand-stor-0 [ 136.382579] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-3: Preparing remote state change 2870269401 Mar 17 01:54:31 offine-stand-stor-0 [ 136.384384] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a: susp-io( no -> quorum ) [attach] Mar 17 01:54:31 offine-stand-stor-0 [ 136.386049] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036 offline-stand-stor-3: self 32B95DB1EDA92EBC:0000000000000000:8664D268D01DADB6:0000000000000000 bits:0 flags:0 Mar 17 01:54:31 offine-stand-stor-0 [ 136.387331] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:31 offine-stand-stor-0 [ 136.426977] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036 offline-stand-stor-3: peer's exposed UUID: 32B95DB1EDA92EBC Mar 17 01:54:31 offine-stand-stor-0 [ 136.428006] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032: Maximum number of peer devices = 7 Mar 17 01:54:31 offine-stand-stor-0 [ 136.428354] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:31 offine-stand-stor-0 [ 136.428356] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:31 offine-stand-stor-0 [ 136.434538] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:31 offine-stand-stor-0 [ 136.435639] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:31 offine-stand-stor-0 [ 136.444731] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-4: Preparing remote state change 3257993824 Mar 17 01:54:31 offine-stand-stor-0 [ 136.450093] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:31 offine-stand-stor-0 [ 136.450096] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:31 offine-stand-stor-0 [ 136.458452] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:31 offine-stand-stor-0 [ 136.472746] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f: State change 2691359173: primary_nodes=0, weak_nodes=0 Mar 17 01:54:31 offine-stand-stor-0 [ 136.475478] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a: Method to ensure write ordering: flush Mar 17 01:54:31 offine-stand-stor-0 [ 136.515829] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-1: Preparing remote state change 2017831699 Mar 17 01:54:31 offine-stand-stor-0 [ 136.515997] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:31 offine-stand-stor-0 [ 136.519359] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:31 offine-stand-stor-0 [ 136.520422] drbd1032: detected capacity change from 0 to 10491632 Mar 17 01:54:31 offine-stand-stor-0 [ 136.520584] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f: Committing cluster-wide state change 2691359173 (208ms) Mar 17 01:54:31 offine-stand-stor-0 [ 136.521663] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032: size = 5123 MB (5245816 KB) Mar 17 01:54:31 offine-stand-stor-0 [ 136.532450] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032: recounting of set bits took additional 0ms Mar 17 01:54:31 offine-stand-stor-0 [ 136.545974] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:31 offine-stand-stor-0 [ 136.546704] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:31 offine-stand-stor-0 [ 136.546707] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032: attached to current UUID: F0A9E98CF8EF7AE0 Mar 17 01:54:31 offine-stand-stor-0 [ 136.546710] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032: Setting exposed data uuid: F0A9E98CF8EF7AE0 Mar 17 01:54:31 offine-stand-stor-0 [ 136.549375] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:31 offine-stand-stor-0 [ 136.552475] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:31 offine-stand-stor-0 [ 136.552479] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:31 offine-stand-stor-0 [ 136.568683] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-4: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:31 offine-stand-stor-0 [ 136.568688] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:31 offine-stand-stor-0 [ 136.573151] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:31 offine-stand-stor-0 [ 136.578449] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-1: Preparing remote state change 445203795 Mar 17 01:54:31 offine-stand-stor-0 [ 136.580578] drbd1118: detected capacity change from 0 to 10491632 Mar 17 01:54:31 offine-stand-stor-0 [ 136.580581] drbd pvc-61142752-4847-46e1-beab-29fd57555424/0 drbd1118: size = 5123 MB (5245816 KB) Mar 17 01:54:31 offine-stand-stor-0 [ 136.580638] drbd pvc-61142752-4847-46e1-beab-29fd57555424/0 drbd1118 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:31 offine-stand-stor-0 [ 136.580641] drbd pvc-61142752-4847-46e1-beab-29fd57555424/0 drbd1118 offline-stand-stor-3: peer 81859D56BBB6DCB8:0000000000000000:19D6FCBD921D13F0:0000000000000000 bits:0 flags:1120 Mar 17 01:54:31 offine-stand-stor-0 [ 136.580645] drbd pvc-61142752-4847-46e1-beab-29fd57555424/0 drbd1118: Setting exposed data uuid: 81859D56BBB6DCB8 Mar 17 01:54:31 offine-stand-stor-0 [ 136.590321] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036 offline-stand-stor-3: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:31 offine-stand-stor-0 [ 136.590336] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448/0 drbd1122 offline-stand-stor-4: my exposed UUID: B70C316676A29C2C Mar 17 01:54:31 offine-stand-stor-0 [ 136.590338] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448/0 drbd1122 offline-stand-stor-4: peer B70C316676A29C2C:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:31 offine-stand-stor-0 [ 136.591865] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-3: Committing remote state change 2870269401 (primary_nodes=0) Mar 17 01:54:31 offine-stand-stor-0 [ 136.592411] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-7247 [11050]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.593614] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:31 offine-stand-stor-0 [ 136.593779] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:31 offine-stand-stor-0 [ 136.593801] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-7247 [11050]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.593949] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:31 offine-stand-stor-0 [ 136.616343] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:31 offine-stand-stor-0 [ 136.616363] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:31 offine-stand-stor-0 [ 136.617283] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:31 offine-stand-stor-0 [ 136.617525] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-2: Preparing remote state change 207564055 Mar 17 01:54:31 offine-stand-stor-0 [ 136.617864] drbd pvc-61142752-4847-46e1-beab-29fd57555424: susp-io( quorum -> no ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.617867] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.617869] drbd pvc-61142752-4847-46e1-beab-29fd57555424/0 drbd1118: quorum( no -> yes ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.617871] drbd pvc-61142752-4847-46e1-beab-29fd57555424/0 drbd1118 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.620051] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:31 offine-stand-stor-0 [ 136.622316] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-4: Preparing remote state change 951035341 Mar 17 01:54:31 offine-stand-stor-0 [ 136.623691] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-4: Committing remote state change 3257993824 (primary_nodes=0) Mar 17 01:54:31 offine-stand-stor-0 [ 136.623701] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.623705] drbd pvc-5b37afc8-eea2-4031-a930-26dff2b81448/0 drbd1122 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.629131] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:31 offine-stand-stor-0 [ 136.640588] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-1: Preparing remote state change 3978873758 Mar 17 01:54:31 offine-stand-stor-0 [ 136.641755] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:31 offine-stand-stor-0 [ 136.648570] drbd1093: detected capacity change from 0 to 10491632 Mar 17 01:54:31 offine-stand-stor-0 [ 136.648612] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-1: drbd_sync_handshake: Mar 17 01:54:31 offine-stand-stor-0 [ 136.648645] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-1: self 1F999BE9AC02FE8C:0000000000000000:D5AD40DB88D5E3A4:6C7C486CBAA6237A bits:0 flags:20 Mar 17 01:54:31 offine-stand-stor-0 [ 136.648652] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-1: peer 7FFA14CB8791F5EF:1F999BE9AC02FE8D:BB50651D470C76DC:CB0665B12E9DACBA bits:901 flags:1120 Mar 17 01:54:31 offine-stand-stor-0 [ 136.648656] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-1: uuid_compare()=target-use-bitmap by rule=bitmap-peer Mar 17 01:54:31 offine-stand-stor-0 [ 136.648802] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:31 offine-stand-stor-0 [ 136.648846] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036 offline-stand-stor-2: self 32B95DB1EDA92EBC:0000000000000000:8664D268D01DADB6:0000000000000000 bits:0 flags:20 Mar 17 01:54:31 offine-stand-stor-0 [ 136.648868] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036 offline-stand-stor-2: peer 32B95DB1EDA92EBC:0000000000000000:DA7AC98C8607C67C:2691D60ED319D7FE bits:0 flags:1120 Mar 17 01:54:31 offine-stand-stor-0 [ 136.648932] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:31 offine-stand-stor-0 [ 136.650098] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:31 offine-stand-stor-0 [ 136.652329] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577/0 drbd1093: size = 5123 MB (5245816 KB) Mar 17 01:54:31 offine-stand-stor-0 [ 136.653418] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-1: Committing remote state change 445203795 (primary_nodes=1) Mar 17 01:54:31 offine-stand-stor-0 [ 136.655812] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577/0 drbd1093 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:31 offine-stand-stor-0 [ 136.657979] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab: susp-io( quorum -> no ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.659814] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577/0 drbd1093 offline-stand-stor-1: peer 4B3D9126BDA98B7C:0000000000000000:97965B16F291A910:0000000000000000 bits:0 flags:1120 Mar 17 01:54:31 offine-stand-stor-0 [ 136.661638] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-2: Committing remote state change 207564055 (primary_nodes=0) Mar 17 01:54:31 offine-stand-stor-0 [ 136.661841] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Primary ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.661844] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018: disk( UpToDate -> Outdated ) quorum( no -> yes ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.661847] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> WFBitMapT ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.662032] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f: susp-io( quorum -> no ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.662052] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.662054] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036: quorum( no -> yes ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.662073] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.663698] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577/0 drbd1093: Setting exposed data uuid: 4B3D9126BDA98B7C Mar 17 01:54:31 offine-stand-stor-0 [ 136.664711] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018: Setting exposed data uuid: 7FFA14CB8791F5EE Mar 17 01:54:31 offine-stand-stor-0 [ 136.665189] drbd pvc-61142752-4847-46e1-beab-29fd57555424/0 drbd1118 offline-stand-stor-4: my exposed UUID: 81859D56BBB6DCB8 Mar 17 01:54:31 offine-stand-stor-0 [ 136.665193] drbd pvc-61142752-4847-46e1-beab-29fd57555424/0 drbd1118 offline-stand-stor-4: peer 81859D56BBB6DCB8:0000000000000000:4B89430809108512:0000000000000000 bits:0 flags:1120 Mar 17 01:54:31 offine-stand-stor-0 [ 136.665195] drbd pvc-60dcb94a-1808-407b-a62f-ab456da83e9f/0 drbd1036 offline-stand-stor-2: cleared bm UUID and bitmap 32B95DB1EDA92EBC:0000000000000000:8664D268D01DADB6:0000000000000000 Mar 17 01:54:31 offine-stand-stor-0 [ 136.668666] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-1: Committing remote state change 2017831699 (primary_nodes=0) Mar 17 01:54:31 offine-stand-stor-0 [ 136.670461] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab: Preparing cluster-wide state change 1864099915 (1->2 499/146) Mar 17 01:54:31 offine-stand-stor-0 [ 136.670546] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833: Starting worker thread (from drbdsetup [11096]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.672022] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577: susp-io( quorum -> no ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.676058] drbd1115: detected capacity change from 0 to 10491632 Mar 17 01:54:31 offine-stand-stor-0 [ 136.676349] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.677297] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b/0 drbd1115: size = 5123 MB (5245816 KB) Mar 17 01:54:31 offine-stand-stor-0 [ 136.679250] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577/0 drbd1093: quorum( no -> yes ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.680311] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:31 offine-stand-stor-0 [ 136.680314] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:31 offine-stand-stor-0 [ 136.680973] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b/0 drbd1115 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:31 offine-stand-stor-0 [ 136.681358] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-1: Starting sender thread (from drbdsetup [11101]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.682437] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-2: Starting sender thread (from drbdsetup [11103]) Mar 17 01:54:31 offine-stand-stor-0 [ 136.683022] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577/0 drbd1093 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.684132] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:31 offine-stand-stor-0 [ 136.684391] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:31 offine-stand-stor-0 [ 136.684394] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:31 offine-stand-stor-0 [ 136.684751] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b/0 drbd1115 offline-stand-stor-1: peer 4EF08A2B96AA5CCC:0000000000000000:0F803100CF5031D0:0000000000000000 bits:0 flags:1120 Mar 17 01:54:31 offine-stand-stor-0 [ 136.685711] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-2: Preparing remote state change 3339158658 Mar 17 01:54:31 offine-stand-stor-0 [ 136.687422] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b/0 drbd1115: Setting exposed data uuid: 4EF08A2B96AA5CCC Mar 17 01:54:31 offine-stand-stor-0 [ 136.688973] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:31 offine-stand-stor-0 [ 136.693979] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-4: Committing remote state change 951035341 (primary_nodes=0) Mar 17 01:54:31 offine-stand-stor-0 [ 136.694882] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-1: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 36(1), total 36; compression: 100.0% Mar 17 01:54:31 offine-stand-stor-0 [ 136.695207] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-1: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 36(1), total 36; compression: 100.0% Mar 17 01:54:31 offine-stand-stor-0 [ 136.696427] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-1: Preparing remote state change 88210913 Mar 17 01:54:31 offine-stand-stor-0 [ 136.699581] drbd pvc-61142752-4847-46e1-beab-29fd57555424 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.699591] drbd pvc-61142752-4847-46e1-beab-29fd57555424/0 drbd1118 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.739770] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-1: Committing remote state change 3978873758 (primary_nodes=0) Mar 17 01:54:31 offine-stand-stor-0 [ 136.740357] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130: meta-data IO uses: blk-bio Mar 17 01:54:31 offine-stand-stor-0 [ 136.741826] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b: susp-io( quorum -> no ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.741829] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.741831] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b/0 drbd1115: quorum( no -> yes ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.741833] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b/0 drbd1115 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.758657] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-4: Preparing remote state change 1107989426 Mar 17 01:54:31 offine-stand-stor-0 [ 136.758740] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577/0 drbd1093 offline-stand-stor-2: my exposed UUID: 4B3D9126BDA98B7C Mar 17 01:54:31 offine-stand-stor-0 [ 136.797045] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577/0 drbd1093 offline-stand-stor-2: peer 4B3D9126BDA98B7C:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:31 offine-stand-stor-0 [ 136.799617] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833: susp-io( no -> quorum ) [attach] Mar 17 01:54:31 offine-stand-stor-0 [ 136.800591] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-4: self 1F999BE9AC02FE8C:27E30F1C4AE6BE96:D5AD40DB88D5E3A4:6C7C486CBAA6237A bits:0 flags:0 Mar 17 01:54:31 offine-stand-stor-0 [ 136.801080] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:31 offine-stand-stor-0 [ 136.803503] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-4: peer's exposed UUID: 7FFA14CB8791F5EE Mar 17 01:54:31 offine-stand-stor-0 [ 136.804685] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130: Maximum number of peer devices = 7 Mar 17 01:54:31 offine-stand-stor-0 [ 136.806756] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab: State change 1864099915: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFF8 Mar 17 01:54:31 offine-stand-stor-0 [ 136.808923] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833: Method to ensure write ordering: flush Mar 17 01:54:31 offine-stand-stor-0 [ 136.810101] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab: Committing cluster-wide state change 1864099915 (140ms) Mar 17 01:54:31 offine-stand-stor-0 [ 136.812032] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:31 offine-stand-stor-0 [ 136.813711] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:31 offine-stand-stor-0 [ 136.813717] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-4: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:31 offine-stand-stor-0 [ 136.820606] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:31 offine-stand-stor-0 [ 136.820669] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:31 offine-stand-stor-0 [ 136.820672] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:31 offine-stand-stor-0 [ 136.823493] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-2: Committing remote state change 3339158658 (primary_nodes=0) Mar 17 01:54:31 offine-stand-stor-0 [ 136.825490] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:31 offine-stand-stor-0 [ 136.825554] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:31 offine-stand-stor-0 [ 136.828719] drbd1057: detected capacity change from 0 to 10491632 Mar 17 01:54:31 offine-stand-stor-0 [ 136.830150] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.831885] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505/0 drbd1057: size = 5123 MB (5245816 KB) Mar 17 01:54:31 offine-stand-stor-0 [ 136.833255] drbd pvc-61391028-daa3-4e5a-9af9-b00c7cd8d577/0 drbd1093 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.833300] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:31 offine-stand-stor-0 [ 136.834344] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:31 offine-stand-stor-0 [ 136.835972] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505/0 drbd1057 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:31 offine-stand-stor-0 [ 136.837298] drbd1130: detected capacity change from 0 to 10491632 Mar 17 01:54:31 offine-stand-stor-0 [ 136.837301] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130: size = 5123 MB (5245816 KB) Mar 17 01:54:31 offine-stand-stor-0 [ 136.840560] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17: Preparing cluster-wide state change 4153354240 (1->2 499/146) Mar 17 01:54:31 offine-stand-stor-0 [ 136.840940] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505/0 drbd1057 offline-stand-stor-1: peer AE46F229AAAF4F28:0000000000000000:E10ACB9977D1CC2A:0000000000000000 bits:0 flags:1120 Mar 17 01:54:31 offine-stand-stor-0 [ 136.843325] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-1: Aborting local state change 4153354240 to yield to remote state change 3779921023. Mar 17 01:54:31 offine-stand-stor-0 [ 136.844044] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b/0 drbd1115 offline-stand-stor-4: my exposed UUID: 4EF08A2B96AA5CCC Mar 17 01:54:31 offine-stand-stor-0 [ 136.844048] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b/0 drbd1115 offline-stand-stor-4: peer 4EF08A2B96AA5CCC:0000000000000000:0097B099B9580BD6:0000000000000000 bits:0 flags:1120 Mar 17 01:54:31 offine-stand-stor-0 [ 136.844426] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505/0 drbd1057: Setting exposed data uuid: AE46F229AAAF4F28 Mar 17 01:54:31 offine-stand-stor-0 [ 136.860907] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-4: Committing remote state change 1107989426 (primary_nodes=0) Mar 17 01:54:31 offine-stand-stor-0 [ 136.861907] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130: recounting of set bits took additional 4ms Mar 17 01:54:31 offine-stand-stor-0 [ 136.862436] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.862439] drbd pvc-681cb3d2-95ca-4328-8f71-7dd4c405817b/0 drbd1115 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.863944] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-1: Committing remote state change 88210913 (primary_nodes=0) Mar 17 01:54:31 offine-stand-stor-0 [ 136.865056] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:31 offine-stand-stor-0 [ 136.866047] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505: susp-io( quorum -> no ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.868171] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130: attached to current UUID: 65A52EDB43248612 Mar 17 01:54:31 offine-stand-stor-0 [ 136.870646] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:31 offine-stand-stor-0 [ 136.872732] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130: Setting exposed data uuid: 65A52EDB43248612 Mar 17 01:54:31 offine-stand-stor-0 [ 136.874270] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505/0 drbd1057: quorum( no -> yes ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 136.877509] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 136.879179] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505/0 drbd1057 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 136.881627] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 136.882757] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-72b3 [11097]) Mar 17 01:54:32 offine-stand-stor-0 [ 136.896615] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018: disk( Outdated -> Inconsistent ) [postponed-resync] Mar 17 01:54:32 offine-stand-stor-0 [ 136.914340] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-4: resync-susp( no -> connection dependency ) [postponed-resync] Mar 17 01:54:32 offine-stand-stor-0 [ 136.916877] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-1: repl( WFBitMapT -> SyncTarget ) [postponed-resync] Mar 17 01:54:32 offine-stand-stor-0 [ 136.919555] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 136.919666] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-4: Preparing remote state change 1913950258 Mar 17 01:54:32 offine-stand-stor-0 [ 136.919966] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba: Starting worker thread (from drbdsetup [11130]) Mar 17 01:54:32 offine-stand-stor-0 [ 136.920043] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-1: Began resync as SyncTarget (will sync 3604 KB [901 bits set]). Mar 17 01:54:32 offine-stand-stor-0 [ 136.921554] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-72b3 [11097]) Mar 17 01:54:32 offine-stand-stor-0 [ 136.923240] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 136.935990] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-2: Starting sender thread (from drbdsetup [11137]) Mar 17 01:54:32 offine-stand-stor-0 [ 136.939919] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-3: Starting sender thread (from drbdsetup [11139]) Mar 17 01:54:32 offine-stand-stor-0 [ 136.950427] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba: susp-io( no -> quorum ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 136.952096] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 136.952660] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505/0 drbd1057 offline-stand-stor-4: my exposed UUID: AE46F229AAAF4F28 Mar 17 01:54:32 offine-stand-stor-0 [ 136.953764] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-78e9 [11132]) Mar 17 01:54:32 offine-stand-stor-0 [ 136.955141] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505/0 drbd1057 offline-stand-stor-4: peer AE46F229AAAF4F28:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:32 offine-stand-stor-0 [ 136.955774] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 136.964750] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 136.964763] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-78e9 [11132]) Mar 17 01:54:32 offine-stand-stor-0 [ 136.970771] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 136.977970] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-1: Resync done (total 1 sec; paused 0 sec; 3604 K/sec) Mar 17 01:54:32 offine-stand-stor-0 [ 136.980480] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-1: updated UUIDs 7FFA14CB8791F5EE:0000000000000000:D5AD40DB88D5E3A4:6C7C486CBAA6237A Mar 17 01:54:32 offine-stand-stor-0 [ 136.982949] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018: disk( Inconsistent -> UpToDate ) [resync-finished] Mar 17 01:54:32 offine-stand-stor-0 [ 136.984026] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-4: resync-susp( connection dependency -> no ) [resync-finished] Mar 17 01:54:32 offine-stand-stor-0 [ 136.986613] drbd pvc-61f4db05-5ee6-43af-82d1-0ce695149aab/0 drbd1018 offline-stand-stor-1: repl( SyncTarget -> Established ) [resync-finished] Mar 17 01:54:32 offine-stand-stor-0 [ 137.002314] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-4: Committing remote state change 1913950258 (primary_nodes=0) Mar 17 01:54:32 offine-stand-stor-0 [ 137.006970] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.011418] drbd pvc-6e75a3ca-40a0-4eaf-b989-c7b4a45c8505/0 drbd1057 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.015482] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2: Starting worker thread (from drbdsetup [11162]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.030557] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-1: Starting sender thread (from drbdsetup [11167]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.037460] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-2: Starting sender thread (from drbdsetup [11169]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.059065] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133: meta-data IO uses: blk-bio Mar 17 01:54:32 offine-stand-stor-0 [ 137.061315] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2: susp-io( no -> quorum ) [attach] Mar 17 01:54:32 offine-stand-stor-0 [ 137.062951] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:32 offine-stand-stor-0 [ 137.064804] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133: Maximum number of peer devices = 7 Mar 17 01:54:32 offine-stand-stor-0 [ 137.068071] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2: Method to ensure write ordering: flush Mar 17 01:54:32 offine-stand-stor-0 [ 137.070599] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:32 offine-stand-stor-0 [ 137.073278] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:32 offine-stand-stor-0 [ 137.075167] drbd1133: detected capacity change from 0 to 10491632 Mar 17 01:54:32 offine-stand-stor-0 [ 137.077150] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133: size = 5123 MB (5245816 KB) Mar 17 01:54:32 offine-stand-stor-0 [ 137.088126] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133: recounting of set bits took additional 0ms Mar 17 01:54:32 offine-stand-stor-0 [ 137.089272] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:32 offine-stand-stor-0 [ 137.090588] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133: attached to current UUID: 65C3BD5856517EDC Mar 17 01:54:32 offine-stand-stor-0 [ 137.091544] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133: Setting exposed data uuid: 65C3BD5856517EDC Mar 17 01:54:32 offine-stand-stor-0 [ 137.094906] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.097113] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-7953 [11163]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.098095] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.100453] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.100480] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-7953 [11163]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.105513] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.118036] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:32 offine-stand-stor-0 [ 137.121969] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:32 offine-stand-stor-0 [ 137.139425] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3: Starting worker thread (from drbdsetup [11194]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.142110] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:32 offine-stand-stor-0 [ 137.144351] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-1: Starting sender thread (from drbdsetup [11199]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.146001] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-2: Starting sender thread (from drbdsetup [11201]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.146750] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:32 offine-stand-stor-0 [ 137.149249] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:32 offine-stand-stor-0 [ 137.152426] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3: susp-io( no -> quorum ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.153563] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.154570] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-7b5f [11195]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.157417] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.160367] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.160563] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a: Preparing cluster-wide state change 1419690590 (1->2 499/146) Mar 17 01:54:32 offine-stand-stor-0 [ 137.161756] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-7b5f [11195]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.165709] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.189971] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17: Starting worker thread (from drbdsetup [11217]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.195576] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:32 offine-stand-stor-0 [ 137.195787] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-1: Starting sender thread (from drbdsetup [11222]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.200629] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032 offline-stand-stor-2: self F0A9E98CF8EF7AE0:0000000000000000:3638A7CFCF2225E2:0000000000000000 bits:0 flags:0 Mar 17 01:54:32 offine-stand-stor-0 [ 137.201706] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-4: Starting sender thread (from drbdsetup [11225]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.202999] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032 offline-stand-stor-2: peer's exposed UUID: F0A9E98CF8EF7AE0 Mar 17 01:54:32 offine-stand-stor-0 [ 137.207777] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a: State change 1419690590: primary_nodes=0, weak_nodes=0 Mar 17 01:54:32 offine-stand-stor-0 [ 137.209208] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a: Committing cluster-wide state change 1419690590 (52ms) Mar 17 01:54:32 offine-stand-stor-0 [ 137.209337] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.210440] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:32 offine-stand-stor-0 [ 137.212655] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.213208] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-7d7e [11218]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.213765] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:32 offine-stand-stor-0 [ 137.225820] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-3: Preparing remote state change 1458260852 Mar 17 01:54:32 offine-stand-stor-0 [ 137.229906] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.229916] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-7d7e [11218]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.245507] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f: Starting worker thread (from drbdsetup [11240]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.251147] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.251202] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-3: Starting sender thread (from drbdsetup [11245]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.258996] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-4: Starting sender thread (from drbdsetup [11247]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.265069] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f: susp-io( no -> quorum ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.266328] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.267513] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-8013 [11241]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.269015] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.271200] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.271203] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-8013 [11241]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.276657] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:32 offine-stand-stor-0 [ 137.277982] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.279793] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032 offline-stand-stor-3: self F0A9E98CF8EF7AE0:0000000000000000:3638A7CFCF2225E2:0000000000000000 bits:0 flags:20 Mar 17 01:54:32 offine-stand-stor-0 [ 137.284349] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032 offline-stand-stor-3: peer F0A9E98CF8EF7AE0:0000000000000000:3E6AEFF4620359A4:C71C68BDBA2C2362 bits:0 flags:1120 Mar 17 01:54:32 offine-stand-stor-0 [ 137.286657] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:32 offine-stand-stor-0 [ 137.291364] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-3: Committing remote state change 1458260852 (primary_nodes=0) Mar 17 01:54:32 offine-stand-stor-0 [ 137.293605] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a: susp-io( quorum -> no ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.294656] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.296691] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032: quorum( no -> yes ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.297739] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.299853] drbd pvc-72478eb8-27a1-4550-9778-933633b0125a/0 drbd1032 offline-stand-stor-3: cleared bm UUID and bitmap F0A9E98CF8EF7AE0:0000000000000000:3638A7CFCF2225E2:0000000000000000 Mar 17 01:54:32 offine-stand-stor-0 [ 137.305635] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c: Starting worker thread (from drbdsetup [11262]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.310454] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-3: Starting sender thread (from drbdsetup [11267]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.314459] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-4: Starting sender thread (from drbdsetup [11269]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.320885] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c: susp-io( no -> quorum ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.321963] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.323167] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-8092 [11263]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.324347] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.327412] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-8092 [11263]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.327413] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.336562] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.364556] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17: Aborting cluster-wide state change 4153354240 (528ms) rv = -19 Mar 17 01:54:32 offine-stand-stor-0 [ 137.365571] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600: Starting worker thread (from drbdsetup [11284]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.365904] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-1: Preparing remote state change 3779921023 Mar 17 01:54:32 offine-stand-stor-0 [ 137.371628] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-1: Starting sender thread (from drbdsetup [11289]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.377661] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-4: Starting sender thread (from drbdsetup [11291]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.383632] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600: susp-io( no -> quorum ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.384833] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.386132] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-82ae [11285]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.387712] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.390060] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-82ae [11285]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.390348] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.419566] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba: Starting worker thread (from drbdsetup [11306]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.436609] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.441050] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-2: Starting sender thread (from drbdsetup [11311]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.445198] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117 offline-stand-stor-1: drbd_sync_handshake: Mar 17 01:54:32 offine-stand-stor-0 [ 137.445259] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-4: Starting sender thread (from drbdsetup [11313]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.446406] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117 offline-stand-stor-1: self 93D999028EC7A64C:0000000000000000:A05A5EDD207CDCE4:0000000000000000 bits:0 flags:20 Mar 17 01:54:32 offine-stand-stor-0 [ 137.452178] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117 offline-stand-stor-1: peer 93D999028EC7A64C:0000000000000000:E5606FBF35076E2A:BB61A465D3C82C8E bits:0 flags:1120 Mar 17 01:54:32 offine-stand-stor-0 [ 137.456431] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117 offline-stand-stor-1: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:32 offine-stand-stor-0 [ 137.456660] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba: susp-io( no -> quorum ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.460667] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:32 offine-stand-stor-0 [ 137.460687] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:32 offine-stand-stor-0 [ 137.460708] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:32 offine-stand-stor-0 [ 137.461207] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.462729] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.462751] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-82dc [11307]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.463616] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:32 offine-stand-stor-0 [ 137.465874] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.469240] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-82dc [11307]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.469607] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-1: Committing remote state change 3779921023 (primary_nodes=0) Mar 17 01:54:32 offine-stand-stor-0 [ 137.491787] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:32 offine-stand-stor-0 [ 137.496619] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:32 offine-stand-stor-0 [ 137.496631] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:32 offine-stand-stor-0 [ 137.499105] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82: Starting worker thread (from drbdsetup [11328]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.499105] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833: Preparing cluster-wide state change 566239593 (1->2 499/146) Mar 17 01:54:32 offine-stand-stor-0 [ 137.501575] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17: susp-io( quorum -> no ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.504937] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.506220] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.510438] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:32 offine-stand-stor-0 [ 137.513328] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-1: Starting sender thread (from drbdsetup [11334]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.513340] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117: quorum( no -> yes ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.514769] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-4: Starting sender thread (from drbdsetup [11336]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.517538] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.524106] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-2: Preparing remote state change 715300213 Mar 17 01:54:32 offine-stand-stor-0 [ 137.524642] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82: susp-io( no -> quorum ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.524645] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.525672] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.526320] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117 offline-stand-stor-1: cleared bm UUID and bitmap 93D999028EC7A64C:0000000000000000:A05A5EDD207CDCE4:0000000000000000 Mar 17 01:54:32 offine-stand-stor-0 [ 137.528486] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-82e8 [11330]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.532877] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17: Preparing cluster-wide state change 695404533 (1->2 499/146) Mar 17 01:54:32 offine-stand-stor-0 [ 137.534095] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.534125] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-82e8 [11330]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.537839] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-3: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:32 offine-stand-stor-0 [ 137.539235] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.543279] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:32 offine-stand-stor-0 [ 137.548814] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:32 offine-stand-stor-0 [ 137.561785] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:32 offine-stand-stor-0 [ 137.561920] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130 offline-stand-stor-2: self 65A52EDB43248612:0000000000000000:889A7D00CFB53F9A:0000000000000000 bits:0 flags:0 Mar 17 01:54:32 offine-stand-stor-0 [ 137.562050] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130 offline-stand-stor-2: peer's exposed UUID: 65A52EDB43248612 Mar 17 01:54:32 offine-stand-stor-0 [ 137.562398] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833: State change 566239593: primary_nodes=0, weak_nodes=0 Mar 17 01:54:32 offine-stand-stor-0 [ 137.562529] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833: Committing cluster-wide state change 566239593 (64ms) Mar 17 01:54:32 offine-stand-stor-0 [ 137.563141] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:32 offine-stand-stor-0 [ 137.564973] drbd1080: detected capacity change from 0 to 10491632 Mar 17 01:54:32 offine-stand-stor-0 [ 137.564976] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba/0 drbd1080: size = 5123 MB (5245816 KB) Mar 17 01:54:32 offine-stand-stor-0 [ 137.565018] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba/0 drbd1080 offline-stand-stor-2: my exposed UUID: 0000000000000000 Mar 17 01:54:32 offine-stand-stor-0 [ 137.565021] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba/0 drbd1080 offline-stand-stor-2: peer A02371887C9F20CE:618C00AC0542C30A:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:32 offine-stand-stor-0 [ 137.565031] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba/0 drbd1080: Setting exposed data uuid: A02371887C9F20CE Mar 17 01:54:32 offine-stand-stor-0 [ 137.571767] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52: Starting worker thread (from drbdsetup [11354]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.609556] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:32 offine-stand-stor-0 [ 137.617633] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-2: Starting sender thread (from drbdsetup [11359]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.640554] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117 offline-stand-stor-2: self 93D999028EC7A64C:0000000000000000:A05A5EDD207CDCE4:0000000000000000 bits:0 flags:0 Mar 17 01:54:32 offine-stand-stor-0 [ 137.643106] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-2: Committing remote state change 715300213 (primary_nodes=0) Mar 17 01:54:32 offine-stand-stor-0 [ 137.644275] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117 offline-stand-stor-2: peer's exposed UUID: 93D999028EC7A64C Mar 17 01:54:32 offine-stand-stor-0 [ 137.644668] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:32 offine-stand-stor-0 [ 137.644671] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:32 offine-stand-stor-0 [ 137.644809] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-3: Starting sender thread (from drbdsetup [11361]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.645786] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:32 offine-stand-stor-0 [ 137.645823] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba: susp-io( quorum -> no ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.645826] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.645828] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba/0 drbd1080: quorum( no -> yes ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.645836] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba/0 drbd1080 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.648117] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-3: Preparing remote state change 1442304517 Mar 17 01:54:32 offine-stand-stor-0 [ 137.649177] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52: susp-io( no -> quorum ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.649180] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.649316] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-852c [11355]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.649362] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.649942] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17: State change 695404533: primary_nodes=0, weak_nodes=0 Mar 17 01:54:32 offine-stand-stor-0 [ 137.649946] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17: Committing cluster-wide state change 695404533 (116ms) Mar 17 01:54:32 offine-stand-stor-0 [ 137.650029] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:32 offine-stand-stor-0 [ 137.650645] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.650682] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-852c [11355]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.650743] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.651325] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:32 offine-stand-stor-0 [ 137.652586] drbd pvc-715dd0c0-df07-43a5-905d-89b3549cab17/0 drbd1117 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:32 offine-stand-stor-0 [ 137.656446] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-1: Preparing remote state change 158880760 Mar 17 01:54:32 offine-stand-stor-0 [ 137.672323] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:32 offine-stand-stor-0 [ 137.680825] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:32 offine-stand-stor-0 [ 137.684558] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2: Preparing cluster-wide state change 1273761409 (1->2 499/146) Mar 17 01:54:32 offine-stand-stor-0 [ 137.685115] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46: Starting worker thread (from drbdsetup [11377]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.689045] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:32 offine-stand-stor-0 [ 137.691593] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-3: Starting sender thread (from drbdsetup [11383]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.693747] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-4: Starting sender thread (from drbdsetup [11385]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.694576] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:32 offine-stand-stor-0 [ 137.697967] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:32 offine-stand-stor-0 [ 137.700002] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:32 offine-stand-stor-0 [ 137.700599] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba/0 drbd1080 offline-stand-stor-3: my exposed UUID: A02371887C9F20CE Mar 17 01:54:32 offine-stand-stor-0 [ 137.700603] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba/0 drbd1080 offline-stand-stor-3: peer A02371887C9F20CE:618C00AC0542C30A:618C00AC0542C30A:0000000000000000 bits:0 flags:1120 Mar 17 01:54:32 offine-stand-stor-0 [ 137.701556] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46: susp-io( no -> quorum ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.701567] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.701601] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-853e [11378]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.702143] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:32 offine-stand-stor-0 [ 137.702630] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-3: Committing remote state change 1442304517 (primary_nodes=0) Mar 17 01:54:32 offine-stand-stor-0 [ 137.702638] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.702641] drbd pvc-78e95302-7c83-4aac-b356-f752467237ba/0 drbd1080 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:32 offine-stand-stor-0 [ 137.702875] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:32 offine-stand-stor-0 [ 137.708479] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-1: Aborting local state change 1273761409 to yield to remote state change 3388164175. Mar 17 01:54:32 offine-stand-stor-0 [ 137.708816] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.708853] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-853e [11378]) Mar 17 01:54:32 offine-stand-stor-0 [ 137.710064] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-1: Preparing remote state change 4072989763 Mar 17 01:54:32 offine-stand-stor-0 [ 137.713447] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:32 offine-stand-stor-0 [ 137.720074] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:32 offine-stand-stor-0 [ 137.724047] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130 offline-stand-stor-1: drbd_sync_handshake: Mar 17 01:54:33 offine-stand-stor-0 [ 137.752654] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 137.763055] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb: Starting worker thread (from drbdsetup [11410]) Mar 17 01:54:33 offine-stand-stor-0 [ 137.766978] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-1: Starting sender thread (from drbdsetup [11415]) Mar 17 01:54:33 offine-stand-stor-0 [ 137.767318] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130 offline-stand-stor-1: self 65A52EDB43248612:0000000000000000:889A7D00CFB53F9A:0000000000000000 bits:0 flags:20 Mar 17 01:54:33 offine-stand-stor-0 [ 137.767404] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130 offline-stand-stor-1: peer 65A52EDB43248612:0000000000000000:EB771024969A5E4E:77191F02BDC13034 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 137.769846] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 137.770082] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 137.773250] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-4: Starting sender thread (from drbdsetup [11417]) Mar 17 01:54:33 offine-stand-stor-0 [ 137.784707] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 137.784711] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 137.797388] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 137.797604] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130 offline-stand-stor-1: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:33 offine-stand-stor-0 [ 137.803141] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-1: Preparing remote state change 2454455804 Mar 17 01:54:33 offine-stand-stor-0 [ 137.803255] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-1: Committing remote state change 158880760 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 137.803266] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833: susp-io( quorum -> no ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 137.803269] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 137.803271] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130: quorum( no -> yes ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 137.803274] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 137.803344] drbd pvc-72b300d1-632e-4787-b3ee-f5a3dd4b3833/0 drbd1130 offline-stand-stor-1: cleared bm UUID and bitmap 65A52EDB43248612:0000000000000000:889A7D00CFB53F9A:0000000000000000 Mar 17 01:54:33 offine-stand-stor-0 [ 137.804980] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 137.807548] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 137.807886] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126: meta-data IO uses: blk-bio Mar 17 01:54:33 offine-stand-stor-0 [ 137.809712] drbd1088: detected capacity change from 0 to 10491632 Mar 17 01:54:33 offine-stand-stor-0 [ 137.812642] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 137.812714] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133 offline-stand-stor-2: self 65C3BD5856517EDC:0000000000000000:DD582D17F43B4180:0000000000000000 bits:0 flags:0 Mar 17 01:54:33 offine-stand-stor-0 [ 137.812725] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133 offline-stand-stor-2: peer's exposed UUID: 65C3BD5856517EDC Mar 17 01:54:33 offine-stand-stor-0 [ 137.812734] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2: Aborting cluster-wide state change 1273761409 (132ms) rv = -19 Mar 17 01:54:33 offine-stand-stor-0 [ 137.812777] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-1: Preparing remote state change 3388164175 Mar 17 01:54:33 offine-stand-stor-0 [ 137.813537] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3/0 drbd1088: size = 5123 MB (5245816 KB) Mar 17 01:54:33 offine-stand-stor-0 [ 137.814698] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 137.816981] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 137.817288] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3/0 drbd1088 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:33 offine-stand-stor-0 [ 137.823409] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb: susp-io( no -> quorum ) [attach] Mar 17 01:54:33 offine-stand-stor-0 [ 137.823433] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 137.823450] drbd1012: detected capacity change from 0 to 4201520 Mar 17 01:54:33 offine-stand-stor-0 [ 137.823453] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17/0 drbd1012: size = 2052 MB (2100760 KB) Mar 17 01:54:33 offine-stand-stor-0 [ 137.823570] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17/0 drbd1012 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:33 offine-stand-stor-0 [ 137.823573] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17/0 drbd1012 offline-stand-stor-1: peer 122F405D843E74B4:08271E675A159AA8:9F0F60B8848FF7A6:702CD1A286B214EA bits:0 flags:1100 Mar 17 01:54:33 offine-stand-stor-0 [ 137.823577] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17/0 drbd1012: Setting exposed data uuid: 122F405D843E74B4 Mar 17 01:54:33 offine-stand-stor-0 [ 137.825346] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3/0 drbd1088 offline-stand-stor-1: peer 64886B32B490E9FA:64886B32B490E9FA:4EF68FC27E430C64:C2A453F2FE2D1B7E bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 137.827435] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:33 offine-stand-stor-0 [ 137.829654] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3/0 drbd1088: Setting exposed data uuid: 64886B32B490E9FA Mar 17 01:54:33 offine-stand-stor-0 [ 137.829700] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-4: Preparing remote state change 802273250 Mar 17 01:54:33 offine-stand-stor-0 [ 137.830929] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126: Maximum number of peer devices = 7 Mar 17 01:54:33 offine-stand-stor-0 [ 137.849598] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 137.851607] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb: Method to ensure write ordering: flush Mar 17 01:54:33 offine-stand-stor-0 [ 137.853027] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 137.855187] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133 offline-stand-stor-1: drbd_sync_handshake: Mar 17 01:54:33 offine-stand-stor-0 [ 137.856381] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 137.857729] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133 offline-stand-stor-1: self 65C3BD5856517EDC:0000000000000000:DD582D17F43B4180:0000000000000000 bits:0 flags:20 Mar 17 01:54:33 offine-stand-stor-0 [ 137.857735] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133 offline-stand-stor-1: peer 65C3BD5856517EDC:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 137.857882] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133 offline-stand-stor-1: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:33 offine-stand-stor-0 [ 137.860932] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:33 offine-stand-stor-0 [ 137.862700] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-3: Preparing remote state change 3792226958 Mar 17 01:54:33 offine-stand-stor-0 [ 137.880532] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 137.880561] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 137.884122] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 137.888241] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-1: Committing remote state change 4072989763 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 137.888250] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3: susp-io( quorum -> no ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 137.888252] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 137.888254] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3/0 drbd1088: quorum( no -> yes ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 137.888259] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3/0 drbd1088 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 137.893659] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-2: Preparing remote state change 2487575163 Mar 17 01:54:33 offine-stand-stor-0 [ 137.923614] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:33 offine-stand-stor-0 [ 137.973454] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 137.989345] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-1: Aborting remote state change 3388164175 Mar 17 01:54:33 offine-stand-stor-0 [ 137.989361] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2: Preparing cluster-wide state change 2574412102 (1->2 499/146) Mar 17 01:54:33 offine-stand-stor-0 [ 137.990198] drbd1126: detected capacity change from 0 to 10491632 Mar 17 01:54:33 offine-stand-stor-0 [ 137.993784] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.008685] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 138.010106] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.023249] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126: size = 5123 MB (5245816 KB) Mar 17 01:54:33 offine-stand-stor-0 [ 138.024095] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.029267] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-1: Preparing remote state change 362641727 Mar 17 01:54:33 offine-stand-stor-0 [ 138.031728] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.061278] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 138.062394] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 138.063238] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.064056] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.064549] drbd1110: detected capacity change from 0 to 10491632 Mar 17 01:54:33 offine-stand-stor-0 [ 138.064552] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f/0 drbd1110: size = 5123 MB (5245816 KB) Mar 17 01:54:33 offine-stand-stor-0 [ 138.064619] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f/0 drbd1110 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:33 offine-stand-stor-0 [ 138.064627] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f/0 drbd1110 offline-stand-stor-4: peer F41CEACC32924FFE:0000000000000000:3441650C8960878E:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.064632] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f/0 drbd1110: Setting exposed data uuid: F41CEACC32924FFE Mar 17 01:54:33 offine-stand-stor-0 [ 138.066194] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126: recounting of set bits took additional 0ms Mar 17 01:54:33 offine-stand-stor-0 [ 138.067089] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.068653] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 138.068673] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 138.068675] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.068773] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-2: Preparing remote state change 467860440 Mar 17 01:54:33 offine-stand-stor-0 [ 138.069091] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:33 offine-stand-stor-0 [ 138.069107] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.070292] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.071406] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126: attached to current UUID: FD6B7A1FD0E79F92 Mar 17 01:54:33 offine-stand-stor-0 [ 138.071411] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126: Setting exposed data uuid: FD6B7A1FD0E79F92 Mar 17 01:54:33 offine-stand-stor-0 [ 138.072981] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-4: Committing remote state change 802273250 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 138.073970] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.075447] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.076421] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f: susp-io( quorum -> no ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.080562] drbd1060: detected capacity change from 0 to 10491632 Mar 17 01:54:33 offine-stand-stor-0 [ 138.080993] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.082723] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-4: Preparing remote state change 3168972345 Mar 17 01:54:33 offine-stand-stor-0 [ 138.082757] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c/0 drbd1060: size = 5123 MB (5245816 KB) Mar 17 01:54:33 offine-stand-stor-0 [ 138.085213] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f/0 drbd1110: quorum( no -> yes ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.085217] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f/0 drbd1110 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.085308] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-3: Preparing remote state change 4020326550 Mar 17 01:54:33 offine-stand-stor-0 [ 138.086978] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c/0 drbd1060 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:33 offine-stand-stor-0 [ 138.096573] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133 offline-stand-stor-2: self 65C3BD5856517EDC:0000000000000000:DD582D17F43B4180:0000000000000000 bits:0 flags:0 Mar 17 01:54:33 offine-stand-stor-0 [ 138.096579] drbd1043: detected capacity change from 0 to 10491632 Mar 17 01:54:33 offine-stand-stor-0 [ 138.096588] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600/0 drbd1043: size = 5123 MB (5245816 KB) Mar 17 01:54:33 offine-stand-stor-0 [ 138.096591] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3/0 drbd1088 offline-stand-stor-2: my exposed UUID: 64886B32B490E9FA Mar 17 01:54:33 offine-stand-stor-0 [ 138.096594] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3/0 drbd1088 offline-stand-stor-2: peer 64886B32B490E9FA:4EF68FC27E430C64:69240FC7BCB02E66:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.096612] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600/0 drbd1043 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:33 offine-stand-stor-0 [ 138.096615] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600/0 drbd1043 offline-stand-stor-1: peer 78534BB1EA577CD0:0000000000000000:8222F5918984414E:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.096617] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600/0 drbd1043: Setting exposed data uuid: 78534BB1EA577CD0 Mar 17 01:54:33 offine-stand-stor-0 [ 138.098092] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.098414] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c/0 drbd1060 offline-stand-stor-3: peer ACC98CD62FB7CB92:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.099042] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-2: Committing remote state change 2487575163 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 138.099067] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.099070] drbd pvc-7b5fc30b-2099-415e-9d85-f0e9f89186b3/0 drbd1088 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.099604] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133 offline-stand-stor-2: peer's exposed UUID: 65C3BD5856517EDC Mar 17 01:54:33 offine-stand-stor-0 [ 138.101084] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c/0 drbd1060: Setting exposed data uuid: ACC98CD62FB7CB92 Mar 17 01:54:33 offine-stand-stor-0 [ 138.103472] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2: State change 2574412102: primary_nodes=0, weak_nodes=0 Mar 17 01:54:33 offine-stand-stor-0 [ 138.106505] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-8a86 [11411]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.108337] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2: Committing cluster-wide state change 2574412102 (116ms) Mar 17 01:54:33 offine-stand-stor-0 [ 138.109802] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:33 offine-stand-stor-0 [ 138.109820] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-8a86 [11411]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.109824] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-3: Committing remote state change 3792226958 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 138.109834] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c: susp-io( quorum -> no ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.109837] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.109839] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c/0 drbd1060: quorum( no -> yes ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.109843] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c/0 drbd1060 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.111046] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:33 offine-stand-stor-0 [ 138.112043] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.123472] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50: Starting worker thread (from drbdsetup [11454]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.124949] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:33 offine-stand-stor-0 [ 138.126545] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:33 offine-stand-stor-0 [ 138.127890] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-4: Preparing remote state change 2318255850 Mar 17 01:54:33 offine-stand-stor-0 [ 138.129437] drbd1100: detected capacity change from 0 to 10491632 Mar 17 01:54:33 offine-stand-stor-0 [ 138.129506] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba/0 drbd1100: size = 5123 MB (5245816 KB) Mar 17 01:54:33 offine-stand-stor-0 [ 138.130505] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba/0 drbd1100 offline-stand-stor-2: my exposed UUID: 0000000000000000 Mar 17 01:54:33 offine-stand-stor-0 [ 138.130570] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba/0 drbd1100 offline-stand-stor-2: peer 0FCEF4B3F9CAC3C4:A529955C87BF6A7B:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.130697] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f/0 drbd1110 offline-stand-stor-3: my exposed UUID: F41CEACC32924FFE Mar 17 01:54:33 offine-stand-stor-0 [ 138.130706] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f/0 drbd1110 offline-stand-stor-3: peer F41CEACC32924FFE:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.132689] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-1: Starting sender thread (from drbdsetup [11459]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.158752] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba/0 drbd1100: Setting exposed data uuid: 0FCEF4B3F9CAC3C4 Mar 17 01:54:33 offine-stand-stor-0 [ 138.160116] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-1: Preparing remote state change 3706356758 Mar 17 01:54:33 offine-stand-stor-0 [ 138.161683] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-2: Starting sender thread (from drbdsetup [11461]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.165839] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50: susp-io( no -> quorum ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.165842] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.165884] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-8d94 [11455]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.166033] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:33 offine-stand-stor-0 [ 138.167391] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.167424] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-8d94 [11455]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.167556] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:33 offine-stand-stor-0 [ 138.176697] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-1: Committing remote state change 2454455804 (primary_nodes=2) Mar 17 01:54:33 offine-stand-stor-0 [ 138.176709] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.176713] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17/0 drbd1012 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.179141] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-3: Committing remote state change 4020326550 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 138.179155] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.179158] drbd pvc-80131f0d-7b9c-41c3-9968-8c4cf570b33f/0 drbd1110 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.193449] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-4: Preparing remote state change 2602470638 Mar 17 01:54:33 offine-stand-stor-0 [ 138.199136] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287: Starting worker thread (from drbdsetup [11476]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.203305] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-1: Starting sender thread (from drbdsetup [11481]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.205824] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 138.205834] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.206054] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-4: Starting sender thread (from drbdsetup [11483]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.208945] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-1: Committing remote state change 362641727 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 138.208965] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600: susp-io( quorum -> no ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.208968] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.208970] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600/0 drbd1043: quorum( no -> yes ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.208980] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600/0 drbd1043 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.210706] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287: susp-io( no -> quorum ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.210715] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.210744] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-8f60 [11477]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.210851] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:33 offine-stand-stor-0 [ 138.211216] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 138.216474] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-4: Preparing remote state change 2999231511 Mar 17 01:54:33 offine-stand-stor-0 [ 138.217713] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.217893] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-8f60 [11477]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.217980] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.219235] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:33 offine-stand-stor-0 [ 138.227120] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.229094] drbd1103: detected capacity change from 0 to 10491632 Mar 17 01:54:33 offine-stand-stor-0 [ 138.229097] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82/0 drbd1103: size = 5123 MB (5245816 KB) Mar 17 01:54:33 offine-stand-stor-0 [ 138.229097] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-4: Rejecting concurrent remote state change 3633631481 because of state change 467860440 Mar 17 01:54:33 offine-stand-stor-0 [ 138.229149] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82/0 drbd1103 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:33 offine-stand-stor-0 [ 138.231931] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.235344] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82/0 drbd1103 offline-stand-stor-4: peer B3655A142DCF5A78:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.235360] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82/0 drbd1103: Setting exposed data uuid: B3655A142DCF5A78 Mar 17 01:54:33 offine-stand-stor-0 [ 138.235665] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 138.235960] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-2: Committing remote state change 467860440 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 138.236087] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba: susp-io( quorum -> no ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.236196] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.236217] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba/0 drbd1100: quorum( no -> yes ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.236304] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba/0 drbd1100 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.241022] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c/0 drbd1060 offline-stand-stor-4: my exposed UUID: ACC98CD62FB7CB92 Mar 17 01:54:33 offine-stand-stor-0 [ 138.244427] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.246314] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c/0 drbd1060 offline-stand-stor-4: peer ACC98CD62FB7CB92:0000000000000000:1C36BF5B9F735800:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.248423] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-1: Rejecting concurrent remote state change 1642909757 because of state change 3168972345 Mar 17 01:54:33 offine-stand-stor-0 [ 138.252612] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.252612] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 138.252616] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.256689] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.257382] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-4: Committing remote state change 3168972345 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 138.258707] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-3: Preparing remote state change 1544981626 Mar 17 01:54:33 offine-stand-stor-0 [ 138.259234] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82: susp-io( quorum -> no ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.259237] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.259238] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82/0 drbd1103: quorum( no -> yes ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.259247] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82/0 drbd1103 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.261238] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600/0 drbd1043 offline-stand-stor-4: my exposed UUID: 78534BB1EA577CD0 Mar 17 01:54:33 offine-stand-stor-0 [ 138.262040] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133 offline-stand-stor-1: drbd_sync_handshake: Mar 17 01:54:33 offine-stand-stor-0 [ 138.262051] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133 offline-stand-stor-1: self 65C3BD5856517EDC:0000000000000000:DD582D17F43B4180:0000000000000000 bits:0 flags:20 Mar 17 01:54:33 offine-stand-stor-0 [ 138.262055] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133 offline-stand-stor-1: peer 65C3BD5856517EDC:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.262058] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133 offline-stand-stor-1: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:33 offine-stand-stor-0 [ 138.263657] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-2: Preparing remote state change 2291275624 Mar 17 01:54:33 offine-stand-stor-0 [ 138.264373] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-1: Committing remote state change 3706356758 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 138.264971] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600/0 drbd1043 offline-stand-stor-4: peer 78534BB1EA577CD0:0000000000000000:B7D80EB39C27A20A:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.265960] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2: susp-io( quorum -> no ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.269557] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17/0 drbd1012 offline-stand-stor-4: my exposed UUID: 122F405D843E74B4 Mar 17 01:54:33 offine-stand-stor-0 [ 138.269989] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.270791] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17/0 drbd1012 offline-stand-stor-4: peer 122F405D843E74B4:08271E675A159AA8:D24F57593D5E99C4:3178002F39D9F77A bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.271592] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133: quorum( no -> yes ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.275200] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d: Starting worker thread (from drbdsetup [11510]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.275527] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.278404] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba/0 drbd1100 offline-stand-stor-4: my exposed UUID: 0FCEF4B3F9CAC3C4 Mar 17 01:54:33 offine-stand-stor-0 [ 138.279547] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-3: Rejecting concurrent remote state change 212874583 because of state change 2291275624 Mar 17 01:54:33 offine-stand-stor-0 [ 138.291099] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-3: Starting sender thread (from drbdsetup [11515]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.292685] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-4: Starting sender thread (from drbdsetup [11517]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.302909] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba/0 drbd1100 offline-stand-stor-4: peer 0FCEF4B3F9CAC3C4:A529955C87BF6A7A:A529955C87BF6A7A:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.303576] drbd pvc-795332b5-21ab-409c-9576-80ca90e0d6a2/0 drbd1133 offline-stand-stor-1: cleared bm UUID and bitmap 65C3BD5856517EDC:0000000000000000:DD582D17F43B4180:0000000000000000 Mar 17 01:54:33 offine-stand-stor-0 [ 138.356845] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-4: Committing remote state change 2602470638 (primary_nodes=2) Mar 17 01:54:33 offine-stand-stor-0 [ 138.358472] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-4: Committing remote state change 2318255850 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 138.359342] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Primary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.360150] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.361773] drbd pvc-7d7ee262-c08b-4f13-ad53-b7f44135ea17/0 drbd1012 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.362724] drbd pvc-8092a6fb-2bea-41b6-8229-1bdcaf160b3c/0 drbd1060 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.538712] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-4: Committing remote state change 2999231511 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 138.538813] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029: meta-data IO uses: blk-bio Mar 17 01:54:33 offine-stand-stor-0 [ 138.540557] drbd1061: detected capacity change from 0 to 10491632 Mar 17 01:54:33 offine-stand-stor-0 [ 138.540568] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52/0 drbd1061: size = 5123 MB (5245816 KB) Mar 17 01:54:33 offine-stand-stor-0 [ 138.540616] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52/0 drbd1061 offline-stand-stor-2: my exposed UUID: 0000000000000000 Mar 17 01:54:33 offine-stand-stor-0 [ 138.540619] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52/0 drbd1061 offline-stand-stor-2: peer 33F06FAE297729FC:D85CE8E8A04344E0:F6C1F69988F8203C:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.540622] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52/0 drbd1061: Setting exposed data uuid: 33F06FAE297729FC Mar 17 01:54:33 offine-stand-stor-0 [ 138.540663] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-2: Aborting remote state change 2291275624 Mar 17 01:54:33 offine-stand-stor-0 [ 138.541990] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.542000] drbd pvc-82aef4e2-65f4-4c5a-82eb-7f955ce68600/0 drbd1043 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.542589] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82/0 drbd1103 offline-stand-stor-1: my exposed UUID: B3655A142DCF5A78 Mar 17 01:54:33 offine-stand-stor-0 [ 138.543833] drbd1135: detected capacity change from 0 to 10491632 Mar 17 01:54:33 offine-stand-stor-0 [ 138.544176] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d: susp-io( no -> quorum ) [attach] Mar 17 01:54:33 offine-stand-stor-0 [ 138.544179] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:33 offine-stand-stor-0 [ 138.544192] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029: Maximum number of peer devices = 7 Mar 17 01:54:33 offine-stand-stor-0 [ 138.544874] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d: Method to ensure write ordering: flush Mar 17 01:54:33 offine-stand-stor-0 [ 138.545024] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:33 offine-stand-stor-0 [ 138.545105] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82/0 drbd1103 offline-stand-stor-1: peer B3655A142DCF5A78:0000000000000000:3F1B0609072FD70C:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.546000] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:33 offine-stand-stor-0 [ 138.546925] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46/0 drbd1135: size = 5123 MB (5245816 KB) Mar 17 01:54:33 offine-stand-stor-0 [ 138.548332] drbd1029: detected capacity change from 0 to 10491632 Mar 17 01:54:33 offine-stand-stor-0 [ 138.551934] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46/0 drbd1135 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:33 offine-stand-stor-0 [ 138.553381] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029: size = 5123 MB (5245816 KB) Mar 17 01:54:33 offine-stand-stor-0 [ 138.574598] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029: recounting of set bits took additional 0ms Mar 17 01:54:33 offine-stand-stor-0 [ 138.575012] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46/0 drbd1135 offline-stand-stor-3: peer 268D4FAD3EF7BD8E:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.575955] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:33 offine-stand-stor-0 [ 138.576778] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46/0 drbd1135: Setting exposed data uuid: 268D4FAD3EF7BD8E Mar 17 01:54:33 offine-stand-stor-0 [ 138.578619] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029: attached to current UUID: A1ACF9F6714E563C Mar 17 01:54:33 offine-stand-stor-0 [ 138.580625] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52/0 drbd1061 offline-stand-stor-3: my exposed UUID: 33F06FAE297729FC Mar 17 01:54:33 offine-stand-stor-0 [ 138.581552] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029: Setting exposed data uuid: A1ACF9F6714E563C Mar 17 01:54:33 offine-stand-stor-0 [ 138.582631] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52/0 drbd1061 offline-stand-stor-3: peer 33F06FAE297729FC:0000000000000000:D85CE8E8A04344E0:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.588259] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.588296] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-3: Committing remote state change 1544981626 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 138.589817] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-8f97 [11511]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.590600] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.591899] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46: susp-io( quorum -> no ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.594551] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:33 offine-stand-stor-0 [ 138.594587] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-8f97 [11511]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.595997] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.597914] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:33 offine-stand-stor-0 [ 138.599961] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46/0 drbd1135: quorum( no -> yes ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.608362] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46/0 drbd1135 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.617744] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-4: Preparing remote state change 2453571773 Mar 17 01:54:33 offine-stand-stor-0 [ 138.635925] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9: Starting worker thread (from drbdsetup [11542]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.652806] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-1: Starting sender thread (from drbdsetup [11547]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.656709] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46/0 drbd1135 offline-stand-stor-4: my exposed UUID: 268D4FAD3EF7BD8E Mar 17 01:54:33 offine-stand-stor-0 [ 138.658171] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46/0 drbd1135 offline-stand-stor-4: peer 268D4FAD3EF7BD8E:0000000000000000:3BD0DC86164D6D44:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.658880] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-3: Starting sender thread (from drbdsetup [11549]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.666514] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.668544] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-92de [11543]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.669078] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.673712] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-4: Committing remote state change 2453571773 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 138.673722] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.673730] drbd pvc-853ecb8d-d04a-4532-be53-04e3980caf46/0 drbd1135 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.680694] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-1: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 138.680699] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.686188] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 138.686190] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.688747] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.691155] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.698919] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb: Preparing cluster-wide state change 2766869683 (1->2 499/146) Mar 17 01:54:33 offine-stand-stor-0 [ 138.700332] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 138.700334] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.707787] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.717397] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-1: Preparing remote state change 3405734708 Mar 17 01:54:33 offine-stand-stor-0 [ 138.719350] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:33 offine-stand-stor-0 [ 138.721700] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-92de [11543]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.744654] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 138.744664] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 138.744673] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.747023] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:33 offine-stand-stor-0 [ 138.747461] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:33 offine-stand-stor-0 [ 138.749679] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.753687] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:33 offine-stand-stor-0 [ 138.759163] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199: Starting worker thread (from drbdsetup [11567]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.765003] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.767691] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.769359] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:33 offine-stand-stor-0 [ 138.772992] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-1: Starting sender thread (from drbdsetup [11573]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.774017] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-4: Preparing remote state change 543318633 Mar 17 01:54:33 offine-stand-stor-0 [ 138.777804] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-2: Starting sender thread (from drbdsetup [11577]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.782588] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126 offline-stand-stor-1: self FD6B7A1FD0E79F92:0000000000000000:4940992F25460626:0000000000000000 bits:0 flags:0 Mar 17 01:54:33 offine-stand-stor-0 [ 138.783539] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199: susp-io( no -> quorum ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.784341] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126 offline-stand-stor-1: peer's exposed UUID: FD6B7A1FD0E79F92 Mar 17 01:54:33 offine-stand-stor-0 [ 138.785221] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.785284] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-98b1 [11568]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.787002] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb: State change 2766869683: primary_nodes=0, weak_nodes=0 Mar 17 01:54:33 offine-stand-stor-0 [ 138.788029] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:33 offine-stand-stor-0 [ 138.789737] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb: Committing cluster-wide state change 2766869683 (88ms) Mar 17 01:54:33 offine-stand-stor-0 [ 138.790634] drbd1009: detected capacity change from 0 to 10491632 Mar 17 01:54:33 offine-stand-stor-0 [ 138.790649] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.790742] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-98b1 [11568]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.790847] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:33 offine-stand-stor-0 [ 138.792823] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:33 offine-stand-stor-0 [ 138.794103] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50/0 drbd1009: size = 5123 MB (5245816 KB) Mar 17 01:54:33 offine-stand-stor-0 [ 138.794955] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126 offline-stand-stor-1: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:33 offine-stand-stor-0 [ 138.795955] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50/0 drbd1009 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:33 offine-stand-stor-0 [ 138.806912] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50/0 drbd1009 offline-stand-stor-1: peer A23C4972A7CD22C2:F0DA0107236E7C15:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.809132] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50/0 drbd1009: Setting exposed data uuid: A23C4972A7CD22C2 Mar 17 01:54:33 offine-stand-stor-0 [ 138.813018] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-1: Committing remote state change 3405734708 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 138.815145] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50: susp-io( quorum -> no ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.816188] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.818108] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50/0 drbd1009: quorum( no -> yes ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.818416] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-1: Preparing remote state change 3333641975 Mar 17 01:54:33 offine-stand-stor-0 [ 138.819425] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50/0 drbd1009 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.823823] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-2: Preparing remote state change 2701661353 Mar 17 01:54:33 offine-stand-stor-0 [ 138.828376] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9: Starting worker thread (from drbdsetup [11592]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.831507] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-4: Preparing remote state change 1958452611 Mar 17 01:54:33 offine-stand-stor-0 [ 138.832594] drbd1114: detected capacity change from 0 to 10491632 Mar 17 01:54:33 offine-stand-stor-0 [ 138.833796] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287/0 drbd1114: size = 5123 MB (5245816 KB) Mar 17 01:54:33 offine-stand-stor-0 [ 138.834090] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-3: Starting sender thread (from drbdsetup [11597]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.835173] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287/0 drbd1114 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:33 offine-stand-stor-0 [ 138.837633] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-4: Preparing remote state change 4140564419 Mar 17 01:54:33 offine-stand-stor-0 [ 138.841408] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-4: Starting sender thread (from drbdsetup [11599]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.842390] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287/0 drbd1114 offline-stand-stor-4: peer 974E546CA4A8D8D2:0000000000000000:80E956A191C7F972:0000000000000000 bits:0 flags:1120 Mar 17 01:54:33 offine-stand-stor-0 [ 138.846822] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287/0 drbd1114: Setting exposed data uuid: 974E546CA4A8D8D2 Mar 17 01:54:33 offine-stand-stor-0 [ 138.851880] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9: susp-io( no -> quorum ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.852157] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-4: Committing remote state change 543318633 (primary_nodes=0) Mar 17 01:54:33 offine-stand-stor-0 [ 138.852997] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.853050] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-9c30 [11593]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.855633] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287: susp-io( quorum -> no ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.857713] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:33 offine-stand-stor-0 [ 138.860600] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.862359] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:33 offine-stand-stor-0 [ 138.865828] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287/0 drbd1114: quorum( no -> yes ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.868771] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-9c30 [11593]) Mar 17 01:54:33 offine-stand-stor-0 [ 138.870092] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287/0 drbd1114 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:33 offine-stand-stor-0 [ 138.873830] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:34 offine-stand-stor-0 [ 138.875932] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-1: Preparing remote state change 960969886 Mar 17 01:54:34 offine-stand-stor-0 [ 138.876954] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-2: Preparing remote state change 1562920596 Mar 17 01:54:34 offine-stand-stor-0 [ 138.880604] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50/0 drbd1009 offline-stand-stor-2: my exposed UUID: A23C4972A7CD22C2 Mar 17 01:54:34 offine-stand-stor-0 [ 138.880619] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82/0 drbd1103 offline-stand-stor-1: my exposed UUID: B3655A142DCF5A78 Mar 17 01:54:34 offine-stand-stor-0 [ 138.880621] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82/0 drbd1103 offline-stand-stor-1: peer B3655A142DCF5A78:0000000000000000:3F1B0609072FD70C:0000000000000000 bits:0 flags:1120 Mar 17 01:54:34 offine-stand-stor-0 [ 138.881521] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba/0 drbd1100 offline-stand-stor-4: my exposed UUID: 0FCEF4B3F9CAC3C4 Mar 17 01:54:34 offine-stand-stor-0 [ 138.882889] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126 offline-stand-stor-4: drbd_sync_handshake: Mar 17 01:54:34 offine-stand-stor-0 [ 138.882892] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126 offline-stand-stor-4: self FD6B7A1FD0E79F92:0000000000000000:4940992F25460626:0000000000000000 bits:0 flags:20 Mar 17 01:54:34 offine-stand-stor-0 [ 138.882894] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126 offline-stand-stor-4: peer FD6B7A1FD0E79F92:0000000000000000:91253513BBF91F20:88FBE1BDEE0790B8 bits:0 flags:1120 Mar 17 01:54:34 offine-stand-stor-0 [ 138.882901] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126 offline-stand-stor-4: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:34 offine-stand-stor-0 [ 138.883082] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50/0 drbd1009 offline-stand-stor-2: peer A23C4972A7CD22C2:F0DA0107236E7C14:F0DA0107236E7C14:0000000000000000 bits:0 flags:1120 Mar 17 01:54:34 offine-stand-stor-0 [ 138.901555] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-2: Committing remote state change 2701661353 (primary_nodes=0) Mar 17 01:54:34 offine-stand-stor-0 [ 138.912352] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc: Starting worker thread (from drbdsetup [11614]) Mar 17 01:54:34 offine-stand-stor-0 [ 138.913027] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 138.916335] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba/0 drbd1100 offline-stand-stor-4: peer 0FCEF4B3F9CAC3C4:A529955C87BF6A7A:A529955C87BF6A7A:0000000000000000 bits:0 flags:1120 Mar 17 01:54:34 offine-stand-stor-0 [ 138.917765] drbd pvc-8d941f13-46bc-4907-aa1e-cefbd236da50/0 drbd1009 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 138.921675] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-1: Starting sender thread (from drbdsetup [11619]) Mar 17 01:54:34 offine-stand-stor-0 [ 138.924128] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-1: Committing remote state change 3333641975 (primary_nodes=0) Mar 17 01:54:34 offine-stand-stor-0 [ 138.924142] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 138.924147] drbd pvc-82e88dfb-dd61-46e7-a12c-5e29df25ad82/0 drbd1103 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 138.969987] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-4: Committing remote state change 4140564419 (primary_nodes=0) Mar 17 01:54:34 offine-stand-stor-0 [ 138.971369] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287/0 drbd1114 offline-stand-stor-1: my exposed UUID: 974E546CA4A8D8D2 Mar 17 01:54:34 offine-stand-stor-0 [ 138.971567] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52/0 drbd1061 offline-stand-stor-2: my exposed UUID: 33F06FAE297729FC Mar 17 01:54:34 offine-stand-stor-0 [ 138.971570] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52/0 drbd1061 offline-stand-stor-2: peer 33F06FAE297729FC:D85CE8E8A04344E0:F6C1F69988F8203C:0000000000000000 bits:0 flags:1120 Mar 17 01:54:34 offine-stand-stor-0 [ 138.973230] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-4: Starting sender thread (from drbdsetup [11621]) Mar 17 01:54:34 offine-stand-stor-0 [ 138.976641] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc: susp-io( no -> quorum ) [connect] Mar 17 01:54:34 offine-stand-stor-0 [ 138.976644] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:34 offine-stand-stor-0 [ 138.976689] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-9ea1 [11615]) Mar 17 01:54:34 offine-stand-stor-0 [ 138.976736] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:34 offine-stand-stor-0 [ 138.977975] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:34 offine-stand-stor-0 [ 138.978008] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-9ea1 [11615]) Mar 17 01:54:34 offine-stand-stor-0 [ 138.978227] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:34 offine-stand-stor-0 [ 138.983090] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-2: Committing remote state change 1562920596 (primary_nodes=0) Mar 17 01:54:34 offine-stand-stor-0 [ 138.983108] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52: susp-io( quorum -> no ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 138.983111] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 138.983113] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52/0 drbd1061: quorum( no -> yes ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 138.983116] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52/0 drbd1061 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 138.983253] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-4: Committing remote state change 1958452611 (primary_nodes=0) Mar 17 01:54:34 offine-stand-stor-0 [ 138.983262] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb: susp-io( quorum -> no ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 138.983265] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 138.983267] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126: quorum( no -> yes ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 138.983270] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 138.983345] drbd pvc-8a86acf8-df32-494a-a7ce-f83e24275dcb/0 drbd1126 offline-stand-stor-4: cleared bm UUID and bitmap FD6B7A1FD0E79F92:0000000000000000:4940992F25460626:0000000000000000 Mar 17 01:54:34 offine-stand-stor-0 [ 139.013725] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-3: Preparing remote state change 2475869254 Mar 17 01:54:34 offine-stand-stor-0 [ 139.013879] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 139.016412] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287/0 drbd1114 offline-stand-stor-1: peer 974E546CA4A8D8D2:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:34 offine-stand-stor-0 [ 139.016642] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb: Starting worker thread (from drbdsetup [11636]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.050332] drbd pvc-82dc6fd7-3a1f-437b-bd55-1e93975883ba/0 drbd1100 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 139.053153] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-1: Committing remote state change 960969886 (primary_nodes=0) Mar 17 01:54:34 offine-stand-stor-0 [ 139.062622] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-1: Starting sender thread (from drbdsetup [11641]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.069853] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-4: Starting sender thread (from drbdsetup [11643]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.093844] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb: susp-io( no -> quorum ) [connect] Mar 17 01:54:34 offine-stand-stor-0 [ 139.095902] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 139.097200] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:34 offine-stand-stor-0 [ 139.101606] drbd pvc-8f60193e-7c9b-4555-9f0b-d5e94d1a6287/0 drbd1114 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 139.106330] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:34 offine-stand-stor-0 [ 139.116719] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-9fed [11637]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.125600] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-3: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:34 offine-stand-stor-0 [ 139.128640] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52/0 drbd1061 offline-stand-stor-3: my exposed UUID: 33F06FAE297729FC Mar 17 01:54:34 offine-stand-stor-0 [ 139.129552] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:34 offine-stand-stor-0 [ 139.133088] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52/0 drbd1061 offline-stand-stor-3: peer 33F06FAE297729FC:0000000000000000:D85CE8E8A04344E0:0000000000000000 bits:0 flags:1120 Mar 17 01:54:34 offine-stand-stor-0 [ 139.142432] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:34 offine-stand-stor-0 [ 139.142454] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-9fed [11637]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.148967] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-3: Committing remote state change 2475869254 (primary_nodes=0) Mar 17 01:54:34 offine-stand-stor-0 [ 139.158046] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:34 offine-stand-stor-0 [ 139.159184] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:34 offine-stand-stor-0 [ 139.159349] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-4: Handshake to peer 3 successful: Agreed network protocol version 122 Mar 17 01:54:34 offine-stand-stor-0 [ 139.159352] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:34 offine-stand-stor-0 [ 139.160304] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 139.164565] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d: Preparing cluster-wide state change 548620835 (0->1 499/146) Mar 17 01:54:34 offine-stand-stor-0 [ 139.165166] drbd pvc-852c1e2d-d609-459a-8e56-8d74a37cea52/0 drbd1061 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 139.169166] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a: Starting worker thread (from drbdsetup [11659]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.181642] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:34 offine-stand-stor-0 [ 139.209681] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-2: Starting sender thread (from drbdsetup [11664]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.224998] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-3: Starting sender thread (from drbdsetup [11667]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.232068] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a: susp-io( no -> quorum ) [connect] Mar 17 01:54:34 offine-stand-stor-0 [ 139.233261] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:34 offine-stand-stor-0 [ 139.234482] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-a98a [11660]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.237239] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:34 offine-stand-stor-0 [ 139.250211] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:34 offine-stand-stor-0 [ 139.251667] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-a98a [11660]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.255009] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-3: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:34 offine-stand-stor-0 [ 139.255168] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:34 offine-stand-stor-0 [ 139.257501] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:34 offine-stand-stor-0 [ 139.273156] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:34 offine-stand-stor-0 [ 139.275565] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:34 offine-stand-stor-0 [ 139.277195] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:34 offine-stand-stor-0 [ 139.281769] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:34 offine-stand-stor-0 [ 139.294238] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20: Starting worker thread (from drbdsetup [11684]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.299980] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-1: Starting sender thread (from drbdsetup [11689]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.305496] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-3: Preparing remote state change 1166988925 Mar 17 01:54:34 offine-stand-stor-0 [ 139.305992] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-4: Starting sender thread (from drbdsetup [11691]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.315771] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:34 offine-stand-stor-0 [ 139.316692] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:34 offine-stand-stor-0 [ 139.317364] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-a9e1 [11685]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.317765] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:34 offine-stand-stor-0 [ 139.319677] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:34 offine-stand-stor-0 [ 139.321729] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:34 offine-stand-stor-0 [ 139.327346] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-a9e1 [11685]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.329971] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:34 offine-stand-stor-0 [ 139.330013] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:34 offine-stand-stor-0 [ 139.333257] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:34 offine-stand-stor-0 [ 139.337161] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:34 offine-stand-stor-0 [ 139.357256] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-1: Preparing remote state change 776307171 Mar 17 01:54:34 offine-stand-stor-0 [ 139.380510] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:34 offine-stand-stor-0 [ 139.384659] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:34 offine-stand-stor-0 [ 139.388838] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:34 offine-stand-stor-0 [ 139.393441] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc: Starting worker thread (from drbdsetup [11725]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.396572] drbd1020: detected capacity change from 0 to 4201520 Mar 17 01:54:34 offine-stand-stor-0 [ 139.397170] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:34 offine-stand-stor-0 [ 139.398535] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9/0 drbd1020: size = 2052 MB (2100760 KB) Mar 17 01:54:34 offine-stand-stor-0 [ 139.399570] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029 offline-stand-stor-3: self A1ACF9F6714E563C:0000000000000000:49F69AC3ADEBE684:0000000000000000 bits:0 flags:20 Mar 17 01:54:34 offine-stand-stor-0 [ 139.401846] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9/0 drbd1020 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:34 offine-stand-stor-0 [ 139.402783] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029 offline-stand-stor-3: peer A1ACF9F6714E563C:0000000000000000:9B98BF52E09B8928:259CF20E7B44ADA2 bits:0 flags:1120 Mar 17 01:54:34 offine-stand-stor-0 [ 139.404814] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9/0 drbd1020 offline-stand-stor-3: peer FC1A2F3E35371454:66BEB922DD8C6E54:C2E125EEA51BE16C:7E3DFA1888DB1150 bits:0 flags:1120 Mar 17 01:54:34 offine-stand-stor-0 [ 139.405463] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:34 offine-stand-stor-0 [ 139.407044] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:34 offine-stand-stor-0 [ 139.409154] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9/0 drbd1020: Setting exposed data uuid: FC1A2F3E35371454 Mar 17 01:54:34 offine-stand-stor-0 [ 139.410585] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d: State change 548620835: primary_nodes=0, weak_nodes=0 Mar 17 01:54:34 offine-stand-stor-0 [ 139.415044] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d: Committing cluster-wide state change 548620835 (248ms) Mar 17 01:54:34 offine-stand-stor-0 [ 139.416148] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d: susp-io( quorum -> no ) [connected] Mar 17 01:54:34 offine-stand-stor-0 [ 139.416623] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:34 offine-stand-stor-0 [ 139.417379] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:34 offine-stand-stor-0 [ 139.419915] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:34 offine-stand-stor-0 [ 139.423068] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029: quorum( no -> yes ) [connected] Mar 17 01:54:34 offine-stand-stor-0 [ 139.423072] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [connected] Mar 17 01:54:34 offine-stand-stor-0 [ 139.423183] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029 offline-stand-stor-3: cleared bm UUID and bitmap A1ACF9F6714E563C:0000000000000000:49F69AC3ADEBE684:0000000000000000 Mar 17 01:54:34 offine-stand-stor-0 [ 139.424440] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-1: Rejecting concurrent remote state change 1502006349 because of state change 1166988925 Mar 17 01:54:34 offine-stand-stor-0 [ 139.433492] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-2: Starting sender thread (from drbdsetup [11731]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.434812] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-3: Committing remote state change 1166988925 (primary_nodes=2) Mar 17 01:54:34 offine-stand-stor-0 [ 139.441120] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-3: Starting sender thread (from drbdsetup [11734]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.441823] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Primary ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 139.444101] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-3: Preparing remote state change 1169714875 Mar 17 01:54:34 offine-stand-stor-0 [ 139.444547] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d: Preparing cluster-wide state change 1208228190 (0->3 499/146) Mar 17 01:54:34 offine-stand-stor-0 [ 139.447892] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9/0 drbd1020 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 139.448428] drbd1091: detected capacity change from 0 to 10491632 Mar 17 01:54:34 offine-stand-stor-0 [ 139.469268] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:34 offine-stand-stor-0 [ 139.481395] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062: meta-data IO uses: blk-bio Mar 17 01:54:34 offine-stand-stor-0 [ 139.481448] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199/0 drbd1091: size = 5123 MB (5245816 KB) Mar 17 01:54:34 offine-stand-stor-0 [ 139.488631] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9/0 drbd1020 offline-stand-stor-1: my exposed UUID: FC1A2F3E35371454 Mar 17 01:54:34 offine-stand-stor-0 [ 139.489591] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc: susp-io( no -> quorum ) [attach] Mar 17 01:54:34 offine-stand-stor-0 [ 139.490514] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9/0 drbd1020 offline-stand-stor-1: peer FC1A2F3E35371454:66BEB922DD8C6E54:1F68533CF30BC714:E8F7EE54181CB694 bits:0 flags:1100 Mar 17 01:54:34 offine-stand-stor-0 [ 139.491774] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:34 offine-stand-stor-0 [ 139.496549] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199/0 drbd1091 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:34 offine-stand-stor-0 [ 139.496780] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062: Maximum number of peer devices = 7 Mar 17 01:54:34 offine-stand-stor-0 [ 139.512618] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:34 offine-stand-stor-0 [ 139.512622] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:34 offine-stand-stor-0 [ 139.522675] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199/0 drbd1091 offline-stand-stor-1: peer C24A8FAF9F883514:0000000000000000:EAB31868146B745C:0000000000000000 bits:0 flags:1120 Mar 17 01:54:34 offine-stand-stor-0 [ 139.523659] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc: Method to ensure write ordering: flush Mar 17 01:54:34 offine-stand-stor-0 [ 139.524558] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029 offline-stand-stor-4: self A1ACF9F6714E563C:B47DF4267CC8B72C:49F69AC3ADEBE684:0000000000000000 bits:0 flags:0 Mar 17 01:54:34 offine-stand-stor-0 [ 139.524563] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029 offline-stand-stor-4: peer's exposed UUID: A1ACF9F6714E563D Mar 17 01:54:34 offine-stand-stor-0 [ 139.524581] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d: State change 1208228190: primary_nodes=0, weak_nodes=0 Mar 17 01:54:34 offine-stand-stor-0 [ 139.524590] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d: Committing cluster-wide state change 1208228190 (80ms) Mar 17 01:54:34 offine-stand-stor-0 [ 139.524665] drbd1010: detected capacity change from 0 to 10491632 Mar 17 01:54:34 offine-stand-stor-0 [ 139.524668] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9/0 drbd1010: size = 5123 MB (5245816 KB) Mar 17 01:54:34 offine-stand-stor-0 [ 139.524746] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9/0 drbd1010 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:34 offine-stand-stor-0 [ 139.524749] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9/0 drbd1010 offline-stand-stor-3: peer 26D6622D91137180:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:34 offine-stand-stor-0 [ 139.524752] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9/0 drbd1010: Setting exposed data uuid: 26D6622D91137180 Mar 17 01:54:34 offine-stand-stor-0 [ 139.568495] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199/0 drbd1091: Setting exposed data uuid: C24A8FAF9F883514 Mar 17 01:54:34 offine-stand-stor-0 [ 139.570413] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:34 offine-stand-stor-0 [ 139.570610] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:34 offine-stand-stor-0 [ 139.570741] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:34 offine-stand-stor-0 [ 139.571312] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:34 offine-stand-stor-0 [ 139.571323] drbd1062: detected capacity change from 0 to 10491632 Mar 17 01:54:34 offine-stand-stor-0 [ 139.571325] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062: size = 5123 MB (5245816 KB) Mar 17 01:54:34 offine-stand-stor-0 [ 139.579671] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-3: Committing remote state change 1169714875 (primary_nodes=0) Mar 17 01:54:34 offine-stand-stor-0 [ 139.579686] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9: susp-io( quorum -> no ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 139.579688] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 139.579690] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9/0 drbd1010: quorum( no -> yes ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 139.579692] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9/0 drbd1010 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:34 offine-stand-stor-0 [ 139.580130] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062: recounting of set bits took additional 0ms Mar 17 01:54:34 offine-stand-stor-0 [ 139.580146] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:34 offine-stand-stor-0 [ 139.580148] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062: attached to current UUID: D789202F55C0D77E Mar 17 01:54:34 offine-stand-stor-0 [ 139.580151] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062: Setting exposed data uuid: D789202F55C0D77E Mar 17 01:54:34 offine-stand-stor-0 [ 139.582749] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:34 offine-stand-stor-0 [ 139.584098] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:34 offine-stand-stor-0 [ 139.592278] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-4: Preparing remote state change 2341657977 Mar 17 01:54:34 offine-stand-stor-0 [ 139.595834] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-1: Preparing remote state change 4184914400 Mar 17 01:54:34 offine-stand-stor-0 [ 139.640533] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:34 offine-stand-stor-0 [ 139.640707] drbd pvc-8f97c757-cbde-4a18-a473-daaff0a02e1d/0 drbd1029 offline-stand-stor-4: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:34 offine-stand-stor-0 [ 139.643355] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-ab2d [11727]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.652964] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66: Starting worker thread (from drbdsetup [11772]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.663139] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-1: Starting sender thread (from drbdsetup [11777]) Mar 17 01:54:34 offine-stand-stor-0 [ 139.665451] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: Starting sender thread (from drbdsetup [11779]) Mar 17 01:54:35 offine-stand-stor-0 [ 139.668283] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:35 offine-stand-stor-0 [ 139.694133] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-ab2d [11727]) Mar 17 01:54:35 offine-stand-stor-0 [ 139.700620] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:35 offine-stand-stor-0 [ 139.700652] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-2: Rejecting concurrent remote state change 3198432835 because of state change 776307171 Mar 17 01:54:35 offine-stand-stor-0 [ 139.701823] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:35 offine-stand-stor-0 [ 139.702728] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:35 offine-stand-stor-0 [ 139.703852] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:35 offine-stand-stor-0 [ 139.705774] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:35 offine-stand-stor-0 [ 139.706131] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:35 offine-stand-stor-0 [ 139.706134] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:35 offine-stand-stor-0 [ 139.711480] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:35 offine-stand-stor-0 [ 139.713189] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123: meta-data IO uses: blk-bio Mar 17 01:54:35 offine-stand-stor-0 [ 139.713603] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66: susp-io( no -> quorum ) [attach] Mar 17 01:54:35 offine-stand-stor-0 [ 139.745473] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-1: Committing remote state change 776307171 (primary_nodes=0) Mar 17 01:54:35 offine-stand-stor-0 [ 139.745699] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:35 offine-stand-stor-0 [ 139.745794] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123: Maximum number of peer devices = 7 Mar 17 01:54:35 offine-stand-stor-0 [ 139.748775] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9/0 drbd1010 offline-stand-stor-4: my exposed UUID: 26D6622D91137180 Mar 17 01:54:35 offine-stand-stor-0 [ 139.748785] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9/0 drbd1010 offline-stand-stor-4: peer 26D6622D91137180:0000000000000000:B429FA696652DC9E:0000000000000000 bits:0 flags:1120 Mar 17 01:54:35 offine-stand-stor-0 [ 139.748871] drbd1108: detected capacity change from 0 to 10491632 Mar 17 01:54:35 offine-stand-stor-0 [ 139.748874] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc/0 drbd1108: size = 5123 MB (5245816 KB) Mar 17 01:54:35 offine-stand-stor-0 [ 139.748902] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc/0 drbd1108 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:35 offine-stand-stor-0 [ 139.748904] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc/0 drbd1108 offline-stand-stor-1: peer 16133F0E082B6FF0:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:35 offine-stand-stor-0 [ 139.748913] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc/0 drbd1108: Setting exposed data uuid: 16133F0E082B6FF0 Mar 17 01:54:35 offine-stand-stor-0 [ 139.751647] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-4: Committing remote state change 2341657977 (primary_nodes=0) Mar 17 01:54:35 offine-stand-stor-0 [ 139.751656] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 139.751658] drbd pvc-9c306fb9-1015-4de2-bfeb-5fa45340f5b9/0 drbd1010 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 139.756731] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:35 offine-stand-stor-0 [ 139.757621] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-1: Committing remote state change 4184914400 (primary_nodes=0) Mar 17 01:54:35 offine-stand-stor-0 [ 139.757629] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc: susp-io( quorum -> no ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 139.757631] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 139.757633] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc/0 drbd1108: quorum( no -> yes ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 139.757641] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc/0 drbd1108 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 139.760928] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-4: Preparing remote state change 3744288764 Mar 17 01:54:35 offine-stand-stor-0 [ 139.765842] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:35 offine-stand-stor-0 [ 139.765852] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:35 offine-stand-stor-0 [ 139.774033] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:35 offine-stand-stor-0 [ 139.774036] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:35 offine-stand-stor-0 [ 139.781473] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:35 offine-stand-stor-0 [ 139.783871] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199: susp-io( quorum -> no ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 139.785118] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:35 offine-stand-stor-0 [ 139.790439] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-1: Preparing remote state change 2578733818 Mar 17 01:54:35 offine-stand-stor-0 [ 139.832541] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 139.847725] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-3: Preparing remote state change 1252885901 Mar 17 01:54:35 offine-stand-stor-0 [ 139.849061] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199/0 drbd1091: quorum( no -> yes ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 139.850905] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:35 offine-stand-stor-0 [ 139.884194] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199/0 drbd1091 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 139.887109] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:35 offine-stand-stor-0 [ 139.888931] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:35 offine-stand-stor-0 [ 139.916952] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66: Method to ensure write ordering: flush Mar 17 01:54:35 offine-stand-stor-0 [ 140.023020] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-1: Preparing remote state change 3862494139 Mar 17 01:54:35 offine-stand-stor-0 [ 140.024400] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-1: Preparing remote state change 2842200567 Mar 17 01:54:35 offine-stand-stor-0 [ 140.026079] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:35 offine-stand-stor-0 [ 140.028860] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:35 offine-stand-stor-0 [ 140.029504] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:35 offine-stand-stor-0 [ 140.030888] drbd1123: detected capacity change from 0 to 10491632 Mar 17 01:54:35 offine-stand-stor-0 [ 140.036775] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:35 offine-stand-stor-0 [ 140.038743] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123: size = 5123 MB (5245816 KB) Mar 17 01:54:35 offine-stand-stor-0 [ 140.059491] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123: recounting of set bits took additional 0ms Mar 17 01:54:35 offine-stand-stor-0 [ 140.061442] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:35 offine-stand-stor-0 [ 140.062576] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:35 offine-stand-stor-0 [ 140.063026] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123: attached to current UUID: 829492204A41A12A Mar 17 01:54:35 offine-stand-stor-0 [ 140.063133] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123: Setting exposed data uuid: 829492204A41A12A Mar 17 01:54:35 offine-stand-stor-0 [ 140.067287] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199/0 drbd1091 offline-stand-stor-2: my exposed UUID: C24A8FAF9F883514 Mar 17 01:54:35 offine-stand-stor-0 [ 140.070157] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:35 offine-stand-stor-0 [ 140.084538] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199/0 drbd1091 offline-stand-stor-2: peer C24A8FAF9F883514:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:35 offine-stand-stor-0 [ 140.086213] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-ab73 [11773]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.089314] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:35 offine-stand-stor-0 [ 140.144821] drbd1125: detected capacity change from 0 to 10491632 Mar 17 01:54:35 offine-stand-stor-0 [ 140.146815] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb/0 drbd1125: size = 5123 MB (5245816 KB) Mar 17 01:54:35 offine-stand-stor-0 [ 140.147695] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-ab73 [11773]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.148431] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb/0 drbd1125 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:35 offine-stand-stor-0 [ 140.152658] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:35 offine-stand-stor-0 [ 140.153629] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb/0 drbd1125 offline-stand-stor-1: peer 1923AE99F3A469A0:0000000000000000:E2A88464C9A87F58:0000000000000000 bits:0 flags:1120 Mar 17 01:54:35 offine-stand-stor-0 [ 140.157040] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:35 offine-stand-stor-0 [ 140.158869] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb/0 drbd1125: Setting exposed data uuid: 1923AE99F3A469A0 Mar 17 01:54:35 offine-stand-stor-0 [ 140.167852] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99: Starting worker thread (from drbdsetup [11817]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.172594] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc/0 drbd1108 offline-stand-stor-4: my exposed UUID: 16133F0E082B6FF0 Mar 17 01:54:35 offine-stand-stor-0 [ 140.172985] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-1: Starting sender thread (from drbdsetup [11822]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.173798] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc/0 drbd1108 offline-stand-stor-4: peer 16133F0E082B6FF0:0000000000000000:72853D9731987B2A:0000000000000000 bits:0 flags:1120 Mar 17 01:54:35 offine-stand-stor-0 [ 140.176188] drbd1014: detected capacity change from 0 to 4201520 Mar 17 01:54:35 offine-stand-stor-0 [ 140.176191] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20/0 drbd1014: size = 2052 MB (2100760 KB) Mar 17 01:54:35 offine-stand-stor-0 [ 140.176220] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20/0 drbd1014 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:35 offine-stand-stor-0 [ 140.176228] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20/0 drbd1014 offline-stand-stor-1: peer 332339F78A351D34:0C1932419F590226:67467B526E257660:F5A53C7EEE37178A bits:0 flags:1100 Mar 17 01:54:35 offine-stand-stor-0 [ 140.176232] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20/0 drbd1014: Setting exposed data uuid: 332339F78A351D34 Mar 17 01:54:35 offine-stand-stor-0 [ 140.178080] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-1: Committing remote state change 2578733818 (primary_nodes=0) Mar 17 01:54:35 offine-stand-stor-0 [ 140.178531] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9/0 drbd1020 offline-stand-stor-1: my exposed UUID: FC1A2F3E35371454 Mar 17 01:54:35 offine-stand-stor-0 [ 140.178534] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9/0 drbd1020 offline-stand-stor-1: peer FC1A2F3E35371454:66BEB922DD8C6E54:1F68533CF30BC714:E8F7EE54181CB694 bits:0 flags:1100 Mar 17 01:54:35 offine-stand-stor-0 [ 140.181954] drbd1035: detected capacity change from 0 to 10491632 Mar 17 01:54:35 offine-stand-stor-0 [ 140.182511] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb: susp-io( quorum -> no ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.182832] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-4: Starting sender thread (from drbdsetup [11824]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.183322] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a/0 drbd1035: size = 5123 MB (5245816 KB) Mar 17 01:54:35 offine-stand-stor-0 [ 140.184967] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.184970] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb/0 drbd1125: quorum( no -> yes ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.184973] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb/0 drbd1125 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.185754] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:35 offine-stand-stor-0 [ 140.185780] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-b054 [11818]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.185803] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a/0 drbd1035 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:35 offine-stand-stor-0 [ 140.185848] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:35 offine-stand-stor-0 [ 140.186603] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:35 offine-stand-stor-0 [ 140.186624] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-b054 [11818]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.186665] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:35 offine-stand-stor-0 [ 140.194225] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-4: Preparing remote state change 3585114267 Mar 17 01:54:35 offine-stand-stor-0 [ 140.196564] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a/0 drbd1035 offline-stand-stor-3: peer E35515476D11FC82:0000000000000000:650D22FD6AC90234:0000000000000000 bits:0 flags:1120 Mar 17 01:54:35 offine-stand-stor-0 [ 140.196569] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a/0 drbd1035: Setting exposed data uuid: E35515476D11FC82 Mar 17 01:54:35 offine-stand-stor-0 [ 140.196572] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-4: Committing remote state change 3744288764 (primary_nodes=0) Mar 17 01:54:35 offine-stand-stor-0 [ 140.198069] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-1: Committing remote state change 2842200567 (primary_nodes=2) Mar 17 01:54:35 offine-stand-stor-0 [ 140.199777] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.199780] drbd pvc-9ea1ba12-54bb-4e0f-9451-b62a5a97c6dc/0 drbd1108 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.205248] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-1: Committing remote state change 3862494139 (primary_nodes=2) Mar 17 01:54:35 offine-stand-stor-0 [ 140.207303] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.209357] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.211587] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20/0 drbd1014 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.213447] drbd pvc-92de0ed3-5b2d-449b-9eeb-29fe9f6af4e9/0 drbd1020 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.215626] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-4: Preparing remote state change 3312752053 Mar 17 01:54:35 offine-stand-stor-0 [ 140.219028] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:35 offine-stand-stor-0 [ 140.219031] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:35 offine-stand-stor-0 [ 140.229991] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-3: Committing remote state change 1252885901 (primary_nodes=0) Mar 17 01:54:35 offine-stand-stor-0 [ 140.239568] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9: Starting worker thread (from drbdsetup [11839]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.241071] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a: susp-io( quorum -> no ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.244736] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-2: Starting sender thread (from drbdsetup [11844]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.246247] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.249196] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-3: Starting sender thread (from drbdsetup [11846]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.249965] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a/0 drbd1035: quorum( no -> yes ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.254721] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9: susp-io( no -> quorum ) [connect] Mar 17 01:54:35 offine-stand-stor-0 [ 140.255878] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a/0 drbd1035 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.256826] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:35 offine-stand-stor-0 [ 140.257754] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-2: Preparing remote state change 1542851523 Mar 17 01:54:35 offine-stand-stor-0 [ 140.259524] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-b245 [11840]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.260652] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:35 offine-stand-stor-0 [ 140.264607] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb/0 drbd1125 offline-stand-stor-4: my exposed UUID: 1923AE99F3A469A0 Mar 17 01:54:35 offine-stand-stor-0 [ 140.265537] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:35 offine-stand-stor-0 [ 140.265754] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:35 offine-stand-stor-0 [ 140.265756] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-b245 [11840]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.267095] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb/0 drbd1125 offline-stand-stor-4: peer 1923AE99F3A469A0:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:35 offine-stand-stor-0 [ 140.268196] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:35 offine-stand-stor-0 [ 140.276587] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:35 offine-stand-stor-0 [ 140.279074] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-2: Preparing remote state change 3919356963 Mar 17 01:54:35 offine-stand-stor-0 [ 140.282253] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-4: Committing remote state change 3585114267 (primary_nodes=0) Mar 17 01:54:35 offine-stand-stor-0 [ 140.294248] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a/0 drbd1035 offline-stand-stor-2: my exposed UUID: E35515476D11FC82 Mar 17 01:54:35 offine-stand-stor-0 [ 140.294253] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a/0 drbd1035 offline-stand-stor-2: peer E35515476D11FC82:650D22FD6AC90234:B4898D2846177786:0000000000000000 bits:0 flags:1120 Mar 17 01:54:35 offine-stand-stor-0 [ 140.310958] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-2: Committing remote state change 1542851523 (primary_nodes=0) Mar 17 01:54:35 offine-stand-stor-0 [ 140.310969] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.310972] drbd pvc-a98a39ce-039c-4d4e-a964-fa3a9350515a/0 drbd1035 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.318273] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a: Starting worker thread (from drbdsetup [11869]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.329654] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-2: Starting sender thread (from drbdsetup [11874]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.333212] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.335912] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-3: Starting sender thread (from drbdsetup [11876]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.337119] drbd pvc-9fed7ac4-1b9c-4638-bcdd-1540e8dc9bdb/0 drbd1125 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.359054] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076: meta-data IO uses: blk-bio Mar 17 01:54:35 offine-stand-stor-0 [ 140.359506] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:35 offine-stand-stor-0 [ 140.361901] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:35 offine-stand-stor-0 [ 140.362139] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a: susp-io( no -> quorum ) [attach] Mar 17 01:54:35 offine-stand-stor-0 [ 140.362142] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:35 offine-stand-stor-0 [ 140.362156] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076: Maximum number of peer devices = 7 Mar 17 01:54:35 offine-stand-stor-0 [ 140.362792] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a: Method to ensure write ordering: flush Mar 17 01:54:35 offine-stand-stor-0 [ 140.362831] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:35 offine-stand-stor-0 [ 140.363799] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:35 offine-stand-stor-0 [ 140.368562] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc: Preparing cluster-wide state change 3060411527 (1->2 499/146) Mar 17 01:54:35 offine-stand-stor-0 [ 140.368619] drbd1076: detected capacity change from 0 to 10491632 Mar 17 01:54:35 offine-stand-stor-0 [ 140.377057] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076: size = 5123 MB (5245816 KB) Mar 17 01:54:35 offine-stand-stor-0 [ 140.378666] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20/0 drbd1014 offline-stand-stor-4: my exposed UUID: 332339F78A351D34 Mar 17 01:54:35 offine-stand-stor-0 [ 140.380042] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20/0 drbd1014 offline-stand-stor-4: peer 332339F78A351D34:0C1932419F590227:6FB7181C73F94FAA:3A91706D2D728506 bits:0 flags:1120 Mar 17 01:54:35 offine-stand-stor-0 [ 140.390263] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-4: Committing remote state change 3312752053 (primary_nodes=2) Mar 17 01:54:35 offine-stand-stor-0 [ 140.393942] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Primary ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.397089] drbd pvc-a9e10c0f-8215-470a-8d36-3f1c46524c20/0 drbd1014 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.425544] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076: recounting of set bits took additional 0ms Mar 17 01:54:35 offine-stand-stor-0 [ 140.426552] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:35 offine-stand-stor-0 [ 140.427763] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076: attached to current UUID: 29057B5F0DA61EAC Mar 17 01:54:35 offine-stand-stor-0 [ 140.428800] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076: Setting exposed data uuid: 29057B5F0DA61EAC Mar 17 01:54:35 offine-stand-stor-0 [ 140.432576] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199/0 drbd1091 offline-stand-stor-2: my exposed UUID: C24A8FAF9F883514 Mar 17 01:54:35 offine-stand-stor-0 [ 140.433626] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199/0 drbd1091 offline-stand-stor-2: peer C24A8FAF9F883514:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:35 offine-stand-stor-0 [ 140.439974] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-2: Committing remote state change 3919356963 (primary_nodes=0) Mar 17 01:54:35 offine-stand-stor-0 [ 140.441875] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.443747] drbd pvc-98b12554-1c57-4c72-85c3-b3b28dd83199/0 drbd1091 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.464574] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062 offline-stand-stor-2: self D789202F55C0D77E:0000000000000000:3C76D34D88BE2DBA:0000000000000000 bits:0 flags:0 Mar 17 01:54:35 offine-stand-stor-0 [ 140.466618] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062 offline-stand-stor-2: peer's exposed UUID: D789202F55C0D77E Mar 17 01:54:35 offine-stand-stor-0 [ 140.468426] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc: State change 3060411527: primary_nodes=0, weak_nodes=0 Mar 17 01:54:35 offine-stand-stor-0 [ 140.469338] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc: Committing cluster-wide state change 3060411527 (100ms) Mar 17 01:54:35 offine-stand-stor-0 [ 140.470379] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:35 offine-stand-stor-0 [ 140.472190] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:35 offine-stand-stor-0 [ 140.482427] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:35 offine-stand-stor-0 [ 140.482898] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-3: Preparing remote state change 1493425438 Mar 17 01:54:35 offine-stand-stor-0 [ 140.485358] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:35 offine-stand-stor-0 [ 140.510212] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-b32c [11870]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.518157] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:35 offine-stand-stor-0 [ 140.528794] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:35 offine-stand-stor-0 [ 140.528808] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-b32c [11870]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.545474] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062 offline-stand-stor-3: self D789202F55C0D77E:0000000000000000:3C76D34D88BE2DBA:0000000000000000 bits:0 flags:20 Mar 17 01:54:35 offine-stand-stor-0 [ 140.552578] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:35 offine-stand-stor-0 [ 140.558474] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd: Starting worker thread (from drbdsetup [11915]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.563909] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-1: Starting sender thread (from drbdsetup [11920]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.566055] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-2: Starting sender thread (from drbdsetup [11922]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.591644] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062 offline-stand-stor-3: peer D789202F55C0D77E:0000000000000000:E0009D96B25265DA:D34EDD1192DD14C2 bits:0 flags:1120 Mar 17 01:54:35 offine-stand-stor-0 [ 140.692664] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:35 offine-stand-stor-0 [ 140.692665] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-1: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:35 offine-stand-stor-0 [ 140.692671] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:35 offine-stand-stor-0 [ 140.697640] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:35 offine-stand-stor-0 [ 140.704428] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:35 offine-stand-stor-0 [ 140.706739] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:35 offine-stand-stor-0 [ 140.712582] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:35 offine-stand-stor-0 [ 140.715316] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119: meta-data IO uses: blk-bio Mar 17 01:54:35 offine-stand-stor-0 [ 140.715629] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd: susp-io( no -> quorum ) [attach] Mar 17 01:54:35 offine-stand-stor-0 [ 140.715639] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:35 offine-stand-stor-0 [ 140.715648] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119: Maximum number of peer devices = 7 Mar 17 01:54:35 offine-stand-stor-0 [ 140.716920] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd: Method to ensure write ordering: flush Mar 17 01:54:35 offine-stand-stor-0 [ 140.717006] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:35 offine-stand-stor-0 [ 140.717755] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:35 offine-stand-stor-0 [ 140.717758] drbd1119: detected capacity change from 0 to 10491632 Mar 17 01:54:35 offine-stand-stor-0 [ 140.717760] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119: size = 5123 MB (5245816 KB) Mar 17 01:54:35 offine-stand-stor-0 [ 140.724843] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:35 offine-stand-stor-0 [ 140.724847] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:35 offine-stand-stor-0 [ 140.726268] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:35 offine-stand-stor-0 [ 140.728552] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66: Preparing cluster-wide state change 2377779815 (1->2 499/146) Mar 17 01:54:35 offine-stand-stor-0 [ 140.728960] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:35 offine-stand-stor-0 [ 140.731266] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119: recounting of set bits took additional 0ms Mar 17 01:54:35 offine-stand-stor-0 [ 140.731280] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:35 offine-stand-stor-0 [ 140.731283] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119: attached to current UUID: 6EB953A4AB724E84 Mar 17 01:54:35 offine-stand-stor-0 [ 140.731287] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119: Setting exposed data uuid: 6EB953A4AB724E84 Mar 17 01:54:35 offine-stand-stor-0 [ 140.733414] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-4: Preparing remote state change 3104882076 Mar 17 01:54:35 offine-stand-stor-0 [ 140.734553] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:35 offine-stand-stor-0 [ 140.735453] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-b343 [11916]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.735496] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:35 offine-stand-stor-0 [ 140.741654] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:35 offine-stand-stor-0 [ 140.741684] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-b343 [11916]) Mar 17 01:54:35 offine-stand-stor-0 [ 140.741782] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:35 offine-stand-stor-0 [ 140.749620] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: Aborting local state change 2377779815 to yield to remote state change 1763889512. Mar 17 01:54:35 offine-stand-stor-0 [ 140.772940] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-3: Committing remote state change 1493425438 (primary_nodes=0) Mar 17 01:54:35 offine-stand-stor-0 [ 140.774276] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:35 offine-stand-stor-0 [ 140.774796] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:35 offine-stand-stor-0 [ 140.780793] drbd1025: detected capacity change from 0 to 10491632 Mar 17 01:54:35 offine-stand-stor-0 [ 140.798235] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:35 offine-stand-stor-0 [ 140.798239] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:35 offine-stand-stor-0 [ 140.801337] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:35 offine-stand-stor-0 [ 140.802126] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:35 offine-stand-stor-0 [ 140.802181] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99/0 drbd1025: size = 5123 MB (5245816 KB) Mar 17 01:54:35 offine-stand-stor-0 [ 140.802298] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99/0 drbd1025 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:35 offine-stand-stor-0 [ 140.802498] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc: susp-io( quorum -> no ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.802542] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.802586] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062: quorum( no -> yes ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.802715] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:35 offine-stand-stor-0 [ 140.804350] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:35 offine-stand-stor-0 [ 140.806479] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99/0 drbd1025 offline-stand-stor-4: peer 5B09F48C2E4B4EEE:3716AA02F6C730DE:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:35 offine-stand-stor-0 [ 140.809117] drbd pvc-ab2d4b19-e646-4310-af81-15b9c3c6b1cc/0 drbd1062 offline-stand-stor-3: cleared bm UUID and bitmap D789202F55C0D77E:0000000000000000:3C76D34D88BE2DBA:0000000000000000 Mar 17 01:54:35 offine-stand-stor-0 [ 140.810107] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99/0 drbd1025: Setting exposed data uuid: 5B09F48C2E4B4EEE Mar 17 01:54:35 offine-stand-stor-0 [ 140.810767] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:35 offine-stand-stor-0 [ 140.812825] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b: Starting worker thread (from drbdsetup [11960]) Mar 17 01:54:36 offine-stand-stor-0 [ 140.817127] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-2: Starting sender thread (from drbdsetup [11965]) Mar 17 01:54:36 offine-stand-stor-0 [ 140.819601] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-3: Starting sender thread (from drbdsetup [11967]) Mar 17 01:54:36 offine-stand-stor-0 [ 140.822265] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123 offline-stand-stor-1: self 829492204A41A12A:0000000000000000:C2F47F1BE7A3A22E:0000000000000000 bits:0 flags:0 Mar 17 01:54:36 offine-stand-stor-0 [ 140.822270] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123 offline-stand-stor-1: peer's exposed UUID: 829492204A41A12A Mar 17 01:54:36 offine-stand-stor-0 [ 140.822284] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66: Aborting cluster-wide state change 2377779815 (92ms) rv = -19 Mar 17 01:54:36 offine-stand-stor-0 [ 140.822345] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: Preparing remote state change 1763889512 Mar 17 01:54:36 offine-stand-stor-0 [ 140.891219] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-4: Committing remote state change 3104882076 (primary_nodes=0) Mar 17 01:54:36 offine-stand-stor-0 [ 140.891725] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-3: Preparing remote state change 290613311 Mar 17 01:54:36 offine-stand-stor-0 [ 140.893348] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 140.893351] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99/0 drbd1025 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 140.893393] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-1: Preparing remote state change 404895115 Mar 17 01:54:36 offine-stand-stor-0 [ 140.909739] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077: meta-data IO uses: blk-bio Mar 17 01:54:36 offine-stand-stor-0 [ 140.911272] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b: susp-io( no -> quorum ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 140.912486] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 140.913769] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077: Maximum number of peer devices = 7 Mar 17 01:54:36 offine-stand-stor-0 [ 140.915854] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b: Method to ensure write ordering: flush Mar 17 01:54:36 offine-stand-stor-0 [ 140.917160] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:36 offine-stand-stor-0 [ 140.919803] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:36 offine-stand-stor-0 [ 140.921850] drbd1077: detected capacity change from 0 to 10491632 Mar 17 01:54:36 offine-stand-stor-0 [ 140.923599] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077: size = 5123 MB (5245816 KB) Mar 17 01:54:36 offine-stand-stor-0 [ 140.931704] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077: recounting of set bits took additional 0ms Mar 17 01:54:36 offine-stand-stor-0 [ 140.933097] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 140.934211] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077: attached to current UUID: 7611A9AFA9116866 Mar 17 01:54:36 offine-stand-stor-0 [ 140.935299] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077: Setting exposed data uuid: 7611A9AFA9116866 Mar 17 01:54:36 offine-stand-stor-0 [ 140.938983] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 140.940806] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-b53b [11961]) Mar 17 01:54:36 offine-stand-stor-0 [ 140.941672] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 140.943782] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:36 offine-stand-stor-0 [ 140.943784] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-b53b [11961]) Mar 17 01:54:36 offine-stand-stor-0 [ 140.948810] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:36 offine-stand-stor-0 [ 140.980573] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99/0 drbd1025 offline-stand-stor-1: my exposed UUID: 5B09F48C2E4B4EEE Mar 17 01:54:36 offine-stand-stor-0 [ 140.980598] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123 offline-stand-stor-4: drbd_sync_handshake: Mar 17 01:54:36 offine-stand-stor-0 [ 140.981433] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99/0 drbd1025 offline-stand-stor-1: peer 5B09F48C2E4B4EEE:3716AA02F6C730DE:3716AA02F6C730DE:0000000000000000 bits:0 flags:1120 Mar 17 01:54:36 offine-stand-stor-0 [ 140.982203] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123 offline-stand-stor-4: self 829492204A41A12A:0000000000000000:C2F47F1BE7A3A22E:0000000000000000 bits:0 flags:20 Mar 17 01:54:36 offine-stand-stor-0 [ 140.985518] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123 offline-stand-stor-4: peer 829492204A41A12A:0000000000000000:2B77A521DA8ACBBA:4C3726B8418C5F00 bits:0 flags:1120 Mar 17 01:54:36 offine-stand-stor-0 [ 140.987633] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123 offline-stand-stor-4: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:36 offine-stand-stor-0 [ 140.989844] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: Aborting remote state change 1763889512 Mar 17 01:54:36 offine-stand-stor-0 [ 140.990755] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66: Preparing cluster-wide state change 3938650393 (1->2 499/146) Mar 17 01:54:36 offine-stand-stor-0 [ 140.991858] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: Aborting local state change 3938650393 to yield to remote state change 709003198. Mar 17 01:54:36 offine-stand-stor-0 [ 140.992563] drbd1038: detected capacity change from 0 to 10491632 Mar 17 01:54:36 offine-stand-stor-0 [ 140.994771] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9/0 drbd1038: size = 5123 MB (5245816 KB) Mar 17 01:54:36 offine-stand-stor-0 [ 140.995687] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9/0 drbd1038 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:36 offine-stand-stor-0 [ 140.996722] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9/0 drbd1038 offline-stand-stor-3: peer C6EC8E9221295DE4:0000000000000000:C3DFF5A80F81D796:413C62A655E8F4C0 bits:0 flags:1120 Mar 17 01:54:36 offine-stand-stor-0 [ 140.998758] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9/0 drbd1038: Setting exposed data uuid: C6EC8E9221295DE4 Mar 17 01:54:36 offine-stand-stor-0 [ 141.000713] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-1: Committing remote state change 404895115 (primary_nodes=0) Mar 17 01:54:36 offine-stand-stor-0 [ 141.002240] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.003687] drbd pvc-b054acc7-d99c-4633-9172-1c68c4734f99/0 drbd1025 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.008289] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-3: Committing remote state change 290613311 (primary_nodes=0) Mar 17 01:54:36 offine-stand-stor-0 [ 141.010395] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9: susp-io( quorum -> no ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.011316] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.013291] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9/0 drbd1038: quorum( no -> yes ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.014260] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9/0 drbd1038 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.019618] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f: Starting worker thread (from drbdsetup [12002]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.024819] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-2: Starting sender thread (from drbdsetup [12007]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.028366] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-3: Starting sender thread (from drbdsetup [12009]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.031749] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-2: Preparing remote state change 4277131116 Mar 17 01:54:36 offine-stand-stor-0 [ 141.046132] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068: meta-data IO uses: blk-bio Mar 17 01:54:36 offine-stand-stor-0 [ 141.047303] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f: susp-io( no -> quorum ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 141.048277] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 141.049278] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068: Maximum number of peer devices = 7 Mar 17 01:54:36 offine-stand-stor-0 [ 141.051242] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f: Method to ensure write ordering: flush Mar 17 01:54:36 offine-stand-stor-0 [ 141.052413] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:36 offine-stand-stor-0 [ 141.054505] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:36 offine-stand-stor-0 [ 141.056029] drbd1068: detected capacity change from 0 to 10491632 Mar 17 01:54:36 offine-stand-stor-0 [ 141.057190] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068: size = 5123 MB (5245816 KB) Mar 17 01:54:36 offine-stand-stor-0 [ 141.066146] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068: recounting of set bits took additional 0ms Mar 17 01:54:36 offine-stand-stor-0 [ 141.067093] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 141.067988] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068: attached to current UUID: 58AED534EB27D3A4 Mar 17 01:54:36 offine-stand-stor-0 [ 141.068924] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068: Setting exposed data uuid: 58AED534EB27D3A4 Mar 17 01:54:36 offine-stand-stor-0 [ 141.072188] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 141.073894] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-b5c9 [12003]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.074925] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 141.076624] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:36 offine-stand-stor-0 [ 141.076782] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-b5c9 [12003]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.076819] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:36 offine-stand-stor-0 [ 141.079024] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:36 offine-stand-stor-0 [ 141.081214] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:36 offine-stand-stor-0 [ 141.084364] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:36 offine-stand-stor-0 [ 141.092609] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a: Preparing cluster-wide state change 3474316300 (1->2 499/146) Mar 17 01:54:36 offine-stand-stor-0 [ 141.108619] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9/0 drbd1038 offline-stand-stor-2: my exposed UUID: C6EC8E9221295DE4 Mar 17 01:54:36 offine-stand-stor-0 [ 141.110421] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9/0 drbd1038 offline-stand-stor-2: peer C6EC8E9221295DE4:C3DFF5A80F81D796:069BEE957D980142:0000000000000000 bits:0 flags:1120 Mar 17 01:54:36 offine-stand-stor-0 [ 141.113848] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:36 offine-stand-stor-0 [ 141.116542] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:36 offine-stand-stor-0 [ 141.120651] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-2: Committing remote state change 4277131116 (primary_nodes=0) Mar 17 01:54:36 offine-stand-stor-0 [ 141.124335] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.127410] drbd pvc-b245fa52-47b5-48d3-8a15-64e36205c6e9/0 drbd1038 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.131015] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1: Starting worker thread (from drbdsetup [12035]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.136091] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:36 offine-stand-stor-0 [ 141.138169] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-1: Starting sender thread (from drbdsetup [12040]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.143463] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-4: Starting sender thread (from drbdsetup [12043]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.149350] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1: susp-io( no -> quorum ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 141.150361] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 141.151435] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-b871 [12036]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.153169] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 141.155715] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-b871 [12036]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.155798] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:36 offine-stand-stor-0 [ 141.163660] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:36 offine-stand-stor-0 [ 141.196823] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076 offline-stand-stor-2: self 29057B5F0DA61EAC:0000000000000000:404C5D7C732EFE0C:0000000000000000 bits:0 flags:0 Mar 17 01:54:36 offine-stand-stor-0 [ 141.200013] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076 offline-stand-stor-2: peer's exposed UUID: 29057B5F0DA61EAC Mar 17 01:54:36 offine-stand-stor-0 [ 141.203437] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a: State change 3474316300: primary_nodes=0, weak_nodes=0 Mar 17 01:54:36 offine-stand-stor-0 [ 141.205127] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a: Committing cluster-wide state change 3474316300 (112ms) Mar 17 01:54:36 offine-stand-stor-0 [ 141.206797] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:36 offine-stand-stor-0 [ 141.210093] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:36 offine-stand-stor-0 [ 141.233492] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-3: Preparing remote state change 778510439 Mar 17 01:54:36 offine-stand-stor-0 [ 141.234248] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d: Starting worker thread (from drbdsetup [12068]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.248148] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-2: Starting sender thread (from drbdsetup [12073]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.252018] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-3: Starting sender thread (from drbdsetup [12075]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.260331] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-1: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:36 offine-stand-stor-0 [ 141.263160] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:36 offine-stand-stor-0 [ 141.268050] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:36 offine-stand-stor-0 [ 141.268624] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:36 offine-stand-stor-0 [ 141.269262] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076 offline-stand-stor-3: self 29057B5F0DA61EAC:0000000000000000:404C5D7C732EFE0C:0000000000000000 bits:0 flags:20 Mar 17 01:54:36 offine-stand-stor-0 [ 141.269266] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076 offline-stand-stor-3: peer 29057B5F0DA61EAC:0000000000000000:55EBE15F5C0ED68C:30E43A70F2D2D7DE bits:34 flags:1120 Mar 17 01:54:36 offine-stand-stor-0 [ 141.271097] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:36 offine-stand-stor-0 [ 141.272015] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016: meta-data IO uses: blk-bio Mar 17 01:54:36 offine-stand-stor-0 [ 141.272126] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d: susp-io( no -> quorum ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 141.272128] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 141.272134] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016: Maximum number of peer devices = 7 Mar 17 01:54:36 offine-stand-stor-0 [ 141.272724] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d: Method to ensure write ordering: flush Mar 17 01:54:36 offine-stand-stor-0 [ 141.272829] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:36 offine-stand-stor-0 [ 141.273026] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:36 offine-stand-stor-0 [ 141.273729] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:36 offine-stand-stor-0 [ 141.280520] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:36 offine-stand-stor-0 [ 141.281195] drbd1016: detected capacity change from 0 to 10491632 Mar 17 01:54:36 offine-stand-stor-0 [ 141.281198] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016: size = 5123 MB (5245816 KB) Mar 17 01:54:36 offine-stand-stor-0 [ 141.289529] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:36 offine-stand-stor-0 [ 141.292721] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd: Preparing cluster-wide state change 2017589438 (1->2 499/146) Mar 17 01:54:36 offine-stand-stor-0 [ 141.298107] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016: recounting of set bits took additional 0ms Mar 17 01:54:36 offine-stand-stor-0 [ 141.299728] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 141.301887] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016: attached to current UUID: 4695B6E26D0B5DCC Mar 17 01:54:36 offine-stand-stor-0 [ 141.303691] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016: Setting exposed data uuid: 4695B6E26D0B5DCC Mar 17 01:54:36 offine-stand-stor-0 [ 141.306532] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-3: Committing remote state change 778510439 (primary_nodes=0) Mar 17 01:54:36 offine-stand-stor-0 [ 141.307657] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 141.308523] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a: susp-io( quorum -> no ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.309695] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-b895 [12069]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.310342] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.310435] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 141.313095] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:36 offine-stand-stor-0 [ 141.313117] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-b895 [12069]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.314706] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076: quorum( no -> yes ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.315885] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:36 offine-stand-stor-0 [ 141.317619] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.323714] drbd pvc-b32cb6c2-a216-4fc4-867b-fe62126cd80a/0 drbd1076 offline-stand-stor-3: cleared bm UUID and bitmap 29057B5F0DA61EAC:0000000000000000:404C5D7C732EFE0C:0000000000000000 Mar 17 01:54:36 offine-stand-stor-0 [ 141.348574] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119 offline-stand-stor-1: self 6EB953A4AB724E84:0000000000000000:D773B7B62524DE1E:0000000000000000 bits:0 flags:0 Mar 17 01:54:36 offine-stand-stor-0 [ 141.351340] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119 offline-stand-stor-1: peer's exposed UUID: 6EB953A4AB724E84 Mar 17 01:54:36 offine-stand-stor-0 [ 141.354114] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd: State change 2017589438: primary_nodes=0, weak_nodes=0 Mar 17 01:54:36 offine-stand-stor-0 [ 141.355504] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd: Committing cluster-wide state change 2017589438 (60ms) Mar 17 01:54:36 offine-stand-stor-0 [ 141.357060] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:36 offine-stand-stor-0 [ 141.359945] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119 offline-stand-stor-1: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:36 offine-stand-stor-0 [ 141.361135] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506: Starting worker thread (from drbdsetup [12110]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.368034] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-2: Starting sender thread (from drbdsetup [12115]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.371820] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-4: Starting sender thread (from drbdsetup [12117]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.379606] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-2: Preparing remote state change 2783678565 Mar 17 01:54:36 offine-stand-stor-0 [ 141.389271] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078: meta-data IO uses: blk-bio Mar 17 01:54:36 offine-stand-stor-0 [ 141.390591] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 141.391676] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078: Maximum number of peer devices = 7 Mar 17 01:54:36 offine-stand-stor-0 [ 141.393659] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506: Method to ensure write ordering: flush Mar 17 01:54:36 offine-stand-stor-0 [ 141.394700] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:36 offine-stand-stor-0 [ 141.396186] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:36 offine-stand-stor-0 [ 141.397304] drbd1078: detected capacity change from 0 to 10491632 Mar 17 01:54:36 offine-stand-stor-0 [ 141.398410] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078: size = 5123 MB (5245816 KB) Mar 17 01:54:36 offine-stand-stor-0 [ 141.405758] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078: recounting of set bits took additional 0ms Mar 17 01:54:36 offine-stand-stor-0 [ 141.406758] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 141.407726] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078: attached to current UUID: EFDC961863D26C7A Mar 17 01:54:36 offine-stand-stor-0 [ 141.408687] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078: Setting exposed data uuid: EFDC961863D26C7A Mar 17 01:54:36 offine-stand-stor-0 [ 141.411858] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 141.413485] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-b9a9 [12111]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.414250] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 141.416973] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-b9a9 [12111]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.416990] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:36 offine-stand-stor-0 [ 141.421566] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:36 offine-stand-stor-0 [ 141.431597] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:36 offine-stand-stor-0 [ 141.433048] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119 offline-stand-stor-2: self 6EB953A4AB724E84:0000000000000000:D773B7B62524DE1E:0000000000000000 bits:0 flags:20 Mar 17 01:54:36 offine-stand-stor-0 [ 141.435819] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119 offline-stand-stor-2: peer 6EB953A4AB724E84:0000000000000000:B878CD9EED0929D0:D0B7AA9873AC00F2 bits:0 flags:1120 Mar 17 01:54:36 offine-stand-stor-0 [ 141.438556] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:36 offine-stand-stor-0 [ 141.457916] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-2: Committing remote state change 2783678565 (primary_nodes=0) Mar 17 01:54:36 offine-stand-stor-0 [ 141.460424] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd: susp-io( quorum -> no ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.461680] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.464152] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119: quorum( no -> yes ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.465444] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.468177] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-3: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:36 offine-stand-stor-0 [ 141.468221] drbd pvc-b3430fc2-3b88-4132-aeb7-4cf6f5637ffd/0 drbd1119 offline-stand-stor-2: cleared bm UUID and bitmap 6EB953A4AB724E84:0000000000000000:D773B7B62524DE1E:0000000000000000 Mar 17 01:54:36 offine-stand-stor-0 [ 141.470167] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:36 offine-stand-stor-0 [ 141.472050] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8: Starting worker thread (from drbdsetup [12150]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.473124] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:36 offine-stand-stor-0 [ 141.478764] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-2: Starting sender thread (from drbdsetup [12155]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.478902] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:36 offine-stand-stor-0 [ 141.483279] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-3: Starting sender thread (from drbdsetup [12157]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.490429] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:36 offine-stand-stor-0 [ 141.496573] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66: Aborting cluster-wide state change 3938650393 (508ms) rv = -19 Mar 17 01:54:36 offine-stand-stor-0 [ 141.502365] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:36 offine-stand-stor-0 [ 141.503370] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023: meta-data IO uses: blk-bio Mar 17 01:54:36 offine-stand-stor-0 [ 141.503753] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8: susp-io( no -> quorum ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 141.503757] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 141.503772] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023: Maximum number of peer devices = 7 Mar 17 01:54:36 offine-stand-stor-0 [ 141.504638] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8: Method to ensure write ordering: flush Mar 17 01:54:36 offine-stand-stor-0 [ 141.504726] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:36 offine-stand-stor-0 [ 141.505612] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:36 offine-stand-stor-0 [ 141.505622] drbd1023: detected capacity change from 0 to 10491632 Mar 17 01:54:36 offine-stand-stor-0 [ 141.505624] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023: size = 5123 MB (5245816 KB) Mar 17 01:54:36 offine-stand-stor-0 [ 141.514811] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-2: Preparing remote state change 1114882029 Mar 17 01:54:36 offine-stand-stor-0 [ 141.517987] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023: recounting of set bits took additional 0ms Mar 17 01:54:36 offine-stand-stor-0 [ 141.518004] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 141.518008] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023: attached to current UUID: 7057BBA0643027A6 Mar 17 01:54:36 offine-stand-stor-0 [ 141.518011] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023: Setting exposed data uuid: 7057BBA0643027A6 Mar 17 01:54:36 offine-stand-stor-0 [ 141.526157] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: Preparing remote state change 709003198 Mar 17 01:54:36 offine-stand-stor-0 [ 141.530334] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 141.563143] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-bec2 [12151]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.564706] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:36 offine-stand-stor-0 [ 141.564820] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 141.567939] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:36 offine-stand-stor-0 [ 141.567964] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-bec2 [12151]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.569280] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077 offline-stand-stor-2: self 7611A9AFA9116866:0000000000000000:6626E5C991F9100E:0000000000000000 bits:0 flags:20 Mar 17 01:54:36 offine-stand-stor-0 [ 141.573300] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:36 offine-stand-stor-0 [ 141.575630] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077 offline-stand-stor-2: peer 7611A9AFA9116866:0000000000000000:5B618A186412350A:798A40B89EA31D80 bits:34 flags:1120 Mar 17 01:54:36 offine-stand-stor-0 [ 141.583316] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:36 offine-stand-stor-0 [ 141.585856] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123 offline-stand-stor-4: drbd_sync_handshake: Mar 17 01:54:36 offine-stand-stor-0 [ 141.593337] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-2: Committing remote state change 1114882029 (primary_nodes=0) Mar 17 01:54:36 offine-stand-stor-0 [ 141.606942] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123 offline-stand-stor-4: self 829492204A41A12A:0000000000000000:C2F47F1BE7A3A22E:0000000000000000 bits:0 flags:20 Mar 17 01:54:36 offine-stand-stor-0 [ 141.606948] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123 offline-stand-stor-4: peer 829492204A41A12A:0000000000000000:2B77A521DA8ACBBA:4C3726B8418C5F00 bits:0 flags:1120 Mar 17 01:54:36 offine-stand-stor-0 [ 141.606980] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123 offline-stand-stor-4: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:36 offine-stand-stor-0 [ 141.608656] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:36 offine-stand-stor-0 [ 141.608659] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:36 offine-stand-stor-0 [ 141.610286] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b: susp-io( quorum -> no ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.610289] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.610291] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077: quorum( no -> yes ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.610299] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.610420] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077 offline-stand-stor-2: cleared bm UUID and bitmap 7611A9AFA9116866:0000000000000000:6626E5C991F9100E:0000000000000000 Mar 17 01:54:36 offine-stand-stor-0 [ 141.613250] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:36 offine-stand-stor-0 [ 141.614533] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c: Starting worker thread (from drbdsetup [12185]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.620943] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-1: Starting sender thread (from drbdsetup [12190]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.622266] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-2: Starting sender thread (from drbdsetup [12192]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.627929] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c: susp-io( no -> quorum ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 141.627932] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 141.628001] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-ca27 [12186]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.628079] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:36 offine-stand-stor-0 [ 141.629278] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:36 offine-stand-stor-0 [ 141.629344] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-ca27 [12186]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.630248] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:36 offine-stand-stor-0 [ 141.656592] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f: Preparing cluster-wide state change 1767266631 (1->2 499/146) Mar 17 01:54:36 offine-stand-stor-0 [ 141.656747] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:36 offine-stand-stor-0 [ 141.659203] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b: Preparing cluster-wide state change 1768999148 (1->2 499/146) Mar 17 01:54:36 offine-stand-stor-0 [ 141.684602] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:36 offine-stand-stor-0 [ 141.684817] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:36 offine-stand-stor-0 [ 141.685306] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:36 offine-stand-stor-0 [ 141.685309] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:36 offine-stand-stor-0 [ 141.687184] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:36 offine-stand-stor-0 [ 141.696665] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: Committing remote state change 709003198 (primary_nodes=0) Mar 17 01:54:36 offine-stand-stor-0 [ 141.696811] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:36 offine-stand-stor-0 [ 141.697702] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:36 offine-stand-stor-0 [ 141.708550] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068 offline-stand-stor-2: self 58AED534EB27D3A4:F65240401FE725C2:C82C362C1024C36C:0000000000000000 bits:0 flags:0 Mar 17 01:54:36 offine-stand-stor-0 [ 141.729265] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-4: Preparing remote state change 3204155348 Mar 17 01:54:36 offine-stand-stor-0 [ 141.738612] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d: Starting worker thread (from drbdsetup [12217]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.743326] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-2: Starting sender thread (from drbdsetup [12222]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.745270] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-3: Starting sender thread (from drbdsetup [12224]) Mar 17 01:54:36 offine-stand-stor-0 [ 141.748046] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66: susp-io( quorum -> no ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.750125] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068 offline-stand-stor-2: peer's exposed UUID: 58AED534EB27D3A4 Mar 17 01:54:36 offine-stand-stor-0 [ 141.750603] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f: State change 1767266631: primary_nodes=0, weak_nodes=0 Mar 17 01:54:36 offine-stand-stor-0 [ 141.783220] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.783224] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123: quorum( no -> yes ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.783228] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:36 offine-stand-stor-0 [ 141.783388] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048: meta-data IO uses: blk-bio Mar 17 01:54:36 offine-stand-stor-0 [ 141.785438] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f: Committing cluster-wide state change 1767266631 (128ms) Mar 17 01:54:36 offine-stand-stor-0 [ 141.785714] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:36 offine-stand-stor-0 [ 141.787234] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-1: Rejecting concurrent remote state change 3132225913 because of state change 3204155348 Mar 17 01:54:36 offine-stand-stor-0 [ 141.790787] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:36 offine-stand-stor-0 [ 141.792573] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077 offline-stand-stor-3: self 7611A9AFA9116866:0000000000000000:6626E5C991F9100E:0000000000000000 bits:0 flags:0 Mar 17 01:54:36 offine-stand-stor-0 [ 141.792577] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077 offline-stand-stor-3: peer's exposed UUID: 7611A9AFA9116866 Mar 17 01:54:36 offine-stand-stor-0 [ 141.792594] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b: State change 1768999148: primary_nodes=0, weak_nodes=0 Mar 17 01:54:36 offine-stand-stor-0 [ 141.793717] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:36 offine-stand-stor-0 [ 141.794770] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123 offline-stand-stor-4: cleared bm UUID and bitmap 829492204A41A12A:0000000000000000:C2F47F1BE7A3A22E:0000000000000000 Mar 17 01:54:36 offine-stand-stor-0 [ 141.796401] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b: Committing cluster-wide state change 1768999148 (136ms) Mar 17 01:54:36 offine-stand-stor-0 [ 141.799959] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d: susp-io( no -> quorum ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 141.800361] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:36 offine-stand-stor-0 [ 141.800869] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66: Preparing cluster-wide state change 288286081 (1->2 499/146) Mar 17 01:54:36 offine-stand-stor-0 [ 141.802352] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 141.803372] drbd pvc-b53bd394-579c-4715-8314-817aba32ea4b/0 drbd1077 offline-stand-stor-3: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:36 offine-stand-stor-0 [ 141.805937] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048: Maximum number of peer devices = 7 Mar 17 01:54:36 offine-stand-stor-0 [ 141.824681] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-3: Preparing remote state change 3509923544 Mar 17 01:54:36 offine-stand-stor-0 [ 141.825933] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d: Method to ensure write ordering: flush Mar 17 01:54:36 offine-stand-stor-0 [ 141.826492] drbd1059: detected capacity change from 0 to 10491632 Mar 17 01:54:36 offine-stand-stor-0 [ 141.828635] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:36 offine-stand-stor-0 [ 141.829796] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1/0 drbd1059: size = 5123 MB (5245816 KB) Mar 17 01:54:36 offine-stand-stor-0 [ 141.831491] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:36 offine-stand-stor-0 [ 141.832975] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1/0 drbd1059 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:36 offine-stand-stor-0 [ 141.834032] drbd1048: detected capacity change from 0 to 10491632 Mar 17 01:54:36 offine-stand-stor-0 [ 141.835116] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1/0 drbd1059 offline-stand-stor-4: peer 1DAB96F2D97A30A8:0000000000000000:0A12912B089887FE:0000000000000000 bits:0 flags:1120 Mar 17 01:54:36 offine-stand-stor-0 [ 141.836123] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048: size = 5123 MB (5245816 KB) Mar 17 01:54:36 offine-stand-stor-0 [ 141.837383] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1/0 drbd1059: Setting exposed data uuid: 1DAB96F2D97A30A8 Mar 17 01:54:36 offine-stand-stor-0 [ 141.837323] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123 offline-stand-stor-1: self 829492204A41A12A:0000000000000000:C2F47F1BE7A3A22E:0000000000000000 bits:0 flags:0 Mar 17 01:54:36 offine-stand-stor-0 [ 141.837432] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123 offline-stand-stor-1: peer's exposed UUID: 829492204A41A12A Mar 17 01:54:36 offine-stand-stor-0 [ 141.844626] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:36 offine-stand-stor-0 [ 141.844975] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1/0 drbd1059 offline-stand-stor-1: my exposed UUID: 1DAB96F2D97A30A8 Mar 17 01:54:36 offine-stand-stor-0 [ 141.846856] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:36 offine-stand-stor-0 [ 141.847919] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1/0 drbd1059 offline-stand-stor-1: peer 1DAB96F2D97A30A8:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:36 offine-stand-stor-0 [ 141.851851] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-3: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:36 offine-stand-stor-0 [ 141.852035] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:36 offine-stand-stor-0 [ 141.854845] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-4: Aborting remote state change 3204155348 Mar 17 01:54:36 offine-stand-stor-0 [ 141.855871] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048: recounting of set bits took additional 0ms Mar 17 01:54:36 offine-stand-stor-0 [ 141.855880] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:36 offine-stand-stor-0 [ 141.855889] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048: attached to current UUID: 150E1F7F6FA63506 Mar 17 01:54:36 offine-stand-stor-0 [ 141.855892] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048: Setting exposed data uuid: 150E1F7F6FA63506 Mar 17 01:54:36 offine-stand-stor-0 [ 141.856555] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d: Preparing cluster-wide state change 1256999875 (0->1 499/146) Mar 17 01:54:36 offine-stand-stor-0 [ 141.858095] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66: State change 288286081: primary_nodes=0, weak_nodes=0 Mar 17 01:54:36 offine-stand-stor-0 [ 141.858098] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66: Committing cluster-wide state change 288286081 (56ms) Mar 17 01:54:36 offine-stand-stor-0 [ 141.858190] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 141.858194] drbd pvc-ab73d322-ec01-4696-8fb3-b375c2229a66/0 drbd1123 offline-stand-stor-1: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 141.858485] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:37 offine-stand-stor-0 [ 141.861392] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:37 offine-stand-stor-0 [ 141.862277] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:37 offine-stand-stor-0 [ 141.866514] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:37 offine-stand-stor-0 [ 141.867756] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068 offline-stand-stor-3: self 58AED534EB27D3A4:0000000000000000:C82C362C1024C36C:0000000000000000 bits:0 flags:20 Mar 17 01:54:37 offine-stand-stor-0 [ 141.883705] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-cdf9 [12218]) Mar 17 01:54:37 offine-stand-stor-0 [ 141.884557] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068 offline-stand-stor-3: peer 58AED534EB27D3A4:0000000000000000:7FAC69936F522350:1531A75440DDF15C bits:0 flags:1120 Mar 17 01:54:37 offine-stand-stor-0 [ 141.885492] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:37 offine-stand-stor-0 [ 141.885499] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-cdf9 [12218]) Mar 17 01:54:37 offine-stand-stor-0 [ 141.886886] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:37 offine-stand-stor-0 [ 141.886919] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:37 offine-stand-stor-0 [ 141.889272] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-3: Committing remote state change 3509923544 (primary_nodes=0) Mar 17 01:54:37 offine-stand-stor-0 [ 141.902210] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:37 offine-stand-stor-0 [ 141.902701] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f: susp-io( quorum -> no ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 141.908160] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 141.910327] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068: quorum( no -> yes ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 141.911370] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 141.911817] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:37 offine-stand-stor-0 [ 141.913755] drbd pvc-b5c909a9-3ffd-4d72-ac80-87fe0f819e1f/0 drbd1068 offline-stand-stor-3: cleared bm UUID and bitmap 58AED534EB27D3A4:0000000000000000:C82C362C1024C36C:0000000000000000 Mar 17 01:54:37 offine-stand-stor-0 [ 141.917886] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6: Starting worker thread (from drbdsetup [12252]) Mar 17 01:54:37 offine-stand-stor-0 [ 141.921825] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-2: Starting sender thread (from drbdsetup [12257]) Mar 17 01:54:37 offine-stand-stor-0 [ 141.926282] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-3: Starting sender thread (from drbdsetup [12259]) Mar 17 01:54:37 offine-stand-stor-0 [ 141.930057] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6: susp-io( no -> quorum ) [connect] Mar 17 01:54:37 offine-stand-stor-0 [ 141.930059] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:37 offine-stand-stor-0 [ 141.930087] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-d30f [12253]) Mar 17 01:54:37 offine-stand-stor-0 [ 141.930298] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:37 offine-stand-stor-0 [ 141.931255] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:37 offine-stand-stor-0 [ 141.931277] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-d30f [12253]) Mar 17 01:54:37 offine-stand-stor-0 [ 141.931337] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:37 offine-stand-stor-0 [ 141.938449] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016 offline-stand-stor-2: self 4695B6E26D0B5DCC:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:20 Mar 17 01:54:37 offine-stand-stor-0 [ 141.940933] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:37 offine-stand-stor-0 [ 141.962096] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:37 offine-stand-stor-0 [ 141.962100] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:37 offine-stand-stor-0 [ 141.963499] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016 offline-stand-stor-2: peer 4695B6E26D0B5DCC:0000000000000000:62C14EC64AEAC15C:08C081ECF6F00024 bits:0 flags:1120 Mar 17 01:54:37 offine-stand-stor-0 [ 141.963744] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:37 offine-stand-stor-0 [ 141.965843] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:37 offine-stand-stor-0 [ 141.966451] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:37 offine-stand-stor-0 [ 141.971003] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde: Starting worker thread (from drbdsetup [12274]) Mar 17 01:54:37 offine-stand-stor-0 [ 141.975117] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-1: Starting sender thread (from drbdsetup [12279]) Mar 17 01:54:37 offine-stand-stor-0 [ 141.976671] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-4: Starting sender thread (from drbdsetup [12281]) Mar 17 01:54:37 offine-stand-stor-0 [ 141.977399] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:37 offine-stand-stor-0 [ 141.980576] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506: Preparing cluster-wide state change 3772166118 (1->2 499/146) Mar 17 01:54:37 offine-stand-stor-0 [ 141.980744] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde: susp-io( no -> quorum ) [connect] Mar 17 01:54:37 offine-stand-stor-0 [ 141.980747] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:37 offine-stand-stor-0 [ 141.980836] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-d350 [12275]) Mar 17 01:54:37 offine-stand-stor-0 [ 141.981093] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:37 offine-stand-stor-0 [ 141.985208] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:37 offine-stand-stor-0 [ 141.985239] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-d350 [12275]) Mar 17 01:54:37 offine-stand-stor-0 [ 141.985542] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:37 offine-stand-stor-0 [ 142.016831] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d: State change 1256999875: primary_nodes=0, weak_nodes=0 Mar 17 01:54:37 offine-stand-stor-0 [ 142.030018] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560: Starting worker thread (from drbdsetup [12298]) Mar 17 01:54:37 offine-stand-stor-0 [ 142.072923] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d: Committing cluster-wide state change 1256999875 (216ms) Mar 17 01:54:37 offine-stand-stor-0 [ 142.079090] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-1: Starting sender thread (from drbdsetup [12303]) Mar 17 01:54:37 offine-stand-stor-0 [ 142.104637] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:37 offine-stand-stor-0 [ 142.104642] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:37 offine-stand-stor-0 [ 142.114297] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-3: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:37 offine-stand-stor-0 [ 142.115242] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d: susp-io( quorum -> no ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.115395] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.115398] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016: quorum( no -> yes ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.115504] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.116208] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:37 offine-stand-stor-0 [ 142.118602] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-2: Starting sender thread (from drbdsetup [12305]) Mar 17 01:54:37 offine-stand-stor-0 [ 142.118585] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016 offline-stand-stor-2: cleared bm UUID and bitmap 4695B6E26D0B5DCC:0000000000000000:0000000000000000:0000000000000000 Mar 17 01:54:37 offine-stand-stor-0 [ 142.119717] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:37 offine-stand-stor-0 [ 142.121155] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078 offline-stand-stor-2: self EFDC961863D26C7A:0000000000000000:6055F0D3AEEBA11C:0000000000000000 bits:0 flags:0 Mar 17 01:54:37 offine-stand-stor-0 [ 142.122724] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560: susp-io( no -> quorum ) [connect] Mar 17 01:54:37 offine-stand-stor-0 [ 142.122727] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:37 offine-stand-stor-0 [ 142.122767] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-d5d4 [12299]) Mar 17 01:54:37 offine-stand-stor-0 [ 142.122914] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:37 offine-stand-stor-0 [ 142.124578] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8: Preparing cluster-wide state change 1816976738 (0->2 499/146) Mar 17 01:54:37 offine-stand-stor-0 [ 142.125364] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078 offline-stand-stor-2: peer's exposed UUID: EFDC961863D26C7A Mar 17 01:54:37 offine-stand-stor-0 [ 142.126528] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d: Preparing cluster-wide state change 3187317147 (0->2 499/146) Mar 17 01:54:37 offine-stand-stor-0 [ 142.127477] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:37 offine-stand-stor-0 [ 142.130821] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506: State change 3772166118: primary_nodes=0, weak_nodes=0 Mar 17 01:54:37 offine-stand-stor-0 [ 142.132577] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-d5d4 [12299]) Mar 17 01:54:37 offine-stand-stor-0 [ 142.132756] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:37 offine-stand-stor-0 [ 142.133988] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506: Committing cluster-wide state change 3772166118 (152ms) Mar 17 01:54:37 offine-stand-stor-0 [ 142.145962] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:37 offine-stand-stor-0 [ 142.146333] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.150428] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:37 offine-stand-stor-0 [ 142.151320] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.156075] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:37 offine-stand-stor-0 [ 142.157809] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:37 offine-stand-stor-0 [ 142.170560] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-4: Preparing remote state change 3917525527 Mar 17 01:54:37 offine-stand-stor-0 [ 142.172864] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:37 offine-stand-stor-0 [ 142.174748] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-2: Preparing remote state change 2354486733 Mar 17 01:54:37 offine-stand-stor-0 [ 142.176625] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023 offline-stand-stor-2: self 7057BBA0643027A6:0000000000000000:72B5625B9E85A63A:0000000000000000 bits:0 flags:0 Mar 17 01:54:37 offine-stand-stor-0 [ 142.177923] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:37 offine-stand-stor-0 [ 142.179868] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023 offline-stand-stor-2: peer's exposed UUID: 7057BBA0643027A6 Mar 17 01:54:37 offine-stand-stor-0 [ 142.192936] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:37 offine-stand-stor-0 [ 142.197605] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016 offline-stand-stor-3: self 4695B6E26D0B5DCC:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:0 Mar 17 01:54:37 offine-stand-stor-0 [ 142.201156] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8: State change 1816976738: primary_nodes=0, weak_nodes=0 Mar 17 01:54:37 offine-stand-stor-0 [ 142.213036] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354: Starting worker thread (from drbdsetup [12332]) Mar 17 01:54:37 offine-stand-stor-0 [ 142.216875] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-2: Starting sender thread (from drbdsetup [12337]) Mar 17 01:54:37 offine-stand-stor-0 [ 142.218764] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-3: Starting sender thread (from drbdsetup [12339]) Mar 17 01:54:37 offine-stand-stor-0 [ 142.228408] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016 offline-stand-stor-3: peer's exposed UUID: 4695B6E26D0B5DCC Mar 17 01:54:37 offine-stand-stor-0 [ 142.230723] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8: Committing cluster-wide state change 1816976738 (104ms) Mar 17 01:54:37 offine-stand-stor-0 [ 142.230765] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.268898] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d: State change 3187317147: primary_nodes=0, weak_nodes=0 Mar 17 01:54:37 offine-stand-stor-0 [ 142.269581] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.272576] drbd1134: detected capacity change from 0 to 10491632 Mar 17 01:54:37 offine-stand-stor-0 [ 142.276655] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078 offline-stand-stor-4: drbd_sync_handshake: Mar 17 01:54:37 offine-stand-stor-0 [ 142.276659] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078 offline-stand-stor-4: self EFDC961863D26C7A:0000000000000000:6055F0D3AEEBA11C:0000000000000000 bits:0 flags:20 Mar 17 01:54:37 offine-stand-stor-0 [ 142.276663] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078 offline-stand-stor-4: peer EFDC961863D26C7A:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:37 offine-stand-stor-0 [ 142.276671] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078 offline-stand-stor-4: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:37 offine-stand-stor-0 [ 142.279103] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-4: Committing remote state change 3917525527 (primary_nodes=0) Mar 17 01:54:37 offine-stand-stor-0 [ 142.279114] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.279122] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.279208] drbd pvc-b9a986ae-b0dd-4678-8aa2-d60273d76506/0 drbd1078 offline-stand-stor-4: cleared bm UUID and bitmap EFDC961863D26C7A:0000000000000000:6055F0D3AEEBA11C:0000000000000000 Mar 17 01:54:37 offine-stand-stor-0 [ 142.280566] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8: Preparing cluster-wide state change 1329934656 (0->1 499/146) Mar 17 01:54:37 offine-stand-stor-0 [ 142.298847] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033: meta-data IO uses: blk-bio Mar 17 01:54:37 offine-stand-stor-0 [ 142.300931] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c/0 drbd1134: size = 5123 MB (5245816 KB) Mar 17 01:54:37 offine-stand-stor-0 [ 142.301023] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c/0 drbd1134 offline-stand-stor-2: my exposed UUID: 0000000000000000 Mar 17 01:54:37 offine-stand-stor-0 [ 142.305629] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d: Committing cluster-wide state change 3187317147 (180ms) Mar 17 01:54:37 offine-stand-stor-0 [ 142.305657] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354: susp-io( no -> quorum ) [attach] Mar 17 01:54:37 offine-stand-stor-0 [ 142.305661] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:37 offine-stand-stor-0 [ 142.305683] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033: Maximum number of peer devices = 7 Mar 17 01:54:37 offine-stand-stor-0 [ 142.306727] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c/0 drbd1134 offline-stand-stor-2: peer 4BA2908DF8F3613E:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:37 offine-stand-stor-0 [ 142.306732] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c/0 drbd1134: Setting exposed data uuid: 4BA2908DF8F3613E Mar 17 01:54:37 offine-stand-stor-0 [ 142.307077] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354: Method to ensure write ordering: flush Mar 17 01:54:37 offine-stand-stor-0 [ 142.383240] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.383418] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:37 offine-stand-stor-0 [ 142.399377] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-4: Preparing remote state change 1432195829 Mar 17 01:54:37 offine-stand-stor-0 [ 142.399584] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-1: Rejecting concurrent remote state change 2466292667 because of state change 2354486733 Mar 17 01:54:37 offine-stand-stor-0 [ 142.420617] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:37 offine-stand-stor-0 [ 142.420622] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:37 offine-stand-stor-0 [ 142.421751] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-3: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:37 offine-stand-stor-0 [ 142.421753] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:37 offine-stand-stor-0 [ 142.426367] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:37 offine-stand-stor-0 [ 142.432763] drbd pvc-b895a18e-2674-463c-96ca-35b37572cd8d/0 drbd1016 offline-stand-stor-3: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.432783] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d: Preparing cluster-wide state change 3428903928 (0->1 499/146) Mar 17 01:54:37 offine-stand-stor-0 [ 142.451682] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-2: Committing remote state change 2354486733 (primary_nodes=0) Mar 17 01:54:37 offine-stand-stor-0 [ 142.451990] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:37 offine-stand-stor-0 [ 142.452540] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:37 offine-stand-stor-0 [ 142.452548] drbd1033: detected capacity change from 0 to 10491632 Mar 17 01:54:37 offine-stand-stor-0 [ 142.452549] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033: size = 5123 MB (5245816 KB) Mar 17 01:54:37 offine-stand-stor-0 [ 142.455366] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c: susp-io( quorum -> no ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.456734] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023 offline-stand-stor-3: self 7057BBA0643027A6:0000000000000000:72B5625B9E85A63A:0000000000000000 bits:0 flags:20 Mar 17 01:54:37 offine-stand-stor-0 [ 142.458256] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.459535] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023 offline-stand-stor-3: peer 7057BBA0643027A6:0000000000000000:6E783D66FBF61034:E3ABBB34A148F5C0 bits:0 flags:1120 Mar 17 01:54:37 offine-stand-stor-0 [ 142.460021] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:37 offine-stand-stor-0 [ 142.460805] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c/0 drbd1134: quorum( no -> yes ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.462299] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:37 offine-stand-stor-0 [ 142.462456] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:37 offine-stand-stor-0 [ 142.462459] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:37 offine-stand-stor-0 [ 142.464320] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c/0 drbd1134 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.466647] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8: State change 1329934656: primary_nodes=0, weak_nodes=0 Mar 17 01:54:37 offine-stand-stor-0 [ 142.466717] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:37 offine-stand-stor-0 [ 142.482444] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-3: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:37 offine-stand-stor-0 [ 142.482824] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8: Committing cluster-wide state change 1329934656 (200ms) Mar 17 01:54:37 offine-stand-stor-0 [ 142.484601] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1/0 drbd1059 offline-stand-stor-4: my exposed UUID: 1DAB96F2D97A30A8 Mar 17 01:54:37 offine-stand-stor-0 [ 142.484605] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1/0 drbd1059 offline-stand-stor-4: peer 1DAB96F2D97A30A8:0000000000000000:0A12912B089887FE:0000000000000000 bits:0 flags:1120 Mar 17 01:54:37 offine-stand-stor-0 [ 142.484620] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c/0 drbd1134 offline-stand-stor-1: my exposed UUID: 4BA2908DF8F3613E Mar 17 01:54:37 offine-stand-stor-0 [ 142.484622] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c/0 drbd1134 offline-stand-stor-1: peer 4BA2908DF8F3613E:0000000000000000:27C335E47FD55F80:0000000000000000 bits:0 flags:1120 Mar 17 01:54:37 offine-stand-stor-0 [ 142.493488] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-4: Committing remote state change 1432195829 (primary_nodes=0) Mar 17 01:54:37 offine-stand-stor-0 [ 142.493497] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1: susp-io( quorum -> no ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.493500] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.493502] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1/0 drbd1059: quorum( no -> yes ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.493504] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1/0 drbd1059 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.493540] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:37 offine-stand-stor-0 [ 142.493543] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048 offline-stand-stor-2: self 150E1F7F6FA63506:0000000000000000:0CA1A47EFCE24B9E:0000000000000000 bits:0 flags:20 Mar 17 01:54:37 offine-stand-stor-0 [ 142.493547] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048 offline-stand-stor-2: peer 150E1F7F6FA63506:0000000000000000:DD13F517B240A3F8:1909BDE5AE904990 bits:0 flags:1120 Mar 17 01:54:37 offine-stand-stor-0 [ 142.493551] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:37 offine-stand-stor-0 [ 142.502911] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-2: Preparing remote state change 1468195640 Mar 17 01:54:37 offine-stand-stor-0 [ 142.516610] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:37 offine-stand-stor-0 [ 142.516614] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:37 offine-stand-stor-0 [ 142.524054] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:37 offine-stand-stor-0 [ 142.524368] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:37 offine-stand-stor-0 [ 142.526450] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8: susp-io( quorum -> no ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.526912] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d: State change 3428903928: primary_nodes=0, weak_nodes=0 Mar 17 01:54:37 offine-stand-stor-0 [ 142.526916] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d: Committing cluster-wide state change 3428903928 (92ms) Mar 17 01:54:37 offine-stand-stor-0 [ 142.526933] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d: susp-io( quorum -> no ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.526936] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.526938] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048: quorum( no -> yes ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.526941] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.527025] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048 offline-stand-stor-2: cleared bm UUID and bitmap 150E1F7F6FA63506:0000000000000000:0CA1A47EFCE24B9E:0000000000000000 Mar 17 01:54:37 offine-stand-stor-0 [ 142.527037] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033: recounting of set bits took additional 0ms Mar 17 01:54:37 offine-stand-stor-0 [ 142.527046] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:37 offine-stand-stor-0 [ 142.527049] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033: attached to current UUID: A55321B47CC9F2D4 Mar 17 01:54:37 offine-stand-stor-0 [ 142.527053] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033: Setting exposed data uuid: A55321B47CC9F2D4 Mar 17 01:54:37 offine-stand-stor-0 [ 142.533491] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-4: Preparing remote state change 1425321386 Mar 17 01:54:37 offine-stand-stor-0 [ 142.543939] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d: Preparing cluster-wide state change 3472136110 (0->2 499/146) Mar 17 01:54:37 offine-stand-stor-0 [ 142.544064] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-1: Preparing remote state change 3255887278 Mar 17 01:54:37 offine-stand-stor-0 [ 142.546868] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.548625] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:37 offine-stand-stor-0 [ 142.551032] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023: quorum( no -> yes ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.553468] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:37 offine-stand-stor-0 [ 142.554546] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.561497] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:37 offine-stand-stor-0 [ 142.562180] drbd pvc-bec2d3b3-2d1c-410d-8ffb-2903c6441ce8/0 drbd1023 offline-stand-stor-3: cleared bm UUID and bitmap 7057BBA0643027A6:0000000000000000:72B5625B9E85A63A:0000000000000000 Mar 17 01:54:37 offine-stand-stor-0 [ 142.603417] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:37 offine-stand-stor-0 [ 142.606796] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:37 offine-stand-stor-0 [ 142.620130] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:37 offine-stand-stor-0 [ 142.624079] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-d8e1 [12333]) Mar 17 01:54:37 offine-stand-stor-0 [ 142.624575] drbd1084: detected capacity change from 0 to 10491632 Mar 17 01:54:37 offine-stand-stor-0 [ 142.624588] drbd1042: detected capacity change from 0 to 10491632 Mar 17 01:54:37 offine-stand-stor-0 [ 142.624611] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1/0 drbd1059 offline-stand-stor-1: my exposed UUID: 1DAB96F2D97A30A8 Mar 17 01:54:37 offine-stand-stor-0 [ 142.624615] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1/0 drbd1059 offline-stand-stor-1: peer 1DAB96F2D97A30A8:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:37 offine-stand-stor-0 [ 142.624629] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde/0 drbd1042: size = 5123 MB (5245816 KB) Mar 17 01:54:37 offine-stand-stor-0 [ 142.624678] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde/0 drbd1042 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:37 offine-stand-stor-0 [ 142.624681] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde/0 drbd1042 offline-stand-stor-4: peer 532CABE8C39AD96C:0F2BE5547F706277:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:37 offine-stand-stor-0 [ 142.624684] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde/0 drbd1042: Setting exposed data uuid: 532CABE8C39AD96C Mar 17 01:54:37 offine-stand-stor-0 [ 142.631556] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048 offline-stand-stor-3: self 150E1F7F6FA63506:1909BDE5AE904990:0CA1A47EFCE24B9E:0000000000000000 bits:0 flags:0 Mar 17 01:54:37 offine-stand-stor-0 [ 142.631562] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048 offline-stand-stor-3: peer's exposed UUID: 150E1F7F6FA63506 Mar 17 01:54:37 offine-stand-stor-0 [ 142.631569] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d: State change 3472136110: primary_nodes=0, weak_nodes=0 Mar 17 01:54:37 offine-stand-stor-0 [ 142.631574] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d: Committing cluster-wide state change 3472136110 (84ms) Mar 17 01:54:37 offine-stand-stor-0 [ 142.631597] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.631600] drbd pvc-cdf95063-dde1-4c98-b807-abf80a7d109d/0 drbd1048 offline-stand-stor-3: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:37 offine-stand-stor-0 [ 142.632907] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-1: Rejecting concurrent remote state change 2730091159 because of state change 1425321386 Mar 17 01:54:37 offine-stand-stor-0 [ 142.668658] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:37 offine-stand-stor-0 [ 142.668858] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6/0 drbd1084: size = 5123 MB (5245816 KB) Mar 17 01:54:37 offine-stand-stor-0 [ 142.672169] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:37 offine-stand-stor-0 [ 142.673026] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:37 offine-stand-stor-0 [ 142.673647] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-4: Committing remote state change 1425321386 (primary_nodes=0) Mar 17 01:54:37 offine-stand-stor-0 [ 142.673932] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6/0 drbd1084 offline-stand-stor-2: my exposed UUID: 0000000000000000 Mar 17 01:54:37 offine-stand-stor-0 [ 142.673936] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6/0 drbd1084 offline-stand-stor-2: peer 876168EAAC25C28E:DE58FAFAEBEC5AC2:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:37 offine-stand-stor-0 [ 142.673940] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6/0 drbd1084: Setting exposed data uuid: 876168EAAC25C28E Mar 17 01:54:37 offine-stand-stor-0 [ 142.674276] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:37 offine-stand-stor-0 [ 142.674279] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:37 offine-stand-stor-0 [ 142.676128] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-1: Committing remote state change 3255887278 (primary_nodes=0) Mar 17 01:54:37 offine-stand-stor-0 [ 142.677371] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-d8e1 [12333]) Mar 17 01:54:37 offine-stand-stor-0 [ 142.678694] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde: susp-io( quorum -> no ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.678705] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.678708] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde/0 drbd1042: quorum( no -> yes ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.678711] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde/0 drbd1042 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.679032] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-2: Committing remote state change 1468195640 (primary_nodes=0) Mar 17 01:54:37 offine-stand-stor-0 [ 142.680367] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.680370] drbd pvc-b871427c-c6ac-4e18-add3-aad2128081c1/0 drbd1059 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.687682] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:37 offine-stand-stor-0 [ 142.688661] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6: susp-io( quorum -> no ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.691607] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:37 offine-stand-stor-0 [ 142.694380] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.694384] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6/0 drbd1084: quorum( no -> yes ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.694389] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6/0 drbd1084 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.694450] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-3: Preparing remote state change 2047064094 Mar 17 01:54:37 offine-stand-stor-0 [ 142.746622] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:37 offine-stand-stor-0 [ 142.748979] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde/0 drbd1042 offline-stand-stor-1: my exposed UUID: 532CABE8C39AD96C Mar 17 01:54:37 offine-stand-stor-0 [ 142.748980] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-1: Preparing remote state change 396758434 Mar 17 01:54:37 offine-stand-stor-0 [ 142.753214] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde/0 drbd1042 offline-stand-stor-1: peer 532CABE8C39AD96C:0F2BE5547F706276:0F2BE5547F706276:0000000000000000 bits:0 flags:1120 Mar 17 01:54:37 offine-stand-stor-0 [ 142.761104] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368: Starting worker thread (from drbdsetup [12381]) Mar 17 01:54:37 offine-stand-stor-0 [ 142.765941] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-2: Starting sender thread (from drbdsetup [12386]) Mar 17 01:54:37 offine-stand-stor-0 [ 142.772377] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-3: Starting sender thread (from drbdsetup [12388]) Mar 17 01:54:37 offine-stand-stor-0 [ 142.784600] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6/0 drbd1084 offline-stand-stor-3: my exposed UUID: 876168EAAC25C28E Mar 17 01:54:37 offine-stand-stor-0 [ 142.786645] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6/0 drbd1084 offline-stand-stor-3: peer 876168EAAC25C28E:DE58FAFAEBEC5AC2:DE58FAFAEBEC5AC2:0000000000000000 bits:0 flags:1120 Mar 17 01:54:37 offine-stand-stor-0 [ 142.798629] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-3: Committing remote state change 2047064094 (primary_nodes=0) Mar 17 01:54:37 offine-stand-stor-0 [ 142.801408] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030: meta-data IO uses: blk-bio Mar 17 01:54:37 offine-stand-stor-0 [ 142.802712] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.802723] drbd pvc-d30f35fb-6587-4d22-b1a0-4330b08c35c6/0 drbd1084 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.809459] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368: susp-io( no -> quorum ) [attach] Mar 17 01:54:37 offine-stand-stor-0 [ 142.810516] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:37 offine-stand-stor-0 [ 142.811709] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030: Maximum number of peer devices = 7 Mar 17 01:54:37 offine-stand-stor-0 [ 142.812566] drbd1085: detected capacity change from 0 to 10491632 Mar 17 01:54:37 offine-stand-stor-0 [ 142.814128] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560/0 drbd1085: size = 5123 MB (5245816 KB) Mar 17 01:54:37 offine-stand-stor-0 [ 142.814538] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368: Method to ensure write ordering: flush Mar 17 01:54:37 offine-stand-stor-0 [ 142.815245] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560/0 drbd1085 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:37 offine-stand-stor-0 [ 142.816522] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:37 offine-stand-stor-0 [ 142.817559] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560/0 drbd1085 offline-stand-stor-1: peer B728839150DC4E00:74FADF498DEB67B4:74FADF498DEB67B4:0000000000000000 bits:0 flags:1120 Mar 17 01:54:37 offine-stand-stor-0 [ 142.821007] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:37 offine-stand-stor-0 [ 142.822625] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560/0 drbd1085: Setting exposed data uuid: B728839150DC4E00 Mar 17 01:54:37 offine-stand-stor-0 [ 142.824373] drbd1030: detected capacity change from 0 to 10491632 Mar 17 01:54:37 offine-stand-stor-0 [ 142.826890] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030: size = 5123 MB (5245816 KB) Mar 17 01:54:37 offine-stand-stor-0 [ 142.834627] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-1: Committing remote state change 396758434 (primary_nodes=0) Mar 17 01:54:37 offine-stand-stor-0 [ 142.837083] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560: susp-io( quorum -> no ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.838249] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.840265] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560/0 drbd1085: quorum( no -> yes ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.841199] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560/0 drbd1085 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:37 offine-stand-stor-0 [ 142.841863] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030: recounting of set bits took additional 0ms Mar 17 01:54:37 offine-stand-stor-0 [ 142.843137] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-2: Preparing remote state change 3308771008 Mar 17 01:54:37 offine-stand-stor-0 [ 142.844215] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:37 offine-stand-stor-0 [ 142.846452] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030: attached to current UUID: 274BD5D2B7A61312 Mar 17 01:54:37 offine-stand-stor-0 [ 142.847551] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030: Setting exposed data uuid: 274BD5D2B7A61312 Mar 17 01:54:37 offine-stand-stor-0 [ 142.851261] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:37 offine-stand-stor-0 [ 142.852947] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-d92e [12382]) Mar 17 01:54:37 offine-stand-stor-0 [ 142.854047] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:37 offine-stand-stor-0 [ 142.857475] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-d92e [12382]) Mar 17 01:54:37 offine-stand-stor-0 [ 142.857558] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 142.862533] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 142.904258] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94: Starting worker thread (from drbdsetup [12413]) Mar 17 01:54:38 offine-stand-stor-0 [ 142.908961] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-3: Starting sender thread (from drbdsetup [12418]) Mar 17 01:54:38 offine-stand-stor-0 [ 142.914457] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-4: Starting sender thread (from drbdsetup [12420]) Mar 17 01:54:38 offine-stand-stor-0 [ 142.916608] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560/0 drbd1085 offline-stand-stor-2: my exposed UUID: B728839150DC4E00 Mar 17 01:54:38 offine-stand-stor-0 [ 142.918077] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560/0 drbd1085 offline-stand-stor-2: peer B728839150DC4E00:74FADF498DEB67B5:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:38 offine-stand-stor-0 [ 142.920946] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94: susp-io( no -> quorum ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 142.921939] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 142.922856] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-2: Committing remote state change 3308771008 (primary_nodes=0) Mar 17 01:54:38 offine-stand-stor-0 [ 142.922967] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-dbd8 [12414]) Mar 17 01:54:38 offine-stand-stor-0 [ 142.924464] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 142.925304] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 142.927684] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-dbd8 [12414]) Mar 17 01:54:38 offine-stand-stor-0 [ 142.928824] drbd pvc-d5d490c4-38fe-4343-9d45-f162d7011560/0 drbd1085 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 142.931844] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 142.944573] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 142.977988] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-1: Preparing remote state change 506182171 Mar 17 01:54:38 offine-stand-stor-0 [ 142.980996] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03: Starting worker thread (from drbdsetup [12436]) Mar 17 01:54:38 offine-stand-stor-0 [ 142.987311] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-1: Starting sender thread (from drbdsetup [12441]) Mar 17 01:54:38 offine-stand-stor-0 [ 142.991418] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-3: Starting sender thread (from drbdsetup [12443]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.000338] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03: susp-io( no -> quorum ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.001553] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.004672] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.012514] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-df81 [12437]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.030834] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.030847] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-df81 [12437]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.034408] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c/0 drbd1134 offline-stand-stor-1: my exposed UUID: 4BA2908DF8F3613E Mar 17 01:54:38 offine-stand-stor-0 [ 143.035339] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c/0 drbd1134 offline-stand-stor-1: peer 4BA2908DF8F3613E:0000000000000000:27C335E47FD55F80:0000000000000000 bits:0 flags:1120 Mar 17 01:54:38 offine-stand-stor-0 [ 143.037257] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.054006] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-1: Committing remote state change 506182171 (primary_nodes=0) Mar 17 01:54:38 offine-stand-stor-0 [ 143.055850] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.057841] drbd pvc-ca275f9e-fb36-4ff7-a2d1-67b5bfda1f6c/0 drbd1134 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.058922] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f: Starting worker thread (from drbdsetup [12466]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.069300] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-1: Starting sender thread (from drbdsetup [12471]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.073554] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-2: Starting sender thread (from drbdsetup [12473]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.097330] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000: meta-data IO uses: blk-bio Mar 17 01:54:38 offine-stand-stor-0 [ 143.105322] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:38 offine-stand-stor-0 [ 143.106465] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000: Maximum number of peer devices = 7 Mar 17 01:54:38 offine-stand-stor-0 [ 143.108573] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f: Method to ensure write ordering: flush Mar 17 01:54:38 offine-stand-stor-0 [ 143.109787] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000: drbd_bm_resize called with capacity == 4201520 Mar 17 01:54:38 offine-stand-stor-0 [ 143.111259] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000: resync bitmap: bits=525190 words=57449 pages=113 Mar 17 01:54:38 offine-stand-stor-0 [ 143.112346] drbd1000: detected capacity change from 0 to 4201520 Mar 17 01:54:38 offine-stand-stor-0 [ 143.113397] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000: size = 2052 MB (2100760 KB) Mar 17 01:54:38 offine-stand-stor-0 [ 143.115371] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000: recounting of set bits took additional 0ms Mar 17 01:54:38 offine-stand-stor-0 [ 143.116723] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:38 offine-stand-stor-0 [ 143.117956] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000: attached to current UUID: 4C8A9DA81B9F35B4 Mar 17 01:54:38 offine-stand-stor-0 [ 143.118978] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000: Setting exposed data uuid: 4C8A9DA81B9F35B4 Mar 17 01:54:38 offine-stand-stor-0 [ 143.123263] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.126314] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-df83 [12467]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.127006] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.166556] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.167295] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-df83 [12467]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.201877] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:38 offine-stand-stor-0 [ 143.215469] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.216484] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:38 offine-stand-stor-0 [ 143.222478] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:38 offine-stand-stor-0 [ 143.228385] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b: Starting worker thread (from drbdsetup [12500]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.233729] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-2: Starting sender thread (from drbdsetup [12505]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.238150] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-1: Preparing remote state change 2230376385 Mar 17 01:54:38 offine-stand-stor-0 [ 143.240881] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-3: Starting sender thread (from drbdsetup [12507]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.247308] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b: susp-io( no -> quorum ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.248325] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.248888] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-2: Preparing remote state change 1757509090 Mar 17 01:54:38 offine-stand-stor-0 [ 143.249300] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-dfa6 [12501]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.252100] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.254620] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.255722] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-dfa6 [12501]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.259474] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.260631] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-3: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:38 offine-stand-stor-0 [ 143.265392] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:38 offine-stand-stor-0 [ 143.281028] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:38 offine-stand-stor-0 [ 143.289383] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde/0 drbd1042 offline-stand-stor-1: my exposed UUID: 532CABE8C39AD96C Mar 17 01:54:38 offine-stand-stor-0 [ 143.291482] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde/0 drbd1042 offline-stand-stor-1: peer 532CABE8C39AD96C:0F2BE5547F706276:0F2BE5547F706276:0000000000000000 bits:0 flags:1120 Mar 17 01:54:38 offine-stand-stor-0 [ 143.300150] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:38 offine-stand-stor-0 [ 143.301085] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033 offline-stand-stor-2: self A55321B47CC9F2D4:0000000000000000:8FAF3EC8D269EE5E:0000000000000000 bits:0 flags:20 Mar 17 01:54:38 offine-stand-stor-0 [ 143.303300] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033 offline-stand-stor-2: peer A55321B47CC9F2D4:0000000000000000:C47EDDE65036FA06:CAF636523D0E1A92 bits:0 flags:1120 Mar 17 01:54:38 offine-stand-stor-0 [ 143.303332] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-1: Committing remote state change 2230376385 (primary_nodes=0) Mar 17 01:54:38 offine-stand-stor-0 [ 143.305656] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:38 offine-stand-stor-0 [ 143.312944] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.315685] drbd pvc-d3503fb9-33b2-4fd8-992c-523f02230fde/0 drbd1042 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.322451] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-2: Committing remote state change 1757509090 (primary_nodes=0) Mar 17 01:54:38 offine-stand-stor-0 [ 143.324187] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354: susp-io( quorum -> no ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.325047] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.326949] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033: quorum( no -> yes ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.327892] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.329894] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033 offline-stand-stor-2: cleared bm UUID and bitmap A55321B47CC9F2D4:0000000000000000:8FAF3EC8D269EE5E:0000000000000000 Mar 17 01:54:38 offine-stand-stor-0 [ 143.331991] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354: Preparing cluster-wide state change 2411836930 (1->2 499/146) Mar 17 01:54:38 offine-stand-stor-0 [ 143.337040] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19: Starting worker thread (from drbdsetup [12523]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.342918] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-2: Starting sender thread (from drbdsetup [12528]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.348871] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-3: Starting sender thread (from drbdsetup [12530]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.357627] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19: susp-io( no -> quorum ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.358727] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.359927] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-e172 [12524]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.361361] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.363529] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-e172 [12524]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.363592] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.368930] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.383280] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033 offline-stand-stor-3: self A55321B47CC9F2D4:0000000000000000:8FAF3EC8D269EE5E:0000000000000000 bits:0 flags:0 Mar 17 01:54:38 offine-stand-stor-0 [ 143.386423] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033 offline-stand-stor-3: peer's exposed UUID: A55321B47CC9F2D4 Mar 17 01:54:38 offine-stand-stor-0 [ 143.389100] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354: State change 2411836930: primary_nodes=0, weak_nodes=0 Mar 17 01:54:38 offine-stand-stor-0 [ 143.389960] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354: Committing cluster-wide state change 2411836930 (60ms) Mar 17 01:54:38 offine-stand-stor-0 [ 143.390017] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:38 offine-stand-stor-0 [ 143.391041] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:38 offine-stand-stor-0 [ 143.393306] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:38 offine-stand-stor-0 [ 143.395405] drbd pvc-d8e123ae-c512-4c8a-a31f-c6cf8c0de354/0 drbd1033 offline-stand-stor-3: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:38 offine-stand-stor-0 [ 143.412390] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca: Starting worker thread (from drbdsetup [12545]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.413224] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:38 offine-stand-stor-0 [ 143.416605] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:38 offine-stand-stor-0 [ 143.418125] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-2: Starting sender thread (from drbdsetup [12551]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.419040] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:38 offine-stand-stor-0 [ 143.424620] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-4: Starting sender thread (from drbdsetup [12553]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.425471] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368: Preparing cluster-wide state change 315726175 (1->2 499/146) Mar 17 01:54:38 offine-stand-stor-0 [ 143.432699] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca: susp-io( no -> quorum ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.433880] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.435295] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-e5ba [12546]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.437268] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.437532] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:38 offine-stand-stor-0 [ 143.440225] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.440261] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-e5ba [12546]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.446284] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.446427] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:38 offine-stand-stor-0 [ 143.451195] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:38 offine-stand-stor-0 [ 143.453925] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:38 offine-stand-stor-0 [ 143.459455] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-3: Preparing remote state change 592621199 Mar 17 01:54:38 offine-stand-stor-0 [ 143.481731] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:38 offine-stand-stor-0 [ 143.483898] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:38 offine-stand-stor-0 [ 143.493969] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:38 offine-stand-stor-0 [ 143.498094] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35: Starting worker thread (from drbdsetup [12571]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.503515] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-1: Starting sender thread (from drbdsetup [12576]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.510071] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-4: Starting sender thread (from drbdsetup [12578]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.517099] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35: susp-io( no -> quorum ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.518151] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.520766] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.524725] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030 offline-stand-stor-2: self 274BD5D2B7A61312:0000000000000000:F204A94F0A8E73EE:0000000000000000 bits:0 flags:0 Mar 17 01:54:38 offine-stand-stor-0 [ 143.527247] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030 offline-stand-stor-2: peer's exposed UUID: 274BD5D2B7A61312 Mar 17 01:54:38 offine-stand-stor-0 [ 143.529634] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368: State change 315726175: primary_nodes=0, weak_nodes=0 Mar 17 01:54:38 offine-stand-stor-0 [ 143.531169] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368: Committing cluster-wide state change 315726175 (104ms) Mar 17 01:54:38 offine-stand-stor-0 [ 143.532501] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:38 offine-stand-stor-0 [ 143.533721] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-e62a [12572]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.534869] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:38 offine-stand-stor-0 [ 143.536784] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.536805] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-e62a [12572]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.548571] drbd1105: detected capacity change from 0 to 10491632 Mar 17 01:54:38 offine-stand-stor-0 [ 143.550588] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94/0 drbd1105: size = 5123 MB (5245816 KB) Mar 17 01:54:38 offine-stand-stor-0 [ 143.552631] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94/0 drbd1105 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:38 offine-stand-stor-0 [ 143.553570] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.554590] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94/0 drbd1105 offline-stand-stor-3: peer 23FF6B9215E01DDA:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:38 offine-stand-stor-0 [ 143.560503] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:38 offine-stand-stor-0 [ 143.562281] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94/0 drbd1105: Setting exposed data uuid: 23FF6B9215E01DDA Mar 17 01:54:38 offine-stand-stor-0 [ 143.565482] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:38 offine-stand-stor-0 [ 143.566193] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-3: Committing remote state change 592621199 (primary_nodes=0) Mar 17 01:54:38 offine-stand-stor-0 [ 143.571462] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94: susp-io( quorum -> no ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.572628] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.572629] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:38 offine-stand-stor-0 [ 143.574776] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94/0 drbd1105: quorum( no -> yes ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.575201] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6: Starting worker thread (from drbdsetup [12593]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.577713] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:38 offine-stand-stor-0 [ 143.578989] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94/0 drbd1105 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.578996] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-3: Preparing remote state change 1900535714 Mar 17 01:54:38 offine-stand-stor-0 [ 143.581295] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-1: Starting sender thread (from drbdsetup [12598]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.581462] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:38 offine-stand-stor-0 [ 143.584453] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-4: Preparing remote state change 1651571219 Mar 17 01:54:38 offine-stand-stor-0 [ 143.586941] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-3: Preparing remote state change 316648325 Mar 17 01:54:38 offine-stand-stor-0 [ 143.587924] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-4: Starting sender thread (from drbdsetup [12601]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.600363] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6: susp-io( no -> quorum ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.601487] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.602711] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-e76e [12594]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.604311] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.606528] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-e76e [12594]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.606590] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.608607] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94/0 drbd1105 offline-stand-stor-4: my exposed UUID: 23FF6B9215E01DDA Mar 17 01:54:38 offine-stand-stor-0 [ 143.608611] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94/0 drbd1105 offline-stand-stor-4: peer 23FF6B9215E01DDA:0000000000000000:9117E94081D9CE7A:0000000000000000 bits:0 flags:1120 Mar 17 01:54:38 offine-stand-stor-0 [ 143.611864] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:38 offine-stand-stor-0 [ 143.612604] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.619720] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-4: Committing remote state change 1651571219 (primary_nodes=0) Mar 17 01:54:38 offine-stand-stor-0 [ 143.622157] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.624169] drbd pvc-dbd863ff-a797-4d02-9258-762f670fdb94/0 drbd1105 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.624551] drbd1104: detected capacity change from 0 to 10491632 Mar 17 01:54:38 offine-stand-stor-0 [ 143.624595] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:38 offine-stand-stor-0 [ 143.624603] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030 offline-stand-stor-3: self 274BD5D2B7A61312:0000000000000000:F204A94F0A8E73EE:0000000000000000 bits:0 flags:20 Mar 17 01:54:38 offine-stand-stor-0 [ 143.624608] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030 offline-stand-stor-3: peer 274BD5D2B7A61312:0000000000000000:9304052A3FE22BBA:69A877F7FC655840 bits:0 flags:1120 Mar 17 01:54:38 offine-stand-stor-0 [ 143.624611] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:38 offine-stand-stor-0 [ 143.626631] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-3: Committing remote state change 1900535714 (primary_nodes=0) Mar 17 01:54:38 offine-stand-stor-0 [ 143.628080] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03/0 drbd1104: size = 5123 MB (5245816 KB) Mar 17 01:54:38 offine-stand-stor-0 [ 143.630129] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368: susp-io( quorum -> no ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.632540] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03/0 drbd1104 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:38 offine-stand-stor-0 [ 143.636478] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.638605] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03/0 drbd1104 offline-stand-stor-3: peer 1DBA09EF3267CDE0:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:38 offine-stand-stor-0 [ 143.641367] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030: quorum( no -> yes ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.641371] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.641540] drbd pvc-d92eea54-bc8b-4b42-8109-a9633d35b368/0 drbd1030 offline-stand-stor-3: cleared bm UUID and bitmap 274BD5D2B7A61312:0000000000000000:F204A94F0A8E73EE:0000000000000000 Mar 17 01:54:38 offine-stand-stor-0 [ 143.642659] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03/0 drbd1104: Setting exposed data uuid: 1DBA09EF3267CDE0 Mar 17 01:54:38 offine-stand-stor-0 [ 143.662459] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-3: Committing remote state change 316648325 (primary_nodes=0) Mar 17 01:54:38 offine-stand-stor-0 [ 143.666169] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03: susp-io( quorum -> no ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.666539] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45: Starting worker thread (from drbdsetup [12617]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.667206] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.670398] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03/0 drbd1104: quorum( no -> yes ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.671955] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-1: Starting sender thread (from drbdsetup [12622]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.671966] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03/0 drbd1104 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.676773] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-1: Preparing remote state change 1660720146 Mar 17 01:54:38 offine-stand-stor-0 [ 143.679568] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-4: Starting sender thread (from drbdsetup [12624]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.686391] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45: susp-io( no -> quorum ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.687528] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.688775] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-e9b9 [12618]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.690180] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.692183] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-e9b9 [12618]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.692223] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.698710] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.704636] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-1: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:38 offine-stand-stor-0 [ 143.706963] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:38 offine-stand-stor-0 [ 143.712516] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:38 offine-stand-stor-0 [ 143.712584] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03/0 drbd1104 offline-stand-stor-1: my exposed UUID: 1DBA09EF3267CDE0 Mar 17 01:54:38 offine-stand-stor-0 [ 143.714814] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03/0 drbd1104 offline-stand-stor-1: peer 1DBA09EF3267CDE0:0000000000000000:097BA75190B8AF7A:0000000000000000 bits:0 flags:1120 Mar 17 01:54:38 offine-stand-stor-0 [ 143.716832] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f: Preparing cluster-wide state change 2087976395 (1->2 499/146) Mar 17 01:54:38 offine-stand-stor-0 [ 143.725114] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-1: Committing remote state change 1660720146 (primary_nodes=0) Mar 17 01:54:38 offine-stand-stor-0 [ 143.741519] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.741906] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:38 offine-stand-stor-0 [ 143.743895] drbd pvc-df81fd91-1af0-4111-bce7-ec764e304c03/0 drbd1104 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:38 offine-stand-stor-0 [ 143.748750] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:38 offine-stand-stor-0 [ 143.750795] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9: Starting worker thread (from drbdsetup [12640]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.765522] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-2: Starting sender thread (from drbdsetup [12645]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.766451] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:38 offine-stand-stor-0 [ 143.767808] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:38 offine-stand-stor-0 [ 143.770266] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-3: Starting sender thread (from drbdsetup [12647]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.770408] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-1: self 4C8A9DA81B9F35B4:7A4C0FA6CED9AD3C:B6D805E4C2BFE3F0:CBE6243C4E22D640 bits:0 flags:0 Mar 17 01:54:38 offine-stand-stor-0 [ 143.770496] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-1: peer's exposed UUID: A96DEBC9065A789F Mar 17 01:54:38 offine-stand-stor-0 [ 143.771135] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:38 offine-stand-stor-0 [ 143.773917] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:38 offine-stand-stor-0 [ 143.779760] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9: susp-io( no -> quorum ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.779837] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:38 offine-stand-stor-0 [ 143.781802] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f: State change 2087976395: primary_nodes=4, weak_nodes=FFFFFFFFFFFFFFF8 Mar 17 01:54:38 offine-stand-stor-0 [ 143.781997] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f: Committing cluster-wide state change 2087976395 (60ms) Mar 17 01:54:38 offine-stand-stor-0 [ 143.782050] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.782120] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-ea11 [12641]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.783147] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-1: Downgrading local disk to D_CONSISTENT since current UUID differs. Mar 17 01:54:38 offine-stand-stor-0 [ 143.783429] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Primary ) [connected] Mar 17 01:54:38 offine-stand-stor-0 [ 143.783494] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000: disk( UpToDate -> Consistent ) [connected] Mar 17 01:54:38 offine-stand-stor-0 [ 143.783513] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:38 offine-stand-stor-0 [ 143.783560] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-1: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:38 offine-stand-stor-0 [ 143.784288] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:38 offine-stand-stor-0 [ 143.787545] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.787565] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-ea11 [12641]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.815169] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:38 offine-stand-stor-0 [ 143.815185] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-2: Preparing remote state change 58119310 Mar 17 01:54:38 offine-stand-stor-0 [ 143.815259] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:38 offine-stand-stor-0 [ 143.821783] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-2: Preparing remote state change 1119183442 Mar 17 01:54:38 offine-stand-stor-0 [ 143.856599] drbd1031: detected capacity change from 0 to 10491632 Mar 17 01:54:38 offine-stand-stor-0 [ 143.857746] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b/0 drbd1031: size = 5123 MB (5245816 KB) Mar 17 01:54:38 offine-stand-stor-0 [ 143.859687] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b/0 drbd1031 offline-stand-stor-2: my exposed UUID: 0000000000000000 Mar 17 01:54:38 offine-stand-stor-0 [ 143.860764] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b/0 drbd1031 offline-stand-stor-2: peer FB4DFFC4A260FF6C:FE808E457CE1B014:FE808E457CE1B014:0000000000000000 bits:0 flags:1120 Mar 17 01:54:38 offine-stand-stor-0 [ 143.862936] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b/0 drbd1031: Setting exposed data uuid: FB4DFFC4A260FF6C Mar 17 01:54:38 offine-stand-stor-0 [ 143.871058] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833: Starting worker thread (from drbdsetup [12673]) Mar 17 01:54:38 offine-stand-stor-0 [ 143.876517] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-1: Starting sender thread (from drbdsetup [12678]) Mar 17 01:54:39 offine-stand-stor-0 [ 143.880266] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-3: Starting sender thread (from drbdsetup [12680]) Mar 17 01:54:39 offine-stand-stor-0 [ 143.882240] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-2: Committing remote state change 58119310 (primary_nodes=0) Mar 17 01:54:39 offine-stand-stor-0 [ 143.885058] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b: susp-io( quorum -> no ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 143.885700] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:39 offine-stand-stor-0 [ 143.886577] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 143.886580] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b/0 drbd1031: quorum( no -> yes ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 143.886582] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b/0 drbd1031 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 143.886667] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-3: Preparing remote state change 3560641241 Mar 17 01:54:39 offine-stand-stor-0 [ 143.911048] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-2: self 4C8A9DA81B9F35B4:0000000000000000:B6D805E4C2BFE3F0:CBE6243C4E22D640 bits:7168 flags:0 Mar 17 01:54:39 offine-stand-stor-0 [ 143.911054] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-2: peer A96DEBC9065A789E:4C8A9DA81B9F35B4:B6D805E4C2BFE3F0:3D272D0D90FD6E6C bits:882 flags:1100 Mar 17 01:54:39 offine-stand-stor-0 [ 143.912640] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:39 offine-stand-stor-0 [ 143.912682] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:39 offine-stand-stor-0 [ 143.912685] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:39 offine-stand-stor-0 [ 143.912911] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-2: uuid_compare()=target-use-bitmap by rule=bitmap-peer Mar 17 01:54:39 offine-stand-stor-0 [ 143.914854] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:39 offine-stand-stor-0 [ 143.917044] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:39 offine-stand-stor-0 [ 143.923921] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136: meta-data IO uses: blk-bio Mar 17 01:54:39 offine-stand-stor-0 [ 143.957470] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833: susp-io( no -> quorum ) [attach] Mar 17 01:54:39 offine-stand-stor-0 [ 143.957553] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:39 offine-stand-stor-0 [ 143.958907] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-2: Preparing remote state change 4176159736 Mar 17 01:54:39 offine-stand-stor-0 [ 143.960709] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b/0 drbd1031 offline-stand-stor-3: my exposed UUID: FB4DFFC4A260FF6C Mar 17 01:54:39 offine-stand-stor-0 [ 143.960719] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b/0 drbd1031 offline-stand-stor-3: peer FB4DFFC4A260FF6C:FE808E457CE1B015:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:39 offine-stand-stor-0 [ 143.961111] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:39 offine-stand-stor-0 [ 143.961165] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136: Maximum number of peer devices = 7 Mar 17 01:54:39 offine-stand-stor-0 [ 143.962345] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833: Method to ensure write ordering: flush Mar 17 01:54:39 offine-stand-stor-0 [ 143.982874] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-3: Committing remote state change 3560641241 (primary_nodes=0) Mar 17 01:54:39 offine-stand-stor-0 [ 143.982900] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:39 offine-stand-stor-0 [ 143.983425] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-2: Committing remote state change 1119183442 (primary_nodes=4) Mar 17 01:54:39 offine-stand-stor-0 [ 143.983772] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 143.983859] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000: disk( Consistent -> Outdated ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 143.983924] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> WFBitMapT ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 143.984358] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000: Setting exposed data uuid: A96DEBC9065A789E Mar 17 01:54:39 offine-stand-stor-0 [ 143.985355] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 143.985359] drbd pvc-dfa69f92-77b5-46d2-9b7b-620c6c3c614b/0 drbd1031 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 143.985502] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:39 offine-stand-stor-0 [ 143.986136] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:39 offine-stand-stor-0 [ 143.986139] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:39 offine-stand-stor-0 [ 143.987410] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:39 offine-stand-stor-0 [ 143.987776] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:39 offine-stand-stor-0 [ 143.987780] drbd1136: detected capacity change from 0 to 10491632 Mar 17 01:54:39 offine-stand-stor-0 [ 143.987782] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136: size = 5123 MB (5245816 KB) Mar 17 01:54:39 offine-stand-stor-0 [ 143.990912] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:39 offine-stand-stor-0 [ 143.999376] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136: recounting of set bits took additional 0ms Mar 17 01:54:39 offine-stand-stor-0 [ 144.003339] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-2: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 35(1), total 35; compression: 100.0% Mar 17 01:54:39 offine-stand-stor-0 [ 144.003854] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:39 offine-stand-stor-0 [ 144.003857] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136: attached to current UUID: F5A5E8748B4E1D74 Mar 17 01:54:39 offine-stand-stor-0 [ 144.003867] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136: Setting exposed data uuid: F5A5E8748B4E1D74 Mar 17 01:54:39 offine-stand-stor-0 [ 144.016022] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:39 offine-stand-stor-0 [ 144.046028] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-2: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 36(1), total 36; compression: 100.0% Mar 17 01:54:39 offine-stand-stor-0 [ 144.047627] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-2: Preparing remote state change 1700394110 Mar 17 01:54:39 offine-stand-stor-0 [ 144.069993] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:39 offine-stand-stor-0 [ 144.084624] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:39 offine-stand-stor-0 [ 144.085126] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:39 offine-stand-stor-0 [ 144.085221] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000: disk( Outdated -> Inconsistent ) [receive-bitmap] Mar 17 01:54:39 offine-stand-stor-0 [ 144.085374] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-2: repl( WFBitMapT -> SyncTarget ) [receive-bitmap] Mar 17 01:54:39 offine-stand-stor-0 [ 144.085418] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-1: resync-susp( no -> connection dependency ) [receive-bitmap] Mar 17 01:54:39 offine-stand-stor-0 [ 144.086601] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:39 offine-stand-stor-0 [ 144.090395] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:39 offine-stand-stor-0 [ 144.091164] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:39 offine-stand-stor-0 [ 144.099031] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:39 offine-stand-stor-0 [ 144.104932] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-2: Began resync as SyncTarget (will sync 28672 KB [7168 bits set]). Mar 17 01:54:39 offine-stand-stor-0 [ 144.108586] drbd1008: detected capacity change from 0 to 10491632 Mar 17 01:54:39 offine-stand-stor-0 [ 144.129308] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:39 offine-stand-stor-0 [ 144.131993] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19/0 drbd1008: size = 5123 MB (5245816 KB) Mar 17 01:54:39 offine-stand-stor-0 [ 144.132060] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19/0 drbd1008 offline-stand-stor-2: my exposed UUID: 0000000000000000 Mar 17 01:54:39 offine-stand-stor-0 [ 144.134616] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-ea6e [12674]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.135713] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19/0 drbd1008 offline-stand-stor-2: peer 50D7794D09AB8420:0000000000000000:33CB378489497F34:0000000000000000 bits:0 flags:1120 Mar 17 01:54:39 offine-stand-stor-0 [ 144.135719] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19/0 drbd1008: Setting exposed data uuid: 50D7794D09AB8420 Mar 17 01:54:39 offine-stand-stor-0 [ 144.136678] drbd1137: detected capacity change from 0 to 10491632 Mar 17 01:54:39 offine-stand-stor-0 [ 144.136992] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-4: Preparing remote state change 722633398 Mar 17 01:54:39 offine-stand-stor-0 [ 144.140030] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-2: Committing remote state change 4176159736 (primary_nodes=0) Mar 17 01:54:39 offine-stand-stor-0 [ 144.140042] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19: susp-io( quorum -> no ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.140051] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.140054] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19/0 drbd1008: quorum( no -> yes ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.140057] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19/0 drbd1008 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.154789] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:39 offine-stand-stor-0 [ 144.155375] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:39 offine-stand-stor-0 [ 144.155378] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:39 offine-stand-stor-0 [ 144.156175] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca/0 drbd1137: size = 5123 MB (5245816 KB) Mar 17 01:54:39 offine-stand-stor-0 [ 144.159939] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:39 offine-stand-stor-0 [ 144.160267] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:39 offine-stand-stor-0 [ 144.162093] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:39 offine-stand-stor-0 [ 144.163201] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-ea6e [12674]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.163738] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:39 offine-stand-stor-0 [ 144.165000] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca/0 drbd1137 offline-stand-stor-2: my exposed UUID: 0000000000000000 Mar 17 01:54:39 offine-stand-stor-0 [ 144.165736] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-3: Preparing remote state change 1764223856 Mar 17 01:54:39 offine-stand-stor-0 [ 144.168964] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-1: Preparing remote state change 856975628 Mar 17 01:54:39 offine-stand-stor-0 [ 144.169437] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca/0 drbd1137 offline-stand-stor-2: peer 6107392484A01D60:0000000000000000:E3DDFBE9FAAB20A4:0000000000000000 bits:0 flags:1120 Mar 17 01:54:39 offine-stand-stor-0 [ 144.185156] drbd1089: detected capacity change from 0 to 10491632 Mar 17 01:54:39 offine-stand-stor-0 [ 144.186457] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca/0 drbd1137: Setting exposed data uuid: 6107392484A01D60 Mar 17 01:54:39 offine-stand-stor-0 [ 144.190317] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-2: Committing remote state change 1700394110 (primary_nodes=0) Mar 17 01:54:39 offine-stand-stor-0 [ 144.191806] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35/0 drbd1089: size = 5123 MB (5245816 KB) Mar 17 01:54:39 offine-stand-stor-0 [ 144.193485] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca: susp-io( quorum -> no ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.195422] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35/0 drbd1089 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:39 offine-stand-stor-0 [ 144.196581] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19/0 drbd1008 offline-stand-stor-3: my exposed UUID: 50D7794D09AB8420 Mar 17 01:54:39 offine-stand-stor-0 [ 144.196586] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19/0 drbd1008 offline-stand-stor-3: peer 50D7794D09AB8420:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:39 offine-stand-stor-0 [ 144.197153] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.197158] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca/0 drbd1137: quorum( no -> yes ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.197161] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca/0 drbd1137 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.197778] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:39 offine-stand-stor-0 [ 144.198071] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35/0 drbd1089 offline-stand-stor-4: peer E104C73B97AC7A38:0000000000000000:74579670FC612FF6:0000000000000000 bits:0 flags:1120 Mar 17 01:54:39 offine-stand-stor-0 [ 144.202269] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919: Starting worker thread (from drbdsetup [12721]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.202670] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35/0 drbd1089: Setting exposed data uuid: E104C73B97AC7A38 Mar 17 01:54:39 offine-stand-stor-0 [ 144.203965] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-3: Committing remote state change 1764223856 (primary_nodes=0) Mar 17 01:54:39 offine-stand-stor-0 [ 144.214165] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-4: Preparing remote state change 4175230117 Mar 17 01:54:39 offine-stand-stor-0 [ 144.215278] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.215282] drbd pvc-e172508f-0a36-4058-9cbe-a15e280cec19/0 drbd1008 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.216624] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:39 offine-stand-stor-0 [ 144.222523] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-1: Rejecting concurrent remote state change 2824714757 because of state change 722633398 Mar 17 01:54:39 offine-stand-stor-0 [ 144.222942] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-1: Starting sender thread (from drbdsetup [12726]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.223431] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:39 offine-stand-stor-0 [ 144.224328] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-2: Starting sender thread (from drbdsetup [12728]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.224462] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-4: Committing remote state change 722633398 (primary_nodes=0) Mar 17 01:54:39 offine-stand-stor-0 [ 144.227201] drbd1095: detected capacity change from 0 to 10491632 Mar 17 01:54:39 offine-stand-stor-0 [ 144.227960] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35: susp-io( quorum -> no ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.227963] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.229377] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6/0 drbd1095: size = 5123 MB (5245816 KB) Mar 17 01:54:39 offine-stand-stor-0 [ 144.231044] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35/0 drbd1089: quorum( no -> yes ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.231048] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35/0 drbd1089 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.236481] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:39 offine-stand-stor-0 [ 144.236823] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:39 offine-stand-stor-0 [ 144.237434] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6/0 drbd1095 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:39 offine-stand-stor-0 [ 144.239967] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:39 offine-stand-stor-0 [ 144.240491] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:39 offine-stand-stor-0 [ 144.241402] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-1: Preparing remote state change 430468613 Mar 17 01:54:39 offine-stand-stor-0 [ 144.244048] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6/0 drbd1095 offline-stand-stor-1: peer 71F32AD1EE71C8D6:0000000000000000:1A74022ECFCC2A4E:0000000000000000 bits:0 flags:1120 Mar 17 01:54:39 offine-stand-stor-0 [ 144.247994] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35/0 drbd1089 offline-stand-stor-1: my exposed UUID: E104C73B97AC7A38 Mar 17 01:54:39 offine-stand-stor-0 [ 144.249786] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6/0 drbd1095: Setting exposed data uuid: 71F32AD1EE71C8D6 Mar 17 01:54:39 offine-stand-stor-0 [ 144.251484] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35/0 drbd1089 offline-stand-stor-1: peer E104C73B97AC7A38:0000000000000000:9FF9F91D4D1C89D0:0000000000000000 bits:0 flags:1120 Mar 17 01:54:39 offine-stand-stor-0 [ 144.256501] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128: meta-data IO uses: blk-bio Mar 17 01:54:39 offine-stand-stor-0 [ 144.257140] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-1: Committing remote state change 856975628 (primary_nodes=0) Mar 17 01:54:39 offine-stand-stor-0 [ 144.257153] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6: susp-io( quorum -> no ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.257157] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.257160] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6/0 drbd1095: quorum( no -> yes ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.257163] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6/0 drbd1095 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.260611] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca/0 drbd1137 offline-stand-stor-4: my exposed UUID: 6107392484A01D60 Mar 17 01:54:39 offine-stand-stor-0 [ 144.262344] drbd1096: detected capacity change from 0 to 10491632 Mar 17 01:54:39 offine-stand-stor-0 [ 144.263355] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca/0 drbd1137 offline-stand-stor-4: peer 6107392484A01D60:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:39 offine-stand-stor-0 [ 144.269849] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919: susp-io( no -> quorum ) [attach] Mar 17 01:54:39 offine-stand-stor-0 [ 144.271234] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45/0 drbd1096: size = 5123 MB (5245816 KB) Mar 17 01:54:39 offine-stand-stor-0 [ 144.272602] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:39 offine-stand-stor-0 [ 144.272734] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128: Maximum number of peer devices = 7 Mar 17 01:54:39 offine-stand-stor-0 [ 144.273413] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-4: Preparing remote state change 1665432998 Mar 17 01:54:39 offine-stand-stor-0 [ 144.275974] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45/0 drbd1096 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:39 offine-stand-stor-0 [ 144.278649] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919: Method to ensure write ordering: flush Mar 17 01:54:39 offine-stand-stor-0 [ 144.279283] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45/0 drbd1096 offline-stand-stor-1: peer B8C68AAC5219CB4C:0000000000000000:D3213E29F1DE5C4C:0000000000000000 bits:0 flags:1120 Mar 17 01:54:39 offine-stand-stor-0 [ 144.282407] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:39 offine-stand-stor-0 [ 144.283639] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45/0 drbd1096: Setting exposed data uuid: B8C68AAC5219CB4C Mar 17 01:54:39 offine-stand-stor-0 [ 144.286013] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:39 offine-stand-stor-0 [ 144.291369] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-1: Committing remote state change 430468613 (primary_nodes=0) Mar 17 01:54:39 offine-stand-stor-0 [ 144.292427] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-4: Committing remote state change 4175230117 (primary_nodes=0) Mar 17 01:54:39 offine-stand-stor-0 [ 144.292446] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.292451] drbd pvc-e5ba1fc4-eae8-4221-8bba-69caa5aef5ca/0 drbd1137 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.293955] drbd1128: detected capacity change from 0 to 10491632 Mar 17 01:54:39 offine-stand-stor-0 [ 144.293974] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128: size = 5123 MB (5245816 KB) Mar 17 01:54:39 offine-stand-stor-0 [ 144.337631] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45: susp-io( quorum -> no ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.338683] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.341814] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45/0 drbd1096: quorum( no -> yes ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.342707] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45/0 drbd1096 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.345348] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-4: Preparing remote state change 3275235550 Mar 17 01:54:39 offine-stand-stor-0 [ 144.345950] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-3: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:39 offine-stand-stor-0 [ 144.348647] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6/0 drbd1095 offline-stand-stor-4: my exposed UUID: 71F32AD1EE71C8D6 Mar 17 01:54:39 offine-stand-stor-0 [ 144.349216] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128: recounting of set bits took additional 0ms Mar 17 01:54:39 offine-stand-stor-0 [ 144.349235] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:39 offine-stand-stor-0 [ 144.349238] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128: attached to current UUID: CCA2B76A02C2EDB8 Mar 17 01:54:39 offine-stand-stor-0 [ 144.349248] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128: Setting exposed data uuid: CCA2B76A02C2EDB8 Mar 17 01:54:39 offine-stand-stor-0 [ 144.350195] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:39 offine-stand-stor-0 [ 144.350381] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:39 offine-stand-stor-0 [ 144.351353] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6/0 drbd1095 offline-stand-stor-4: peer 71F32AD1EE71C8D6:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:39 offine-stand-stor-0 [ 144.353096] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:39 offine-stand-stor-0 [ 144.377477] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:39 offine-stand-stor-0 [ 144.379800] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-ebb7 [12722]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.381642] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:39 offine-stand-stor-0 [ 144.383238] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:39 offine-stand-stor-0 [ 144.394649] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:39 offine-stand-stor-0 [ 144.395456] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:39 offine-stand-stor-0 [ 144.397133] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-ebb7 [12722]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.401297] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:39 offine-stand-stor-0 [ 144.404160] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-2: Preparing remote state change 3371204492 Mar 17 01:54:39 offine-stand-stor-0 [ 144.404596] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-4: Committing remote state change 1665432998 (primary_nodes=0) Mar 17 01:54:39 offine-stand-stor-0 [ 144.409767] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.413439] drbd pvc-e76e194f-5474-4ded-a067-0e1411e4f8f6/0 drbd1095 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.417334] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45/0 drbd1096 offline-stand-stor-4: my exposed UUID: B8C68AAC5219CB4C Mar 17 01:54:39 offine-stand-stor-0 [ 144.419326] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45/0 drbd1096 offline-stand-stor-4: peer B8C68AAC5219CB4C:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:39 offine-stand-stor-0 [ 144.425883] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-4: Committing remote state change 3275235550 (primary_nodes=0) Mar 17 01:54:39 offine-stand-stor-0 [ 144.429867] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.433705] drbd pvc-e9b974ed-6faf-4944-a08c-b0de5efd1f45/0 drbd1096 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.472568] drbd1063: detected capacity change from 0 to 10491632 Mar 17 01:54:39 offine-stand-stor-0 [ 144.474170] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9/0 drbd1063: size = 5123 MB (5245816 KB) Mar 17 01:54:39 offine-stand-stor-0 [ 144.475620] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9/0 drbd1063 offline-stand-stor-2: my exposed UUID: 0000000000000000 Mar 17 01:54:39 offine-stand-stor-0 [ 144.477178] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9/0 drbd1063 offline-stand-stor-2: peer BB0FA4D471069F1C:0000000000000000:5C85E69DBA161188:0000000000000000 bits:0 flags:1120 Mar 17 01:54:39 offine-stand-stor-0 [ 144.479870] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9/0 drbd1063: Setting exposed data uuid: BB0FA4D471069F1C Mar 17 01:54:39 offine-stand-stor-0 [ 144.500150] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-2: Committing remote state change 3371204492 (primary_nodes=0) Mar 17 01:54:39 offine-stand-stor-0 [ 144.502467] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9: susp-io( quorum -> no ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.503674] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.505507] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9/0 drbd1063: quorum( no -> yes ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.506631] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9/0 drbd1063 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.508361] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-3: Preparing remote state change 427568084 Mar 17 01:54:39 offine-stand-stor-0 [ 144.520900] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7: Starting worker thread (from drbdsetup [12758]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.527086] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-1: Starting sender thread (from drbdsetup [12763]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.531564] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-4: Starting sender thread (from drbdsetup [12765]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.543637] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7: susp-io( no -> quorum ) [connect] Mar 17 01:54:39 offine-stand-stor-0 [ 144.545189] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:39 offine-stand-stor-0 [ 144.547343] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-ed3c [12759]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.550924] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:39 offine-stand-stor-0 [ 144.553400] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:39 offine-stand-stor-0 [ 144.555267] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-ed3c [12759]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.558539] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:39 offine-stand-stor-0 [ 144.559813] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9/0 drbd1063 offline-stand-stor-3: my exposed UUID: BB0FA4D471069F1C Mar 17 01:54:39 offine-stand-stor-0 [ 144.562254] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9/0 drbd1063 offline-stand-stor-3: peer BB0FA4D471069F1C:5C85E69DBA161188:AFDC3BA3862DEC20:0000000000000000 bits:0 flags:1120 Mar 17 01:54:39 offine-stand-stor-0 [ 144.580755] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-3: Committing remote state change 427568084 (primary_nodes=0) Mar 17 01:54:39 offine-stand-stor-0 [ 144.582384] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.583961] drbd pvc-ea11c1a5-32e1-4fbd-a622-4a9d36f560f9/0 drbd1063 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.605489] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-2: Resync done (total 1 sec; paused 0 sec; 28684 K/sec) Mar 17 01:54:39 offine-stand-stor-0 [ 144.607324] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-2: updated UUIDs A96DEBC9065A789E:0000000000000000:B6D805E4C2BFE3F0:CBE6243C4E22D640 Mar 17 01:54:39 offine-stand-stor-0 [ 144.609255] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000: disk( Inconsistent -> UpToDate ) [resync-finished] Mar 17 01:54:39 offine-stand-stor-0 [ 144.610217] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-2: repl( SyncTarget -> Established ) [resync-finished] Mar 17 01:54:39 offine-stand-stor-0 [ 144.611934] drbd pvc-df8398d9-4a0d-4109-acb3-449e7d20514f/0 drbd1000 offline-stand-stor-1: resync-susp( connection dependency -> no ) [resync-finished] Mar 17 01:54:39 offine-stand-stor-0 [ 144.654736] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484: Starting worker thread (from drbdsetup [12790]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.661141] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-2: Starting sender thread (from drbdsetup [12795]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.667291] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-4: Starting sender thread (from drbdsetup [12797]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.693512] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:39 offine-stand-stor-0 [ 144.695543] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:39 offine-stand-stor-0 [ 144.695685] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: meta-data IO uses: blk-bio Mar 17 01:54:39 offine-stand-stor-0 [ 144.696604] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-1: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:39 offine-stand-stor-0 [ 144.696607] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:39 offine-stand-stor-0 [ 144.703903] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484: susp-io( no -> quorum ) [attach] Mar 17 01:54:39 offine-stand-stor-0 [ 144.704938] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:39 offine-stand-stor-0 [ 144.706211] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: Maximum number of peer devices = 7 Mar 17 01:54:39 offine-stand-stor-0 [ 144.708480] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484: Method to ensure write ordering: flush Mar 17 01:54:39 offine-stand-stor-0 [ 144.709739] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: drbd_bm_resize called with capacity == 4201520 Mar 17 01:54:39 offine-stand-stor-0 [ 144.711331] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: resync bitmap: bits=525190 words=57449 pages=113 Mar 17 01:54:39 offine-stand-stor-0 [ 144.712344] drbd1005: detected capacity change from 0 to 4201520 Mar 17 01:54:39 offine-stand-stor-0 [ 144.713469] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: size = 2052 MB (2100760 KB) Mar 17 01:54:39 offine-stand-stor-0 [ 144.713795] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:39 offine-stand-stor-0 [ 144.716726] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: recounting of set bits took additional 4ms Mar 17 01:54:39 offine-stand-stor-0 [ 144.717987] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:39 offine-stand-stor-0 [ 144.719195] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: attached to current UUID: 19252AD130F48C78 Mar 17 01:54:39 offine-stand-stor-0 [ 144.720628] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: Setting exposed data uuid: 19252AD130F48C78 Mar 17 01:54:39 offine-stand-stor-0 [ 144.725835] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:39 offine-stand-stor-0 [ 144.728393] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:39 offine-stand-stor-0 [ 144.728405] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-edc7 [12791]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.730197] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:39 offine-stand-stor-0 [ 144.731872] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:39 offine-stand-stor-0 [ 144.731895] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-edc7 [12791]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.734371] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-3: Preparing remote state change 3624388236 Mar 17 01:54:39 offine-stand-stor-0 [ 144.735294] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:39 offine-stand-stor-0 [ 144.780637] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:39 offine-stand-stor-0 [ 144.782096] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136 offline-stand-stor-3: self F5A5E8748B4E1D74:0000000000000000:2C8CF87D295842CC:0000000000000000 bits:0 flags:20 Mar 17 01:54:39 offine-stand-stor-0 [ 144.784999] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136 offline-stand-stor-3: peer F5A5E8748B4E1D74:0000000000000000:3D294B484042C0E8:2641E144604B38E4 bits:0 flags:1120 Mar 17 01:54:39 offine-stand-stor-0 [ 144.787946] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:39 offine-stand-stor-0 [ 144.798643] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-1: Preparing remote state change 398182597 Mar 17 01:54:39 offine-stand-stor-0 [ 144.807416] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-3: Committing remote state change 3624388236 (primary_nodes=0) Mar 17 01:54:39 offine-stand-stor-0 [ 144.809563] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833: susp-io( quorum -> no ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.810315] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.810758] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92: Starting worker thread (from drbdsetup [12824]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.811804] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136: quorum( no -> yes ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.813634] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:39 offine-stand-stor-0 [ 144.815419] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136 offline-stand-stor-3: cleared bm UUID and bitmap F5A5E8748B4E1D74:0000000000000000:2C8CF87D295842CC:0000000000000000 Mar 17 01:54:39 offine-stand-stor-0 [ 144.815725] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-2: Starting sender thread (from drbdsetup [12829]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.817167] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833: Preparing cluster-wide state change 2158198726 (1->2 499/146) Mar 17 01:54:39 offine-stand-stor-0 [ 144.819757] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-3: Starting sender thread (from drbdsetup [12831]) Mar 17 01:54:39 offine-stand-stor-0 [ 144.822584] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35/0 drbd1089 offline-stand-stor-1: my exposed UUID: E104C73B97AC7A38 Mar 17 01:54:39 offine-stand-stor-0 [ 144.825268] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92: susp-io( no -> quorum ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 144.848552] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35/0 drbd1089 offline-stand-stor-1: peer E104C73B97AC7A38:0000000000000000:9FF9F91D4D1C89D0:0000000000000000 bits:0 flags:1120 Mar 17 01:54:40 offine-stand-stor-0 [ 144.849099] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 144.889008] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 144.892728] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-ef0b [12825]) Mar 17 01:54:40 offine-stand-stor-0 [ 144.900664] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136 offline-stand-stor-1: self F5A5E8748B4E1D74:0000000000000000:2C8CF87D295842CC:0000000000000000 bits:0 flags:0 Mar 17 01:54:40 offine-stand-stor-0 [ 144.902426] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-1: Committing remote state change 398182597 (primary_nodes=0) Mar 17 01:54:40 offine-stand-stor-0 [ 144.904285] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136 offline-stand-stor-1: peer's exposed UUID: F5A5E8748B4E1D74 Mar 17 01:54:40 offine-stand-stor-0 [ 144.904297] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833: State change 2158198726: primary_nodes=0, weak_nodes=0 Mar 17 01:54:40 offine-stand-stor-0 [ 144.904301] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833: Committing cluster-wide state change 2158198726 (84ms) Mar 17 01:54:40 offine-stand-stor-0 [ 144.904330] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:40 offine-stand-stor-0 [ 144.907062] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 144.909265] drbd pvc-ea6e21e1-f462-45a9-ba9a-6f9f833b5833/0 drbd1136 offline-stand-stor-1: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:40 offine-stand-stor-0 [ 144.910616] drbd pvc-e62ac570-a751-40d0-a821-57681ccd5f35/0 drbd1089 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 144.944863] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98: Starting worker thread (from drbdsetup [12845]) Mar 17 01:54:40 offine-stand-stor-0 [ 144.961643] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:40 offine-stand-stor-0 [ 144.962162] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-ef0b [12825]) Mar 17 01:54:40 offine-stand-stor-0 [ 144.964633] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:40 offine-stand-stor-0 [ 144.967540] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-1: Starting sender thread (from drbdsetup [12851]) Mar 17 01:54:40 offine-stand-stor-0 [ 144.969577] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:40 offine-stand-stor-0 [ 144.972223] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:40 offine-stand-stor-0 [ 144.979672] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-4: Starting sender thread (from drbdsetup [12853]) Mar 17 01:54:40 offine-stand-stor-0 [ 144.981586] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:40 offine-stand-stor-0 [ 144.981947] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:40 offine-stand-stor-0 [ 144.989519] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98: susp-io( no -> quorum ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 144.994706] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 144.995759] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-f90f [12847]) Mar 17 01:54:40 offine-stand-stor-0 [ 144.996142] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:40 offine-stand-stor-0 [ 144.999051] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:40 offine-stand-stor-0 [ 145.003009] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.004256] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:40 offine-stand-stor-0 [ 145.004493] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-f90f [12847]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.006100] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919: Preparing cluster-wide state change 2349953611 (1->2 499/146) Mar 17 01:54:40 offine-stand-stor-0 [ 145.009385] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:40 offine-stand-stor-0 [ 145.056262] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6: Starting worker thread (from drbdsetup [12870]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.065928] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-3: Starting sender thread (from drbdsetup [12875]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.072241] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-4: Starting sender thread (from drbdsetup [12877]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.077517] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:40 offine-stand-stor-0 [ 145.079182] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6: susp-io( no -> quorum ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.080011] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:40 offine-stand-stor-0 [ 145.080630] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128 offline-stand-stor-2: self CCA2B76A02C2EDB8:0000000000000000:6D3D3A63E3B4287E:0000000000000000 bits:0 flags:0 Mar 17 01:54:40 offine-stand-stor-0 [ 145.080634] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128 offline-stand-stor-2: peer's exposed UUID: CCA2B76A02C2EDB8 Mar 17 01:54:40 offine-stand-stor-0 [ 145.080653] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919: State change 2349953611: primary_nodes=0, weak_nodes=0 Mar 17 01:54:40 offine-stand-stor-0 [ 145.080656] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919: Committing cluster-wide state change 2349953611 (76ms) Mar 17 01:54:40 offine-stand-stor-0 [ 145.080695] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:40 offine-stand-stor-0 [ 145.080698] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:40 offine-stand-stor-0 [ 145.081189] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.081476] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-fa2d [12871]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.089749] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.100401] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:40 offine-stand-stor-0 [ 145.101420] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-fa2d [12871]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.101654] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:40 offine-stand-stor-0 [ 145.104533] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:40 offine-stand-stor-0 [ 145.108610] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:40 offine-stand-stor-0 [ 145.109958] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:40 offine-stand-stor-0 [ 145.110857] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-1: Preparing remote state change 3354169910 Mar 17 01:54:40 offine-stand-stor-0 [ 145.125939] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:40 offine-stand-stor-0 [ 145.129223] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-4: Preparing remote state change 1969722530 Mar 17 01:54:40 offine-stand-stor-0 [ 145.164587] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128 offline-stand-stor-1: drbd_sync_handshake: Mar 17 01:54:40 offine-stand-stor-0 [ 145.165495] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128 offline-stand-stor-1: self CCA2B76A02C2EDB8:0000000000000000:6D3D3A63E3B4287E:0000000000000000 bits:0 flags:20 Mar 17 01:54:40 offine-stand-stor-0 [ 145.167837] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128 offline-stand-stor-1: peer CCA2B76A02C2EDB8:0000000000000000:D9E7397536564E3C:96DB1C85096BEE54 bits:0 flags:1120 Mar 17 01:54:40 offine-stand-stor-0 [ 145.170144] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128 offline-stand-stor-1: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:40 offine-stand-stor-0 [ 145.170505] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959: Starting worker thread (from drbdsetup [12894]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.177121] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-1: Starting sender thread (from drbdsetup [12899]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.177175] drbd1106: detected capacity change from 0 to 10491632 Mar 17 01:54:40 offine-stand-stor-0 [ 145.181764] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7/0 drbd1106: size = 5123 MB (5245816 KB) Mar 17 01:54:40 offine-stand-stor-0 [ 145.183177] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7/0 drbd1106 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:40 offine-stand-stor-0 [ 145.184570] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7/0 drbd1106 offline-stand-stor-4: peer 52335AB6F8C821F4:176402CDCAD9CCD0:176402CDCAD9CCD0:0000000000000000 bits:0 flags:1120 Mar 17 01:54:40 offine-stand-stor-0 [ 145.187405] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7/0 drbd1106: Setting exposed data uuid: 52335AB6F8C821F4 Mar 17 01:54:40 offine-stand-stor-0 [ 145.188641] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-1: Committing remote state change 3354169910 (primary_nodes=0) Mar 17 01:54:40 offine-stand-stor-0 [ 145.189849] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-3: Starting sender thread (from drbdsetup [12901]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.190428] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-4: Committing remote state change 1969722530 (primary_nodes=0) Mar 17 01:54:40 offine-stand-stor-0 [ 145.190438] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7: susp-io( quorum -> no ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.190441] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.190442] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7/0 drbd1106: quorum( no -> yes ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.190444] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7/0 drbd1106 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.191005] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919: susp-io( quorum -> no ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.196069] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959: susp-io( no -> quorum ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.197329] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.198216] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.199878] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128: quorum( no -> yes ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.200746] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-fad2 [12895]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.201617] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.201822] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.203326] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:40 offine-stand-stor-0 [ 145.203339] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-fad2 [12895]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.204304] drbd pvc-ebb77272-4176-4934-8d48-90a91f9a7919/0 drbd1128 offline-stand-stor-1: cleared bm UUID and bitmap CCA2B76A02C2EDB8:0000000000000000:6D3D3A63E3B4287E:0000000000000000 Mar 17 01:54:40 offine-stand-stor-0 [ 145.205227] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:40 offine-stand-stor-0 [ 145.235718] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-1: Preparing remote state change 205650454 Mar 17 01:54:40 offine-stand-stor-0 [ 145.272800] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-4: Handshake to peer 3 successful: Agreed network protocol version 122 Mar 17 01:54:40 offine-stand-stor-0 [ 145.276928] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:40 offine-stand-stor-0 [ 145.280657] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:40 offine-stand-stor-0 [ 145.284895] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:40 offine-stand-stor-0 [ 145.297313] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:40 offine-stand-stor-0 [ 145.300580] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484: Preparing cluster-wide state change 3348432960 (1->3 499/146) Mar 17 01:54:40 offine-stand-stor-0 [ 145.301181] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:40 offine-stand-stor-0 [ 145.318912] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: Starting worker thread (from drbdsetup [12926]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.342054] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: Starting sender thread (from drbdsetup [12931]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.346790] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-2: Starting sender thread (from drbdsetup [12933]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.348609] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7/0 drbd1106 offline-stand-stor-1: my exposed UUID: 52335AB6F8C821F4 Mar 17 01:54:40 offine-stand-stor-0 [ 145.351436] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7/0 drbd1106 offline-stand-stor-1: peer 52335AB6F8C821F4:176402CDCAD9CCD1:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:40 offine-stand-stor-0 [ 145.363965] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-1: Committing remote state change 205650454 (primary_nodes=0) Mar 17 01:54:40 offine-stand-stor-0 [ 145.366748] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.369145] drbd pvc-ed3c0093-a418-434e-95b0-d2e2106bc1f7/0 drbd1106 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.378035] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-4: self 19252AD130F48C78:7E8F77C67CB62EC8:8DF526CA12B833FC:29D2A2A729912E1C bits:0 flags:0 Mar 17 01:54:40 offine-stand-stor-0 [ 145.379967] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-4: peer's exposed UUID: B4D75299AB86568A Mar 17 01:54:40 offine-stand-stor-0 [ 145.380605] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: meta-data IO uses: blk-bio Mar 17 01:54:40 offine-stand-stor-0 [ 145.381890] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484: State change 3348432960: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFF4 Mar 17 01:54:40 offine-stand-stor-0 [ 145.381893] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484: Committing cluster-wide state change 3348432960 (80ms) Mar 17 01:54:40 offine-stand-stor-0 [ 145.381913] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:40 offine-stand-stor-0 [ 145.383197] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: susp-io( no -> quorum ) [attach] Mar 17 01:54:40 offine-stand-stor-0 [ 145.384793] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: disk( UpToDate -> Outdated ) [connected] Mar 17 01:54:40 offine-stand-stor-0 [ 145.385696] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:40 offine-stand-stor-0 [ 145.387410] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-4: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:40 offine-stand-stor-0 [ 145.388344] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: Maximum number of peer devices = 7 Mar 17 01:54:40 offine-stand-stor-0 [ 145.389236] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: Enabling local AL-updates Mar 17 01:54:40 offine-stand-stor-0 [ 145.397481] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: Method to ensure write ordering: flush Mar 17 01:54:40 offine-stand-stor-0 [ 145.400235] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:40 offine-stand-stor-0 [ 145.402368] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:40 offine-stand-stor-0 [ 145.404309] drbd1054: detected capacity change from 0 to 10491632 Mar 17 01:54:40 offine-stand-stor-0 [ 145.405736] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: size = 5123 MB (5245816 KB) Mar 17 01:54:40 offine-stand-stor-0 [ 145.406081] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-2: Preparing remote state change 133028041 Mar 17 01:54:40 offine-stand-stor-0 [ 145.411662] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: recounting of set bits took additional 0ms Mar 17 01:54:40 offine-stand-stor-0 [ 145.412798] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:40 offine-stand-stor-0 [ 145.413814] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: attached to current UUID: 084BEEE16D1E269C Mar 17 01:54:40 offine-stand-stor-0 [ 145.414777] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: Setting exposed data uuid: 084BEEE16D1E269C Mar 17 01:54:40 offine-stand-stor-0 [ 145.418424] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.420080] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-fc9d [12927]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.421576] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.423872] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:40 offine-stand-stor-0 [ 145.423875] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-fc9d [12927]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.429208] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:40 offine-stand-stor-0 [ 145.441826] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:40 offine-stand-stor-0 [ 145.442701] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-2: self 19252AD130F48C78:0000000000000000:8DF526CA12B833FC:29D2A2A729912E1C bits:0 flags:20 Mar 17 01:54:40 offine-stand-stor-0 [ 145.444282] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-2: peer B4D75299AB86568B:19252AD130F48C79:711BC7E61BDC83E0:36C2CEE0775C5CCE bits:887 flags:1120 Mar 17 01:54:40 offine-stand-stor-0 [ 145.445956] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-2: uuid_compare()=target-use-bitmap by rule=bitmap-peer Mar 17 01:54:40 offine-stand-stor-0 [ 145.464287] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-2: Committing remote state change 133028041 (primary_nodes=1) Mar 17 01:54:40 offine-stand-stor-0 [ 145.466187] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484: susp-io( quorum -> no ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.466966] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Primary ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.468484] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: quorum( no -> yes ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.469294] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> WFBitMapT ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.470800] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: Disabling local AL-updates (optimization) Mar 17 01:54:40 offine-stand-stor-0 [ 145.471592] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: Setting exposed data uuid: B4D75299AB86568A Mar 17 01:54:40 offine-stand-stor-0 [ 145.489883] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-2: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 35(1), total 35; compression: 100.0% Mar 17 01:54:40 offine-stand-stor-0 [ 145.491499] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-2: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 35(1), total 35; compression: 100.0% Mar 17 01:54:40 offine-stand-stor-0 [ 145.493058] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: disk( Outdated -> Inconsistent ) [receive-bitmap] Mar 17 01:54:40 offine-stand-stor-0 [ 145.493910] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-4: resync-susp( no -> connection dependency ) [receive-bitmap] Mar 17 01:54:40 offine-stand-stor-0 [ 145.495567] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-2: repl( WFBitMapT -> SyncTarget ) [receive-bitmap] Mar 17 01:54:40 offine-stand-stor-0 [ 145.497502] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-2: Began resync as SyncTarget (will sync 3548 KB [887 bits set]). Mar 17 01:54:40 offine-stand-stor-0 [ 145.498989] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563: Starting worker thread (from drbdsetup [12966]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.505397] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-2: Starting sender thread (from drbdsetup [12971]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.511506] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-3: Starting sender thread (from drbdsetup [12973]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.524653] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:40 offine-stand-stor-0 [ 145.524673] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-3: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:40 offine-stand-stor-0 [ 145.524737] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:40 offine-stand-stor-0 [ 145.524758] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:40 offine-stand-stor-0 [ 145.524931] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:40 offine-stand-stor-0 [ 145.524933] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:40 offine-stand-stor-0 [ 145.527015] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:40 offine-stand-stor-0 [ 145.530643] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:40 offine-stand-stor-0 [ 145.532796] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:40 offine-stand-stor-0 [ 145.534293] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:40 offine-stand-stor-0 [ 145.535770] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:40 offine-stand-stor-0 [ 145.544802] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-4: Preparing remote state change 1702776832 Mar 17 01:54:40 offine-stand-stor-0 [ 145.546693] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-2: Preparing remote state change 329686202 Mar 17 01:54:40 offine-stand-stor-0 [ 145.549208] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067: meta-data IO uses: blk-bio Mar 17 01:54:40 offine-stand-stor-0 [ 145.556177] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563: susp-io( no -> quorum ) [attach] Mar 17 01:54:40 offine-stand-stor-0 [ 145.557316] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:40 offine-stand-stor-0 [ 145.558640] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067: Maximum number of peer devices = 7 Mar 17 01:54:40 offine-stand-stor-0 [ 145.560727] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:40 offine-stand-stor-0 [ 145.562298] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563: Method to ensure write ordering: flush Mar 17 01:54:40 offine-stand-stor-0 [ 145.564956] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:40 offine-stand-stor-0 [ 145.567858] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:40 offine-stand-stor-0 [ 145.570165] drbd1067: detected capacity change from 0 to 10491632 Mar 17 01:54:40 offine-stand-stor-0 [ 145.572152] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067: size = 5123 MB (5245816 KB) Mar 17 01:54:40 offine-stand-stor-0 [ 145.572567] drbd1053: detected capacity change from 0 to 10491632 Mar 17 01:54:40 offine-stand-stor-0 [ 145.575888] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92/0 drbd1053: size = 5123 MB (5245816 KB) Mar 17 01:54:40 offine-stand-stor-0 [ 145.577906] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92/0 drbd1053 offline-stand-stor-2: my exposed UUID: 0000000000000000 Mar 17 01:54:40 offine-stand-stor-0 [ 145.579374] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92/0 drbd1053 offline-stand-stor-2: peer 396C01C545109FE6:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:40 offine-stand-stor-0 [ 145.582228] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92/0 drbd1053: Setting exposed data uuid: 396C01C545109FE6 Mar 17 01:54:40 offine-stand-stor-0 [ 145.588569] drbd1026: detected capacity change from 0 to 10491632 Mar 17 01:54:40 offine-stand-stor-0 [ 145.589645] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98/0 drbd1026: size = 5123 MB (5245816 KB) Mar 17 01:54:40 offine-stand-stor-0 [ 145.590869] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98/0 drbd1026 offline-stand-stor-4: my exposed UUID: 0000000000000000 Mar 17 01:54:40 offine-stand-stor-0 [ 145.592090] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98/0 drbd1026 offline-stand-stor-4: peer 7050AD03531953DA:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:40 offine-stand-stor-0 [ 145.594106] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98/0 drbd1026: Setting exposed data uuid: 7050AD03531953DA Mar 17 01:54:40 offine-stand-stor-0 [ 145.597707] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067: recounting of set bits took additional 0ms Mar 17 01:54:40 offine-stand-stor-0 [ 145.598753] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:40 offine-stand-stor-0 [ 145.599973] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067: attached to current UUID: FC74204D9CCD55FA Mar 17 01:54:40 offine-stand-stor-0 [ 145.601404] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067: Setting exposed data uuid: FC74204D9CCD55FA Mar 17 01:54:40 offine-stand-stor-0 [ 145.608747] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-3: Rejecting concurrent remote state change 3180832351 because of state change 329686202 Mar 17 01:54:40 offine-stand-stor-0 [ 145.609186] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.612439] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-2: Committing remote state change 329686202 (primary_nodes=0) Mar 17 01:54:40 offine-stand-stor-0 [ 145.614798] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-fc9e [12967]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.615124] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92: susp-io( quorum -> no ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.619244] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.621088] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92/0 drbd1053: quorum( no -> yes ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.621977] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92/0 drbd1053 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.623963] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:40 offine-stand-stor-0 [ 145.624647] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:40 offine-stand-stor-0 [ 145.628665] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:40 offine-stand-stor-0 [ 145.631769] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-4: Committing remote state change 1702776832 (primary_nodes=0) Mar 17 01:54:40 offine-stand-stor-0 [ 145.634178] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98: susp-io( quorum -> no ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.635211] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.637459] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.637839] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98/0 drbd1026: quorum( no -> yes ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.639035] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-fc9e [12967]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.640530] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98/0 drbd1026 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.643631] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:40 offine-stand-stor-0 [ 145.645560] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-1: Preparing remote state change 76039892 Mar 17 01:54:40 offine-stand-stor-0 [ 145.650285] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:40 offine-stand-stor-0 [ 145.652682] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:40 offine-stand-stor-0 [ 145.655350] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:40 offine-stand-stor-0 [ 145.656625] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92/0 drbd1053 offline-stand-stor-3: my exposed UUID: 396C01C545109FE6 Mar 17 01:54:40 offine-stand-stor-0 [ 145.659302] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92/0 drbd1053 offline-stand-stor-3: peer 396C01C545109FE6:0000000000000000:7FC1262394A843F4:0000000000000000 bits:0 flags:1120 Mar 17 01:54:40 offine-stand-stor-0 [ 145.666554] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-3: Preparing remote state change 2390292332 Mar 17 01:54:40 offine-stand-stor-0 [ 145.668596] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:40 offine-stand-stor-0 [ 145.672667] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98/0 drbd1026 offline-stand-stor-1: my exposed UUID: 7050AD03531953DA Mar 17 01:54:40 offine-stand-stor-0 [ 145.673811] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98/0 drbd1026 offline-stand-stor-1: peer 7050AD03531953DA:0000000000000000:659A820EC907A2D0:0000000000000000 bits:0 flags:1120 Mar 17 01:54:40 offine-stand-stor-0 [ 145.703006] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-2: Resync done (total 1 sec; paused 0 sec; 3548 K/sec) Mar 17 01:54:40 offine-stand-stor-0 [ 145.704765] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-2: updated UUIDs B4D75299AB86568A:0000000000000000:8DF526CA12B833FC:29D2A2A729912E1C Mar 17 01:54:40 offine-stand-stor-0 [ 145.706699] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005: disk( Inconsistent -> UpToDate ) [resync-finished] Mar 17 01:54:40 offine-stand-stor-0 [ 145.707646] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-4: resync-susp( connection dependency -> no ) [resync-finished] Mar 17 01:54:40 offine-stand-stor-0 [ 145.708616] drbd1102: detected capacity change from 0 to 10491632 Mar 17 01:54:40 offine-stand-stor-0 [ 145.708667] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4: Starting worker thread (from drbdsetup [13004]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.709575] drbd pvc-edc7282c-852a-4ad2-a039-d23f9b5ba484/0 drbd1005 offline-stand-stor-2: repl( SyncTarget -> Established ) [resync-finished] Mar 17 01:54:40 offine-stand-stor-0 [ 145.712727] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-1: Starting sender thread (from drbdsetup [13009]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.713326] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6/0 drbd1102: size = 5123 MB (5245816 KB) Mar 17 01:54:40 offine-stand-stor-0 [ 145.721788] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-4: Starting sender thread (from drbdsetup [13011]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.722048] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6/0 drbd1102 offline-stand-stor-3: my exposed UUID: 0000000000000000 Mar 17 01:54:40 offine-stand-stor-0 [ 145.726048] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6/0 drbd1102 offline-stand-stor-3: peer C7C6D36F1B2C9E24:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:40 offine-stand-stor-0 [ 145.728880] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6/0 drbd1102: Setting exposed data uuid: C7C6D36F1B2C9E24 Mar 17 01:54:40 offine-stand-stor-0 [ 145.729204] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4: susp-io( no -> quorum ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.731809] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.733031] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-fd32 [13005]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.733837] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-3: Committing remote state change 2390292332 (primary_nodes=0) Mar 17 01:54:40 offine-stand-stor-0 [ 145.734850] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.736458] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:40 offine-stand-stor-0 [ 145.736480] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-fd32 [13005]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.736558] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:40 offine-stand-stor-0 [ 145.736566] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:40 offine-stand-stor-0 [ 145.739088] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6: susp-io( quorum -> no ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.739742] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-1: Committing remote state change 76039892 (primary_nodes=0) Mar 17 01:54:40 offine-stand-stor-0 [ 145.739752] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.739762] drbd pvc-f90f4ab6-d994-4a77-a0ff-a36669856d98/0 drbd1026 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.743064] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:40 offine-stand-stor-0 [ 145.743989] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.764490] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6/0 drbd1102: quorum( no -> yes ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.765376] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6/0 drbd1102 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.769348] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:40 offine-stand-stor-0 [ 145.770394] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-4: Preparing remote state change 3351175568 Mar 17 01:54:40 offine-stand-stor-0 [ 145.776574] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-1: Preparing remote state change 686663460 Mar 17 01:54:40 offine-stand-stor-0 [ 145.781565] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e: Starting worker thread (from drbdsetup [13027]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.793683] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:40 offine-stand-stor-0 [ 145.796365] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:40 offine-stand-stor-0 [ 145.797786] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-1: Starting sender thread (from drbdsetup [13032]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.800169] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:40 offine-stand-stor-0 [ 145.806479] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6/0 drbd1102 offline-stand-stor-4: my exposed UUID: C7C6D36F1B2C9E24 Mar 17 01:54:40 offine-stand-stor-0 [ 145.806691] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-4: Starting sender thread (from drbdsetup [13034]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.808500] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6/0 drbd1102 offline-stand-stor-4: peer C7C6D36F1B2C9E24:0000000000000000:C21B55FA877C7C52:0000000000000000 bits:0 flags:1120 Mar 17 01:54:40 offine-stand-stor-0 [ 145.815107] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e: susp-io( no -> quorum ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.816173] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.818124] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-fe22 [13028]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.818444] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-4: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:40 offine-stand-stor-0 [ 145.832471] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-4: Committing remote state change 3351175568 (primary_nodes=0) Mar 17 01:54:40 offine-stand-stor-0 [ 145.835180] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:40 offine-stand-stor-0 [ 145.836558] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:40 offine-stand-stor-0 [ 145.836575] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-4: Starting receiver thread (from drbd_w_pvc-fe22 [13028]) Mar 17 01:54:40 offine-stand-stor-0 [ 145.838579] drbd pvc-fa2dbd70-198a-48f9-b84d-793545985ee6/0 drbd1102 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 145.842408] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-4: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:41 offine-stand-stor-0 [ 145.846821] drbd1055: detected capacity change from 0 to 10491632 Mar 17 01:54:41 offine-stand-stor-0 [ 145.898157] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210: Starting worker thread (from drbdsetup [13058]) Mar 17 01:54:41 offine-stand-stor-0 [ 145.910407] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959/0 drbd1055: size = 5123 MB (5245816 KB) Mar 17 01:54:41 offine-stand-stor-0 [ 145.915865] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-2: Starting sender thread (from drbdsetup [13063]) Mar 17 01:54:41 offine-stand-stor-0 [ 145.937109] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959/0 drbd1055 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:41 offine-stand-stor-0 [ 145.940727] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: Starting sender thread (from drbdsetup [13065]) Mar 17 01:54:41 offine-stand-stor-0 [ 145.960664] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: Handshake to peer 3 successful: Agreed network protocol version 122 Mar 17 01:54:41 offine-stand-stor-0 [ 145.961374] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959/0 drbd1055 offline-stand-stor-1: peer F753DDEE5CD41C0E:0000000000000000:7AB6AAFAD42E62F8:0000000000000000 bits:0 flags:1120 Mar 17 01:54:41 offine-stand-stor-0 [ 145.961480] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959/0 drbd1055: Setting exposed data uuid: F753DDEE5CD41C0E Mar 17 01:54:41 offine-stand-stor-0 [ 145.962943] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-2: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:41 offine-stand-stor-0 [ 145.965419] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:41 offine-stand-stor-0 [ 145.967796] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:41 offine-stand-stor-0 [ 145.970788] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:41 offine-stand-stor-0 [ 145.978169] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:41 offine-stand-stor-0 [ 145.978551] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-1: Committing remote state change 686663460 (primary_nodes=0) Mar 17 01:54:41 offine-stand-stor-0 [ 145.980782] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: Preparing cluster-wide state change 3431709264 (0->3 499/146) Mar 17 01:54:41 offine-stand-stor-0 [ 145.982732] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074: meta-data IO uses: blk-bio Mar 17 01:54:41 offine-stand-stor-0 [ 146.015627] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959: susp-io( quorum -> no ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.015636] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.015679] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959/0 drbd1055: quorum( no -> yes ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.015788] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959/0 drbd1055 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.017325] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210: susp-io( no -> quorum ) [attach] Mar 17 01:54:41 offine-stand-stor-0 [ 146.032255] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-3: Preparing remote state change 2719771889 Mar 17 01:54:41 offine-stand-stor-0 [ 146.033285] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074: disk( Diskless -> Attaching ) [attach] Mar 17 01:54:41 offine-stand-stor-0 [ 146.033412] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074: Maximum number of peer devices = 7 Mar 17 01:54:41 offine-stand-stor-0 [ 146.082052] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210: Method to ensure write ordering: flush Mar 17 01:54:41 offine-stand-stor-0 [ 146.083157] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074: drbd_bm_resize called with capacity == 10491632 Mar 17 01:54:41 offine-stand-stor-0 [ 146.084916] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074: resync bitmap: bits=1311454 words=143444 pages=281 Mar 17 01:54:41 offine-stand-stor-0 [ 146.086239] drbd1074: detected capacity change from 0 to 10491632 Mar 17 01:54:41 offine-stand-stor-0 [ 146.087261] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074: size = 5123 MB (5245816 KB) Mar 17 01:54:41 offine-stand-stor-0 [ 146.098260] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074: recounting of set bits took additional 0ms Mar 17 01:54:41 offine-stand-stor-0 [ 146.099240] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074: disk( Attaching -> UpToDate ) [attach] Mar 17 01:54:41 offine-stand-stor-0 [ 146.100231] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074: attached to current UUID: 8C7D3BA643B31A60 Mar 17 01:54:41 offine-stand-stor-0 [ 146.101166] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074: Setting exposed data uuid: 8C7D3BA643B31A60 Mar 17 01:54:41 offine-stand-stor-0 [ 146.104077] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-2: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:41 offine-stand-stor-0 [ 146.104600] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054 offline-stand-stor-1: self 084BEEE16D1E269C:5B07875DBF56EA07:5704B6CB9E1BAAB4:3E12EBDF8124F06A bits:0 flags:0 Mar 17 01:54:41 offine-stand-stor-0 [ 146.105903] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-2: Starting receiver thread (from drbd_w_pvc-fed6 [13059]) Mar 17 01:54:41 offine-stand-stor-0 [ 146.106715] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959/0 drbd1055 offline-stand-stor-3: my exposed UUID: F753DDEE5CD41C0E Mar 17 01:54:41 offine-stand-stor-0 [ 146.106824] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959/0 drbd1055 offline-stand-stor-3: peer F753DDEE5CD41C0E:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:41 offine-stand-stor-0 [ 146.106938] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:54:41 offine-stand-stor-0 [ 146.107723] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054 offline-stand-stor-1: peer's exposed UUID: 084BEEE16D1E269D Mar 17 01:54:41 offine-stand-stor-0 [ 146.110808] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-2: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:41 offine-stand-stor-0 [ 146.110833] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: Starting receiver thread (from drbd_w_pvc-fed6 [13059]) Mar 17 01:54:41 offine-stand-stor-0 [ 146.111916] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: State change 3431709264: primary_nodes=0, weak_nodes=0 Mar 17 01:54:41 offine-stand-stor-0 [ 146.114373] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:54:41 offine-stand-stor-0 [ 146.115494] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: Committing cluster-wide state change 3431709264 (132ms) Mar 17 01:54:41 offine-stand-stor-0 [ 146.122388] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-3: Committing remote state change 2719771889 (primary_nodes=0) Mar 17 01:54:41 offine-stand-stor-0 [ 146.123490] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:41 offine-stand-stor-0 [ 146.147039] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-2: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:41 offine-stand-stor-0 [ 146.147044] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:41 offine-stand-stor-0 [ 146.149159] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.150571] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054 offline-stand-stor-1: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:41 offine-stand-stor-0 [ 146.150772] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: Preparing cluster-wide state change 1939253118 (0->1 499/146) Mar 17 01:54:41 offine-stand-stor-0 [ 146.169603] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-3: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:41 offine-stand-stor-0 [ 146.169607] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:41 offine-stand-stor-0 [ 146.170642] drbd pvc-fad202fe-fb7d-47e6-b530-5e76129af959/0 drbd1055 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.173016] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:41 offine-stand-stor-0 [ 146.190482] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-3: Preparing remote state change 603091184 Mar 17 01:54:41 offine-stand-stor-0 [ 146.217972] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:41 offine-stand-stor-0 [ 146.220575] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563: Preparing cluster-wide state change 117939372 (1->2 499/146) Mar 17 01:54:41 offine-stand-stor-0 [ 146.256651] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:41 offine-stand-stor-0 [ 146.257620] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054 offline-stand-stor-2: self 084BEEE16D1E269C:0000000000000000:5704B6CB9E1BAAB4:3E12EBDF8124F06A bits:0 flags:20 Mar 17 01:54:41 offine-stand-stor-0 [ 146.259369] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054 offline-stand-stor-2: peer 084BEEE16D1E269C:0000000000000000:5704B6CB9E1BAAB4:477E813E53204892 bits:0 flags:1120 Mar 17 01:54:41 offine-stand-stor-0 [ 146.260602] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92/0 drbd1053 offline-stand-stor-3: my exposed UUID: 396C01C545109FE6 Mar 17 01:54:41 offine-stand-stor-0 [ 146.260638] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-1: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:41 offine-stand-stor-0 [ 146.260641] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:41 offine-stand-stor-0 [ 146.261303] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:41 offine-stand-stor-0 [ 146.262360] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92/0 drbd1053 offline-stand-stor-3: peer 396C01C545109FE6:0000000000000000:7FC1262394A843F4:0000000000000000 bits:0 flags:1120 Mar 17 01:54:41 offine-stand-stor-0 [ 146.264497] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: State change 1939253118: primary_nodes=0, weak_nodes=0 Mar 17 01:54:41 offine-stand-stor-0 [ 146.268619] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067 offline-stand-stor-3: self FC74204D9CCD55FA:0000000000000000:CB37AACE7BDB7AD6:0000000000000000 bits:0 flags:0 Mar 17 01:54:41 offine-stand-stor-0 [ 146.269140] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: Committing cluster-wide state change 1939253118 (120ms) Mar 17 01:54:41 offine-stand-stor-0 [ 146.270290] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-3: Committing remote state change 603091184 (primary_nodes=0) Mar 17 01:54:41 offine-stand-stor-0 [ 146.270301] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.270304] drbd pvc-ef0ba87b-e8a6-44c9-affa-caf4204b4e92/0 drbd1053 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.271097] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067 offline-stand-stor-3: peer's exposed UUID: FC74204D9CCD55FA Mar 17 01:54:41 offine-stand-stor-0 [ 146.272015] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: susp-io( quorum -> no ) [connected] Mar 17 01:54:41 offine-stand-stor-0 [ 146.278716] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563: State change 117939372: primary_nodes=0, weak_nodes=0 Mar 17 01:54:41 offine-stand-stor-0 [ 146.279972] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:41 offine-stand-stor-0 [ 146.281743] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563: Committing cluster-wide state change 117939372 (60ms) Mar 17 01:54:41 offine-stand-stor-0 [ 146.282610] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: quorum( no -> yes ) [connected] Mar 17 01:54:41 offine-stand-stor-0 [ 146.283501] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:41 offine-stand-stor-0 [ 146.285684] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [connected] Mar 17 01:54:41 offine-stand-stor-0 [ 146.286598] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067 offline-stand-stor-3: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:41 offine-stand-stor-0 [ 146.287571] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054 offline-stand-stor-2: cleared bm UUID and bitmap 084BEEE16D1E269C:0000000000000000:5704B6CB9E1BAAB4:3E12EBDF8124F06A Mar 17 01:54:41 offine-stand-stor-0 [ 146.292620] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-4: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:41 offine-stand-stor-0 [ 146.293417] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:41 offine-stand-stor-0 [ 146.297180] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:41 offine-stand-stor-0 [ 146.300830] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:41 offine-stand-stor-0 [ 146.328886] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-2: Preparing remote state change 477908998 Mar 17 01:54:41 offine-stand-stor-0 [ 146.329328] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-1: Preparing remote state change 2145844301 Mar 17 01:54:41 offine-stand-stor-0 [ 146.364588] drbd1051: detected capacity change from 0 to 10491632 Mar 17 01:54:41 offine-stand-stor-0 [ 146.365496] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4/0 drbd1051: size = 5123 MB (5245816 KB) Mar 17 01:54:41 offine-stand-stor-0 [ 146.368675] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067 offline-stand-stor-2: drbd_sync_handshake: Mar 17 01:54:41 offine-stand-stor-0 [ 146.369814] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067 offline-stand-stor-2: self FC74204D9CCD55FA:0000000000000000:CB37AACE7BDB7AD6:0000000000000000 bits:0 flags:20 Mar 17 01:54:41 offine-stand-stor-0 [ 146.372071] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067 offline-stand-stor-2: peer FC74204D9CCD55FA:0000000000000000:1F6D80506B0B805E:7567FD4D298DC8F8 bits:0 flags:1120 Mar 17 01:54:41 offine-stand-stor-0 [ 146.374060] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067 offline-stand-stor-2: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:41 offine-stand-stor-0 [ 146.376398] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-1: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:41 offine-stand-stor-0 [ 146.378512] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-1: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:41 offine-stand-stor-0 [ 146.383055] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4/0 drbd1051 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:41 offine-stand-stor-0 [ 146.383954] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4/0 drbd1051 offline-stand-stor-1: peer 8953F91542E51E86:36D283CC16DBEBA0:36D283CC16DBEBA0:0000000000000000 bits:0 flags:1120 Mar 17 01:54:41 offine-stand-stor-0 [ 146.384427] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-4: Handshake to peer 1 successful: Agreed network protocol version 122 Mar 17 01:54:41 offine-stand-stor-0 [ 146.385909] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4/0 drbd1051: Setting exposed data uuid: 8953F91542E51E86 Mar 17 01:54:41 offine-stand-stor-0 [ 146.389172] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-4: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:41 offine-stand-stor-0 [ 146.390034] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-1: Peer authenticated using 20 bytes HMAC Mar 17 01:54:41 offine-stand-stor-0 [ 146.391560] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-2: Committing remote state change 477908998 (primary_nodes=0) Mar 17 01:54:41 offine-stand-stor-0 [ 146.394773] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563: susp-io( quorum -> no ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.395812] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.397723] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067: quorum( no -> yes ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.398678] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067 offline-stand-stor-2: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.399702] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-1: Preparing remote state change 2971933323 Mar 17 01:54:41 offine-stand-stor-0 [ 146.400894] drbd pvc-fc9e4207-38ba-44f5-b584-48be27510563/0 drbd1067 offline-stand-stor-2: cleared bm UUID and bitmap FC74204D9CCD55FA:0000000000000000:CB37AACE7BDB7AD6:0000000000000000 Mar 17 01:54:41 offine-stand-stor-0 [ 146.402628] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-1: Committing remote state change 2145844301 (primary_nodes=0) Mar 17 01:54:41 offine-stand-stor-0 [ 146.405512] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-4: Peer authenticated using 20 bytes HMAC Mar 17 01:54:41 offine-stand-stor-0 [ 146.405652] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4: susp-io( quorum -> no ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.407296] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.408950] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4/0 drbd1051: quorum( no -> yes ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.409775] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4/0 drbd1051 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.411489] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-4: Preparing remote state change 3624860 Mar 17 01:54:41 offine-stand-stor-0 [ 146.452543] drbd1097: detected capacity change from 0 to 10491632 Mar 17 01:54:41 offine-stand-stor-0 [ 146.452570] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4/0 drbd1051 offline-stand-stor-4: my exposed UUID: 8953F91542E51E86 Mar 17 01:54:41 offine-stand-stor-0 [ 146.453413] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e/0 drbd1097: size = 5123 MB (5245816 KB) Mar 17 01:54:41 offine-stand-stor-0 [ 146.454293] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4/0 drbd1051 offline-stand-stor-4: peer 8953F91542E51E86:36D283CC16DBEBA0:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:41 offine-stand-stor-0 [ 146.455133] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e/0 drbd1097 offline-stand-stor-1: my exposed UUID: 0000000000000000 Mar 17 01:54:41 offine-stand-stor-0 [ 146.457850] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e/0 drbd1097 offline-stand-stor-1: peer 3AC1B4AA40E23BEC:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:1120 Mar 17 01:54:41 offine-stand-stor-0 [ 146.459596] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e/0 drbd1097: Setting exposed data uuid: 3AC1B4AA40E23BEC Mar 17 01:54:41 offine-stand-stor-0 [ 146.460599] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-4: Committing remote state change 3624860 (primary_nodes=0) Mar 17 01:54:41 offine-stand-stor-0 [ 146.463051] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4 offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.465133] drbd pvc-fd32d54e-317a-44ce-b11c-f5eaa00e3eb4/0 drbd1051 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.494077] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-1: Committing remote state change 2971933323 (primary_nodes=0) Mar 17 01:54:41 offine-stand-stor-0 [ 146.495742] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e: susp-io( quorum -> no ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.496562] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-1: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.498198] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e/0 drbd1097: quorum( no -> yes ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.499019] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e/0 drbd1097 offline-stand-stor-1: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.500651] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-4: Preparing remote state change 609699492 Mar 17 01:54:41 offine-stand-stor-0 [ 146.544621] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e/0 drbd1097 offline-stand-stor-4: my exposed UUID: 3AC1B4AA40E23BEC Mar 17 01:54:41 offine-stand-stor-0 [ 146.545490] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e/0 drbd1097 offline-stand-stor-4: peer 3AC1B4AA40E23BEC:0000000000000000:2E5CEB97BAA381E4:0000000000000000 bits:0 flags:1120 Mar 17 01:54:41 offine-stand-stor-0 [ 146.567530] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-4: Committing remote state change 609699492 (primary_nodes=0) Mar 17 01:54:41 offine-stand-stor-0 [ 146.569149] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e offline-stand-stor-4: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.570725] drbd pvc-fe228b52-5405-46dc-ae9c-74d1d4647f7e/0 drbd1097 offline-stand-stor-4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:41 offine-stand-stor-0 [ 146.644589] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-2: Handshake to peer 2 successful: Agreed network protocol version 122 Mar 17 01:54:41 offine-stand-stor-0 [ 146.645530] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: Handshake to peer 0 successful: Agreed network protocol version 122 Mar 17 01:54:41 offine-stand-stor-0 [ 146.646365] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-2: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:41 offine-stand-stor-0 [ 146.648016] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: Feature flags enabled on protocol level: 0x7f TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES RESYNC_DAGTAG Mar 17 01:54:41 offine-stand-stor-0 [ 146.652457] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: Peer authenticated using 20 bytes HMAC Mar 17 01:54:41 offine-stand-stor-0 [ 146.654144] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-2: Peer authenticated using 20 bytes HMAC Mar 17 01:54:41 offine-stand-stor-0 [ 146.660552] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210: Preparing cluster-wide state change 3726442281 (1->2 499/146) Mar 17 01:54:41 offine-stand-stor-0 [ 146.691227] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: Aborting local state change 3726442281 to yield to remote state change 1672426976. Mar 17 01:54:41 offine-stand-stor-0 [ 146.724631] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074 offline-stand-stor-2: self 8C7D3BA643B31A60:0000000000000000:E1867CD7019A74EE:0000000000000000 bits:0 flags:0 Mar 17 01:54:41 offine-stand-stor-0 [ 146.733089] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074 offline-stand-stor-2: peer's exposed UUID: 8C7D3BA643B31A60 Mar 17 01:54:41 offine-stand-stor-0 [ 146.741070] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210: Aborting cluster-wide state change 3726442281 (80ms) rv = -19 Mar 17 01:54:41 offine-stand-stor-0 [ 146.745169] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: Preparing remote state change 1672426976 Mar 17 01:54:41 offine-stand-stor-0 [ 146.776661] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:41 offine-stand-stor-0 [ 146.778629] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074 offline-stand-stor-3: self 8C7D3BA643B31A60:0000000000000000:E1867CD7019A74EE:0000000000000000 bits:0 flags:20 Mar 17 01:54:41 offine-stand-stor-0 [ 146.782461] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074 offline-stand-stor-3: peer 8C7D3BA643B31A60:0000000000000000:B7CC18ED3657E62E:ACFA791B8B51EE4E bits:0 flags:1120 Mar 17 01:54:41 offine-stand-stor-0 [ 146.786309] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:41 offine-stand-stor-0 [ 146.807105] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: Aborting remote state change 1672426976 Mar 17 01:54:41 offine-stand-stor-0 [ 146.808401] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210: Preparing cluster-wide state change 959056589 (1->2 499/146) Mar 17 01:54:41 offine-stand-stor-0 [ 146.840674] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074 offline-stand-stor-2: self 8C7D3BA643B31A60:0000000000000000:E1867CD7019A74EE:0000000000000000 bits:0 flags:0 Mar 17 01:54:41 offine-stand-stor-0 [ 146.848407] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074 offline-stand-stor-2: peer's exposed UUID: 8C7D3BA643B31A60 Mar 17 01:54:41 offine-stand-stor-0 [ 146.854457] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210: State change 959056589: primary_nodes=0, weak_nodes=0 Mar 17 01:54:41 offine-stand-stor-0 [ 146.856944] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210: Committing cluster-wide state change 959056589 (52ms) Mar 17 01:54:41 offine-stand-stor-0 [ 146.858854] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-2: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [connected] Mar 17 01:54:41 offine-stand-stor-0 [ 146.862574] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074 offline-stand-stor-2: pdsk( DUnknown -> Diskless ) repl( Off -> Established ) [connected] Mar 17 01:54:42 offine-stand-stor-0 [ 146.892466] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: Preparing remote state change 3684175174 Mar 17 01:54:42 offine-stand-stor-0 [ 146.920624] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074 offline-stand-stor-3: drbd_sync_handshake: Mar 17 01:54:42 offine-stand-stor-0 [ 146.921551] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074 offline-stand-stor-3: self 8C7D3BA643B31A60:0000000000000000:E1867CD7019A74EE:0000000000000000 bits:0 flags:20 Mar 17 01:54:42 offine-stand-stor-0 [ 146.923180] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074 offline-stand-stor-3: peer 8C7D3BA643B31A60:0000000000000000:B7CC18ED3657E62E:ACFA791B8B51EE4E bits:0 flags:1120 Mar 17 01:54:42 offine-stand-stor-0 [ 146.924837] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074 offline-stand-stor-3: uuid_compare()=no-sync by rule=lost-quorum Mar 17 01:54:42 offine-stand-stor-0 [ 146.971805] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: Committing remote state change 3684175174 (primary_nodes=0) Mar 17 01:54:42 offine-stand-stor-0 [ 146.973551] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210: susp-io( quorum -> no ) [remote] Mar 17 01:54:42 offine-stand-stor-0 [ 146.974384] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210 offline-stand-stor-3: conn( Connecting -> Connected ) peer( Unknown -> Secondary ) [remote] Mar 17 01:54:42 offine-stand-stor-0 [ 146.975973] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074: quorum( no -> yes ) [remote] Mar 17 01:54:42 offine-stand-stor-0 [ 146.976812] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074 offline-stand-stor-3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established ) [remote] Mar 17 01:54:42 offine-stand-stor-0 [ 146.978709] drbd pvc-fed6acd5-fe8d-43b7-8ea6-7cdc9d46f210/0 drbd1074 offline-stand-stor-3: cleared bm UUID and bitmap 8C7D3BA643B31A60:0000000000000000:E1867CD7019A74EE:0000000000000000 Mar 17 01:54:49 offine-stand-stor-0 [ 154.447172] WARNING: chroot access! Mar 17 01:54:49 offine-stand-stor-0 [ 154.548470] WARNING: chroot access! Mar 17 01:55:02 offine-stand-stor-0 [ 154.675861] WARNING: chroot access! Mar 17 01:55:02 offine-stand-stor-0 [ 167.777161] eth0: renamed from tmpda276 Mar 17 01:55:02 offine-stand-stor-0 [ 167.809382] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:55:02 offine-stand-stor-0 [ 167.810453] IPv6: ADDRCONF(NETDEV_CHANGE): lxcabf920e0bbe7: link becomes ready Mar 17 01:55:03 offine-stand-stor-0 [ 168.175671] WARNING: chroot access! Mar 17 01:56:02 offine-stand-stor-0 [ 168.262902] WARNING: chroot access! Mar 17 01:56:02 offine-stand-stor-0 [ 227.872326] eth0: renamed from tmpfdaf6 Mar 17 01:56:03 offine-stand-stor-0 [ 227.896807] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:56:03 offine-stand-stor-0 [ 227.897772] IPv6: ADDRCONF(NETDEV_CHANGE): lxc843e4cff37d9: link becomes ready Mar 17 01:56:03 offine-stand-stor-0 [ 228.285382] WARNING: chroot access! Mar 17 01:57:03 offine-stand-stor-0 [ 228.362623] WARNING: chroot access! Mar 17 01:57:03 offine-stand-stor-0 [ 288.064411] eth0: renamed from tmpc5909 Mar 17 01:57:03 offine-stand-stor-0 [ 288.088362] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:57:03 offine-stand-stor-0 [ 288.089203] IPv6: ADDRCONF(NETDEV_CHANGE): lxcc0e64b939b98: link becomes ready Mar 17 01:57:03 offine-stand-stor-0 [ 288.516994] WARNING: chroot access! Mar 17 01:58:03 offine-stand-stor-0 [ 288.632528] WARNING: chroot access! Mar 17 01:58:03 offine-stand-stor-0 [ 348.052592] eth0: renamed from tmp5292c Mar 17 01:58:03 offine-stand-stor-0 [ 348.072717] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:58:03 offine-stand-stor-0 [ 348.073744] IPv6: ADDRCONF(NETDEV_CHANGE): lxc81b040d79ca8: link becomes ready Mar 17 01:58:03 offine-stand-stor-0 [ 348.478830] WARNING: chroot access! Mar 17 01:59:03 offine-stand-stor-0 [ 348.561987] WARNING: chroot access! Mar 17 01:59:03 offine-stand-stor-0 [ 408.104363] eth0: renamed from tmp30b50 Mar 17 01:59:03 offine-stand-stor-0 [ 408.148406] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 17 01:59:03 offine-stand-stor-0 [ 408.149156] IPv6: ADDRCONF(NETDEV_CHANGE): lxc5306a95747d9: link becomes ready Mar 17 01:59:03 offine-stand-stor-0 [ 408.506666] WARNING: chroot access! Mar 17 01:59:52 offine-stand-stor-0 [ 408.598410] WARNING: chroot access! Mar 17 01:59:52 offine-stand-stor-0 [ 457.332848] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: Preparing cluster-wide state change 3191932210 (1->-1 7680/1024) Mar 17 01:59:52 offine-stand-stor-0 [ 457.353559] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: State change 3191932210: primary_nodes=0, weak_nodes=0 Mar 17 01:59:52 offine-stand-stor-0 [ 457.354371] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: Committing cluster-wide state change 3191932210 (20ms) Mar 17 01:59:52 offine-stand-stor-0 [ 457.355798] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: disk( UpToDate -> Detaching ) [detach] Mar 17 01:59:52 offine-stand-stor-0 [ 457.357252] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: disk( Detaching -> Diskless ) [go-diskless] Mar 17 01:59:52 offine-stand-stor-0 [ 457.359334] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: drbd_bm_resize called with capacity == 0 Mar 17 01:59:52 offine-stand-stor-0 [ 457.372987] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Preparing remote state change 3220153768 Mar 17 01:59:52 offine-stand-stor-0 [ 457.374506] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: Would lose quorum, but using tiebreaker logic to keep Mar 17 01:59:52 offine-stand-stor-0 [ 457.378331] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Committing remote state change 3220153768 (primary_nodes=0) Mar 17 01:59:52 offine-stand-stor-0 [ 457.380556] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121 offline-stand-stor-4: pdsk( UpToDate -> Detaching ) [remote] Mar 17 01:59:52 offine-stand-stor-0 [ 457.394301] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121 offline-stand-stor-4: pdsk( Detaching -> Diskless ) [peer-state] Mar 17 01:59:52 offine-stand-stor-0 [ 457.758535] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:59:52 offine-stand-stor-0 [ 457.759570] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: State change failed: State change was refused by peer node (-10) Mar 17 01:59:52 offine-stand-stor-0 [ 457.760391] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: Failed: susp-io( no -> quorum ) [del-minor] Mar 17 01:59:52 offine-stand-stor-0 [ 457.761215] drbd /unregistered/pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: Failed: quorum( yes -> no ) [del-minor] Mar 17 01:59:52 offine-stand-stor-0 [ 457.762074] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121 offline-stand-stor-4: Failed: pdsk( Diskless -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:59:52 offine-stand-stor-0 [ 457.769179] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:59:52 offine-stand-stor-0 [ 457.807552] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: State change failed: State change was refused by peer node (-10) Mar 17 01:59:52 offine-stand-stor-0 [ 457.827825] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: Failed: susp-io( no -> quorum ) [del-minor] Mar 17 01:59:52 offine-stand-stor-0 [ 457.846438] drbd /unregistered/pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121: Failed: quorum( yes -> no ) [del-minor] Mar 17 01:59:53 offine-stand-stor-0 [ 457.861965] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694/0 drbd1121 offline-stand-stor-1: Failed: pdsk( Diskless -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:59:53 offine-stand-stor-0 [ 458.865770] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) [del-peer] Mar 17 01:59:53 offine-stand-stor-0 [ 458.867128] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Terminating sender thread Mar 17 01:59:53 offine-stand-stor-0 [ 458.868300] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Starting sender thread (from drbd_r_pvc-35ed [9959]) Mar 17 01:59:54 offine-stand-stor-0 [ 458.916219] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Connection closed Mar 17 01:59:54 offine-stand-stor-0 [ 458.916958] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:59:54 offine-stand-stor-0 [ 458.918286] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Terminating receiver thread Mar 17 01:59:54 offine-stand-stor-0 [ 458.935790] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Terminating sender thread Mar 17 01:59:54 offine-stand-stor-0 [ 458.967977] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: Preparing cluster-wide state change 4044114539 (1->-1 0/0) Mar 17 01:59:54 offine-stand-stor-0 [ 458.985464] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: State change 4044114539: primary_nodes=0, weak_nodes=0 Mar 17 01:59:54 offine-stand-stor-0 [ 458.986183] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694: Committing cluster-wide state change 4044114539 (16ms) Mar 17 01:59:54 offine-stand-stor-0 [ 459.013721] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Starting sender thread (from drbdsetup [18671]) Mar 17 01:59:54 offine-stand-stor-0 [ 459.018909] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: conn( StandAlone -> Unconnected ) [connect] Mar 17 01:59:54 offine-stand-stor-0 [ 459.020144] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Starting receiver thread (from drbd_w_pvc-35ed [9936]) Mar 17 01:59:54 offine-stand-stor-0 [ 459.022981] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: conn( Unconnected -> Connecting ) [connecting] Mar 17 01:59:54 offine-stand-stor-0 [ 459.083217] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Preparing remote state change 3318615476 Mar 17 01:59:54 offine-stand-stor-0 [ 459.097231] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: conn( Connecting -> Disconnecting ) [del-peer] Mar 17 01:59:54 offine-stand-stor-0 [ 459.100762] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Terminating sender thread Mar 17 01:59:54 offine-stand-stor-0 [ 459.101605] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Starting sender thread (from drbd_r_pvc-35ed [18675]) Mar 17 01:59:54 offine-stand-stor-0 [ 459.118268] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Committing remote state change 3318615476 (primary_nodes=0) Mar 17 01:59:54 offine-stand-stor-0 [ 459.148214] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Connection closed Mar 17 01:59:54 offine-stand-stor-0 [ 459.149035] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:59:54 offine-stand-stor-0 [ 459.150605] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Terminating receiver thread Mar 17 01:59:54 offine-stand-stor-0 [ 459.151599] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-1: Terminating sender thread Mar 17 01:59:54 offine-stand-stor-0 [ 459.402174] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown ) [down] Mar 17 01:59:54 offine-stand-stor-0 [ 459.403747] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Terminating sender thread Mar 17 01:59:54 offine-stand-stor-0 [ 459.405013] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Starting sender thread (from drbd_r_pvc-35ed [9961]) Mar 17 01:59:54 offine-stand-stor-0 [ 459.452059] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Connection closed Mar 17 01:59:54 offine-stand-stor-0 [ 459.453401] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: conn( Disconnecting -> StandAlone ) [disconnected] Mar 17 01:59:54 offine-stand-stor-0 [ 459.456057] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Terminating receiver thread Mar 17 01:59:54 offine-stand-stor-0 [ 459.457521] drbd pvc-35edb712-ff5d-43af-aded-cae8a75fd694 offline-stand-stor-4: Terminating sender thread Mar 17 01:59:54 offine-stand-stor-0 [ 459.520080] drbd /unregistered/pvc-35edb712-ff5d-43af-aded-cae8a75fd694: Terminating worker thread Mar 17 01:59:55 offine-stand-stor-0 [ 460.678989] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-2: Preparing remote state change 3569889254 Mar 17 01:59:55 offine-stand-stor-0 [ 460.699329] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-2: Committing remote state change 3569889254 (primary_nodes=0) Mar 17 01:59:55 offine-stand-stor-0 [ 460.702481] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054 offline-stand-stor-2: pdsk( UpToDate -> Detaching ) [remote] Mar 17 01:59:55 offine-stand-stor-0 [ 460.719818] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: Preparing cluster-wide state change 411107339 (0->-1 7680/1024) Mar 17 01:59:55 offine-stand-stor-0 [ 460.721900] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054 offline-stand-stor-2: pdsk( Detaching -> Diskless ) [peer-state] Mar 17 01:59:55 offine-stand-stor-0 [ 460.735629] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: State change 411107339: primary_nodes=0, weak_nodes=0 Mar 17 01:59:55 offine-stand-stor-0 [ 460.736683] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: Committing cluster-wide state change 411107339 (20ms) Mar 17 01:59:55 offine-stand-stor-0 [ 460.737923] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: disk( UpToDate -> Detaching ) [detach] Mar 17 01:59:55 offine-stand-stor-0 [ 460.740155] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: Would lose quorum, but using tiebreaker logic to keep Mar 17 01:59:55 offine-stand-stor-0 [ 460.740886] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: disk( Detaching -> Diskless ) [go-diskless] Mar 17 01:59:55 offine-stand-stor-0 [ 460.758615] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: drbd_bm_resize called with capacity == 0 Mar 17 01:59:56 offine-stand-stor-0 [ 461.096657] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:59:56 offine-stand-stor-0 [ 461.098095] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: State change failed: State change was refused by peer node (-10) Mar 17 01:59:56 offine-stand-stor-0 [ 461.098830] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: Failed: susp-io( no -> quorum ) [del-minor] Mar 17 01:59:56 offine-stand-stor-0 [ 461.099539] drbd /unregistered/pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: Failed: quorum( yes -> no ) [del-minor] Mar 17 01:59:56 offine-stand-stor-0 [ 461.100281] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054 offline-stand-stor-2: Failed: pdsk( Diskless -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:59:56 offine-stand-stor-0 [ 461.102205] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: ASSERTION context->flags & CS_SERIALIZE FAILED in change_cluster_wide_state Mar 17 01:59:56 offine-stand-stor-0 [ 461.104149] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: State change failed: State change was refused by peer node (-10) Mar 17 01:59:56 offine-stand-stor-0 [ 461.105104] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: Failed: susp-io( no -> quorum ) [del-minor] Mar 17 01:59:56 offine-stand-stor-0 [ 461.106169] drbd /unregistered/pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054: Failed: quorum( yes -> no ) [del-minor] Mar 17 01:59:56 offine-stand-stor-0 [ 461.107126] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a/0 drbd1054 offline-stand-stor-1: Failed: pdsk( Diskless -> DUnknown ) repl( Established -> Off ) [del-minor] Mar 17 01:59:57 offine-stand-stor-0 [ 462.212691] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: sock was shut down by peer Mar 17 01:59:57 offine-stand-stor-0 [ 462.212741] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: meta connection shut down by peer. Mar 17 01:59:57 offine-stand-stor-0 [ 462.213491] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: conn( Connected -> BrokenPipe ) peer( Secondary -> Unknown ) Mar 17 01:59:57 offine-stand-stor-0 [ 462.215789] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: Preparing cluster-wide state change 605233927 (0->-1 0/0) Mar 17 01:59:57 offine-stand-stor-0 [ 462.233366] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: Terminating sender thread Mar 17 01:59:57 offine-stand-stor-0 [ 462.234120] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a offline-stand-stor-1: Starting sender thread (from drbd_r_pvc-fc9d [12946]) Mar 17 01:59:57 offine-stand-stor-0 [ 462.235535] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: State change 605233927: primary_nodes=0, weak_nodes=0 Mar 17 01:59:57 offine-stand-stor-0 [ 462.236317] drbd pvc-fc9def6f-a8c8-442f-beb1-f5a61262fc7a: Committing cluster-wide state change 605233927 (24ms) Mar 17 01:59:57 offine-stand-stor-0 [ 462.263975] BUG: kernel NULL pointer dereference, address: 000000000000038c Mar 17 01:59:57 offine-stand-stor-0 [ 462.264705] #PF: supervisor write access in kernel mode Mar 17 01:59:57 offine-stand-stor-0 [ 462.265422] #PF: error_code(0x0002) - not-present page Mar 17 01:59:57 offine-stand-stor-0 [ 462.266124] PGD 0 P4D 0 Mar 17 01:59:57 offine-stand-stor-0 [ 462.266813] Oops: 0002 [#1] SMP PTI Mar 17 01:59:57 offine-stand-stor-0 [ 462.267525] CPU: 1 PID: 12946 Comm: drbd_r_pvc-fc9d Kdump: loaded Tainted: G OE 5.15.0-83-generic #astra1+ci14 Mar 17 01:59:57 offine-stand-stor-0 [ 462.268226] Hardware name: Supermicro SYS-5039MS-H8TRF/X11SSD-F, BIOS 2.3 12/20/2019 Mar 17 01:59:57 offine-stand-stor-0 [ 462.268918] RIP: 0010:_raw_spin_lock_irq+0x17/0x40 Mar 17 01:59:57 offine-stand-stor-0 [ 462.269616] Code: cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 fa 66 0f 1f 44 00 00 31 c0 ba 01 00 00 00 0f b1 17 75 06 5d c3 cc cc cc cc 89 c6 e8 d6 c5 42 ff 66 90 5d Mar 17 01:59:57 offine-stand-stor-0 [ 462.271066] RSP: 0018:ffffb93ebe2b7c48 EFLAGS: 00010046 Mar 17 01:59:57 offine-stand-stor-0 [ 462.271840] RAX: 0000000000000000 RBX: ffff9ec8c6fc3e40 RCX: 0000000000000000 Mar 17 01:59:57 offine-stand-stor-0 [ 462.272555] RDX: 0000000000000001 RSI: ffffb93ebe2b7ca0 RDI: 000000000000038c Mar 17 01:59:57 offine-stand-stor-0 [ 462.273248] RBP: ffffb93ebe2b7c48 R08: ffff9eca8f6fd3e0 R09: ffff9eca8f6fd3e0 Mar 17 01:59:57 offine-stand-stor-0 [ 462.273944] R10: ffff9eca8f6fd3e0 R11: ffff9eca8f6fd3e0 R12: 0000000000000001 Mar 17 01:59:57 offine-stand-stor-0 [ 462.274600] R13: ffff9ec9e441b800 R14: 000000000000038c R15: ffff9eca8f6fd000 Mar 17 01:59:57 offine-stand-stor-0 [ 462.275252] FS: 0000000000000000(0000) GS:ffff9ed017a40000(0000) knlGS:0000000000000000 Mar 17 01:59:57 offine-stand-stor-0 [ 462.275900] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Mar 17 01:59:57 offine-stand-stor-0 [ 462.276568] CR2: 000000000000038c CR3: 0000000312c10006 CR4: 00000000003706e0 Mar 17 01:59:57 offine-stand-stor-0 [ 462.277207] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Mar 17 01:59:57 offine-stand-stor-0 [ 462.277862] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Mar 17 01:59:57 offine-stand-stor-0 [ 462.278534] Call Trace: Mar 17 01:59:57 offine-stand-stor-0 [ 462.279259] Mar 17 01:59:57 offine-stand-stor-0 [ 462.279938] ? show_regs.cold.16+0x1a/0x1f Mar 17 01:59:57 offine-stand-stor-0 [ 462.280548] ? __die_body+0x1f/0x70 Mar 17 01:59:57 offine-stand-stor-0 [ 462.281175] ? __die+0x2a/0x35 Mar 17 01:59:57 offine-stand-stor-0 [ 462.281752] ? page_fault_oops+0x136/0x2b0 Mar 17 01:59:57 offine-stand-stor-0 [ 462.282375] ? do_user_addr_fault+0x33e/0x660 Mar 17 01:59:57 offine-stand-stor-0 [ 462.282953] ? finish_task_switch+0x81/0x2a0 Mar 17 01:59:57 offine-stand-stor-0 [ 462.283551] ? exc_page_fault+0x7e/0x170 Mar 17 01:59:57 offine-stand-stor-0 [ 462.284180] ? asm_exc_page_fault+0x27/0x30 Mar 17 01:59:57 offine-stand-stor-0 [ 462.284738] ? _raw_spin_lock_irq+0x17/0x40 Mar 17 01:59:57 offine-stand-stor-0 [ 462.285355] drbd_free_peer_req+0xa9/0x240 [drbd] Mar 17 01:59:57 offine-stand-stor-0 [ 462.285905] drbd_finish_peer_reqs+0xc2/0x180 [drbd] Mar 17 01:59:57 offine-stand-stor-0 [ 462.286463] drain_resync_activity+0x579/0xdc0 [drbd] Mar 17 01:59:57 offine-stand-stor-0 [ 462.287001] ? wake_up_q+0x4e/0x90 Mar 17 01:59:57 offine-stand-stor-0 [ 462.287483] ? __mutex_unlock_slowpath.isra.24+0x9c/0x110 Mar 17 01:59:57 offine-stand-stor-0 [ 462.288077] ? mutex_unlock+0x26/0x30 Mar 17 01:59:57 offine-stand-stor-0 [ 462.288539] conn_disconnect+0x1b3/0xa40 [drbd] Mar 17 01:59:57 offine-stand-stor-0 [ 462.289045] drbd_receiver+0x5ef/0x990 [drbd] Mar 17 01:59:57 offine-stand-stor-0 [ 462.289515] ? drbd_unplug_all_devices+0x50/0x50 [drbd] Mar 17 01:59:57 offine-stand-stor-0 [ 462.290042] drbd_thread_setup+0x85/0x1e0 [drbd] Mar 17 01:59:57 offine-stand-stor-0 [ 462.290486] ? inc_open_count+0xb0/0xb0 [drbd] Mar 17 01:59:57 offine-stand-stor-0 [ 462.290925] kthread+0x12d/0x150 Mar 17 01:59:57 offine-stand-stor-0 [ 462.291348] ? set_kthread_struct+0x50/0x50 Mar 17 01:59:57 offine-stand-stor-0 [ 462.291761] ret_from_fork+0x1f/0x30 Mar 17 01:59:57 offine-stand-stor-0 [ 462.292192] Mar 17 01:59:57 offine-stand-stor-0 [ 462.292583] Modules linked in: drbd_transport_tcp(OE) udp_diag(E) ip_set(E) xt_CT(E) cls_bpf(E) sch_ingress(E) vxlan(E) ip6_udp_tunnel(E) udp_tunnel(E) sch_fq(E) bcache(E) crc64(E) xfrm_user(E) dm_cache(E) xfrm_algo(E) dm_writecache(E) veth(E) nf_tables(E) nfnetlink(E) xt_socket(E) nf_socket_ipv4(E) nf_socket_ipv6(E) ip6table_raw(E) iptable_raw(E) nvme_rdma(E) nvme_fabrics(E) nvmet_rdma(E) nvmet(E) nvme_core(E) rdma_cm(E) iw_cm(E) ib_cm(E) ib_core(E) ip6table_filter(E) ip6table_nat(E) ip6table_mangle(E) ip6_tables(E) xt_MASQUERADE(E) xt_mark(E) iptable_nat(E) nf_nat(E) xt_conntrack(E) nf_conntrack(E) nf_defrag_ipv6(E) nf_defrag_ipv4(E) xt_comment(E) iptable_filter(E) iptable_mangle(E) bpfilter(E) dm_thin_pool(E) dm_persistent_data(E) dm_bio_prison(E) dm_bufio(E) tcp_diag(E) inet_diag(E) aufs(E) overlay(E) intel_rapl_msr(E) intel_rapl_common(E) intel_tcc_cooling(E) x86_pkg_temp_thermal(E) intel_powerclamp(E) coretemp(E) kvm_intel(E) kvm(E) crct10dif_pclmul(E) crc32_pclmul(E) Mar 17 01:59:57 offine-stand-stor-0 [ 462.292625] ghash_clmulni_intel(E) aesni_intel(E) crypto_simd(E) cryptd(E) rapl(E) intel_cstate(E) ipmi_ssif(E) ast(E) drm_vram_helper(E) drm_ttm_helper(E) ttm(E) drm_kms_helper(E) cec(E) rc_core(E) drm(E) fb_sys_fops(E) syscopyarea(E) sysfillrect(E) input_leds(E) joydev(E) sysimgblt(E) ee1004(E) mei_me(E) acpi_ipmi(E) intel_pch_thermal(E) mei(E) ipmi_si(E) ie31200_edac(E) ipmi_devintf(E) ipmi_msghandler(E) acpi_power_meter(E) acpi_pad(E) mac_hid(E) netconsole(E) handshake(OE) drbd(OE) lru_cache(E) libcrc32c(E) br_netfilter(E) bridge(E) stp(E) llc(E) parport_pc(E) ppdev(E) lp(E) parport(E) sunrpc(E) ip_tables(E) x_tables(E) autofs4(E) hid_generic(E) usbhid(E) hid(E) i2c_i801(E) i2c_smbus(E) igb(E) intel_ish_ipc(E) xhci_pci(E) i2c_algo_bit(E) xhci_pci_renesas(E) intel_ishtp(E) dca(E) video(E) parsec(OE) digsig_verif(OE) Mar 17 01:59:57 offine-stand-stor-0 [ 462.299942] CR2: 000000000000038c