[Drbd-dev] [CASE-22] VM hung during complicated testing on 4 nodes

김재헌 jhkim at mantech.co.kr
Thu Feb 18 06:39:13 CET 2016


Hi,

VM hung during complicated testing on 4 nodes.

1. version
 - drbd-9.0.1-1
 - drbd-utils-8.9.6
 - CentOS 7

2. Test procedures
 - On 4 nodes
 - runs up/down,disconnect/connect randomly several times and sometimes
md-create
 - node2 vm hung suddenly. Vm freezed.

3. Logs

1) Node1

Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 575587423 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 575587423 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3005066576 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3005066576 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2982970747 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2982970747 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1635237549 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1635237549 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3629941899 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3629941899 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3986545484 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3986545484 (0ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3563238485 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3563238485 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2815311641 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2815311641 (0ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3238325029 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3238325029 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2126091279 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2126091279 (0ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3638753626 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3638753626 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3599232118 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3599232118 (0ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 113146377 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 113146377 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 776632002 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 776632002 (0ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3173991607 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3173991607 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1425635733 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1425635733 (0ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3766324938 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3766324938 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3678332951 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3678332951 (0ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1350394170 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1350394170 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3453543298 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3453543298 (0ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2874348269 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2874348269 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1961866418 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1961866418 (0ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1422080841 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1422080841 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1106447724 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1106447724 (0ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1935970639 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1935970639 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1369156260 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1369156260 (0ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 36989052 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 36989052 (0ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 582050229 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 582050229 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 4192500224 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 4192500224 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2039128137 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2039128137 (1ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 821093755 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 821093755 (0ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3518597027 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3518597027 (0ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 452858682 (0->2 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 452858682 (0ms) rv = -19
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2321677588 (0->1 499/146)
Feb 18 12:49:16 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2321677588 (0ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3637280121 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3637280121 (0ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 261689227 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 261689227 (0ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1843385190 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1843385190 (0ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3197178194 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3197178194 (0ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 767463344 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 767463344 (0ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3875723021 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3875723021 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3351946337 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3351946337 (0ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3454915512 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3454915512 (0ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2640937765 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2640937765 (0ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3044822599 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3044822599 (0ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3354987837 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3354987837 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3556374775 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3556374775 (4ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2026795642 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2026795642 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1409529751 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1409529751 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3085364587 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3085364587 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1803219856 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1803219856 (0ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2423822761 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2423822761 (0ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2070740492 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2070740492 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 424571609 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 424571609 (0ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1861094959 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1861094959 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1439155988 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1439155988 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1912776257 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1912776257 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3342040311 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3342040311 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3583634975 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3583634975 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3560986460 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3560986460 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1059596388 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1059596388 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2039774846 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2039774846 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2984515839 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2984515839 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2729731529 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2729731529 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3776435962 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3776435962 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1499748024 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1499748024 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2633932659 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2633932659 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3420883318 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3420883318 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3805539839 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3805539839 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2892821134 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2892821134 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3642844571 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3642844571 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 110768160 (0->2 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 110768160 (1ms) rv = -19
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 17859418 (0->1 499/146)
Feb 18 12:49:17 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 17859418 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1919413000 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1919413000 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1145386916 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1145386916 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2321101024 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2321101024 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3288824952 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3288824952 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2274965928 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2274965928 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3641522607 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3641522607 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3926057794 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3926057794 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 128435041 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 128435041 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 620951758 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 620951758 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1067274131 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1067274131 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3401606816 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3401606816 (2ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2464745589 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2464745589 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3575638272 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3575638272 (2ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 289378464 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 289378464 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1793285500 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1793285500 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2159434546 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2159434546 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3776803522 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3776803522 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2020636307 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2020636307 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2574235971 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2574235971 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1115473996 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1115473996 (13ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1681934234 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1681934234 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2926904129 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2926904129 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1651456969 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1651456969 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1578249747 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1578249747 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 430284320 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 430284320 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 4168451443 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 4168451443 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3304566520 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3304566520 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2489323610 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2489323610 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2784036568 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2784036568 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2444898555 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2444898555 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2821131655 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2821131655 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 649862413 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 649862413 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1360241560 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1360241560 (1ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3610428486 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3610428486 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2654692450 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2654692450 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 237694475 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 237694475 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2561046587 (0->2 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2561046587 (0ms) rv = -19
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2123728468 (0->1 499/146)
Feb 18 12:49:18 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2123728468 (0ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1716193777 (0->2 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1716193777 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 954801834 (0->1 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 954801834 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 997680699 (0->2 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 997680699 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1595210697 (0->1 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1595210697 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1795247459 (0->2 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1795247459 (7ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1312694431 (0->1 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1312694431 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1531206635 (0->2 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1531206635 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1379557998 (0->1 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1379557998 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3792084596 (0->2 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3792084596 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1368060281 (0->1 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1368060281 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 3569716009 (0->2 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 3569716009 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1393085582 (0->1 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1393085582 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 4267014762 (0->2 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 4267014762 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1428881181 (0->1 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1428881181 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 1718804050 (0->2 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 1718804050 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 610769045 (0->1 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 610769045 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 795605995 (0->2 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 795605995 (2ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 2783224475 (0->1 499/146)
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Aborting cluster-wide state
change 2783224475 (1ms) rv = -19
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting ->
Disconnecting )
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-02: ack_receiver terminated
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-02: Terminating ack_recv
thread
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-02: conn( Disconnecting ->
StandAlone )
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-02: Terminating receiver
thread
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-02: Terminating sender thread
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting ->
Disconnecting )
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-03: ack_receiver terminated
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-03: Terminating ack_recv
thread
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-03: Connection closed
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-03: conn( Disconnecting ->
StandAlone )
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-03: Terminating receiver
thread
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-03: Terminating sender thread
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-04: conn( Connecting ->
Disconnecting )
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-04: Connection closed
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-04: conn( Disconnecting ->
StandAlone )
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-04: Terminating receiver
thread
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-04: Terminating sender thread
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-05: conn( Connecting ->
Disconnecting )
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-05: Connection closed
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-05: conn( Disconnecting ->
StandAlone )
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-05: Terminating receiver
thread
Feb 18 12:49:19 drbd9-01 kernel: drbd r0 drbd9-05: Terminating sender thread
Feb 18 12:49:19 drbd9-01 kernel: drbd r0/0 drbd1: disk( UpToDate ->
Detaching )
Feb 18 12:49:19 drbd9-01 kernel: drbd r0/0 drbd1: disk( Detaching ->
Diskless )
Feb 18 12:49:19 drbd9-01 kernel: drbd r0/0 drbd1: drbd_bm_resize called
with capacity == 0
Feb 18 12:49:19 drbd9-01 kernel: drbd r0: Terminating worker thread
Feb 18 12:49:29 drbd9-01 kernel: drbd r0: Starting worker thread (from
drbdsetup [32709])
Feb 18 12:49:29 drbd9-01 kernel: drbd r0/0 drbd1: disk( Diskless ->
Attaching )
Feb 18 12:49:29 drbd9-01 kernel: drbd r0/0 drbd1: Maximum number of peer
devices = 4
Feb 18 12:49:29 drbd9-01 kernel: drbd r0: Method to ensure write ordering:
flush
Feb 18 12:49:29 drbd9-01 kernel: drbd r0/0 drbd1: peer does not support
WRITE_SAME
Feb 18 12:49:29 drbd9-01 kernel: drbd r0/0 drbd1: Adjusting my ra_pages to
backing device's (32 -> 1024)
Feb 18 12:49:29 drbd9-01 kernel: drbd r0/0 drbd1: drbd_bm_resize called
with capacity == 9996656
Feb 18 12:49:29 drbd9-01 kernel: drbd r0/0 drbd1: resync bitmap:
bits=1249582 words=78100 pages=153
Feb 18 12:49:29 drbd9-01 kernel: drbd r0/0 drbd1: recounting of set bits
took additional 0ms
Feb 18 12:49:29 drbd9-01 kernel: drbd r0/0 drbd1: disk( Attaching ->
Inconsistent )
Feb 18 12:49:29 drbd9-01 kernel: drbd r0/0 drbd1: attached to current UUID:
0000000000000004
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-02: Starting sender thread
(from drbdsetup [32719])
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-03: Starting sender thread
(from drbdsetup [32723])
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-04: Starting sender thread
(from drbdsetup [32726])
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-05: Starting sender thread
(from drbdsetup [32729])
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-02: conn( StandAlone ->
Unconnected )
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-02: Starting receiver thread
(from drbd_w_r0 [32710])
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-03: conn( StandAlone ->
Unconnected )
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-03: Starting receiver thread
(from drbd_w_r0 [32710])
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected ->
Connecting )
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-04: conn( StandAlone ->
Unconnected )
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-04: Starting receiver thread
(from drbd_w_r0 [32710])
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-03: conn( Unconnected ->
Connecting )
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-05: conn( StandAlone ->
Unconnected )
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-05: Starting receiver thread
(from drbd_w_r0 [32710])
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-04: conn( Unconnected ->
Connecting )
Feb 18 12:49:29 drbd9-01 kernel: drbd r0 drbd9-05: conn( Unconnected ->
Connecting )
Feb 18 12:49:30 drbd9-01 kernel: drbd r0 drbd9-03: Handshake successful:
Agreed network protocol version 111
Feb 18 12:49:30 drbd9-01 kernel: drbd r0 drbd9-03: Feature flags enabled on
protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
Feb 18 12:49:30 drbd9-01 kernel: drbd r0 drbd9-03: Starting ack_recv thread
(from drbd_r_r0 [32736])
Feb 18 12:49:30 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 444800473 (0->2 499/146)
Feb 18 12:49:30 drbd9-01 kernel: drbd r0: State change 444800473:
primary_nodes=0, weak_nodes=0
Feb 18 12:49:30 drbd9-01 kernel: drbd r0: Committing cluster-wide state
change 444800473 (0ms)
Feb 18 12:49:30 drbd9-01 kernel: drbd r0 drbd9-03: conn( Connecting ->
Connected ) peer( Unknown -> Secondary )
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1: peer does not support
WRITE_SAME
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03:
drbd_sync_handshake:
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: self
0000000000000004:0000000000000000:0000000000000000:0000000000000000 bits:0
flags:0
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: peer
B6CAADFB7D215BC6:FFFFFFFFFFFFFFFF:B6CAADFB7D215BC6:0000000000000000 bits:0
flags:20
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03:
uuid_compare()=-3 by rule 20
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: Writing the
whole bitmap, full sync required after drbd_sync_handshake.
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( DUnknown
-> UpToDate ) repl( Off -> WFBitMapT )
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1: size = 4881 MB (4998328
KB)
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: receive bitmap
stats [Bytes(packets)]: plain 0(0), RLE 21(1), total 21; compression: 100.0%
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: send bitmap
stats [Bytes(packets)]: plain 0(0), RLE 21(1), total 21; compression: 100.0%
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: helper command:
/sbin/drbdadm before-resync-target
Feb 18 12:49:30 drbd9-01 drbdadm[32746]: Don't know which config file
belongs to resource r0, trying default ones...
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: helper command:
/sbin/drbdadm before-resync-target exit code 0 (0x0)
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-05: resync-susp( no
-> connection dependency )
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-04: resync-susp( no
-> connection dependency )
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: repl( WFBitMapT
-> SyncTarget )
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: resync-susp( no
-> connection dependency )
Feb 18 12:49:30 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: Began resync as
SyncTarget (will sync 4998328 KB [1249582 bits set]).
Feb 18 12:49:33 drbd9-01 kernel: drbd r0 tcp:drbd9-02: Receiver busy;
rejecting incoming connection
Feb 18 12:49:41 drbd9-01 kernel: drbd r0 drbd9-02: Handshake successful:
Agreed network protocol version 111
Feb 18 12:49:41 drbd9-01 kernel: drbd r0 drbd9-02: Feature flags enabled on
protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
Feb 18 12:49:41 drbd9-01 kernel: drbd r0 drbd9-02: Starting ack_recv thread
(from drbd_r_r0 [32734])
Feb 18 12:49:41 drbd9-01 kernel: drbd r0 drbd9-02: sock was shut down by
peer
Feb 18 12:49:41 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting ->
BrokenPipe )
Feb 18 12:49:41 drbd9-01 kernel: drbd r0 drbd9-02: ack_receiver terminated
Feb 18 12:49:41 drbd9-01 kernel: drbd r0 drbd9-02: Terminating ack_recv
thread
Feb 18 12:49:41 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
Feb 18 12:49:41 drbd9-01 kernel: drbd r0 drbd9-02: conn( BrokenPipe ->
Unconnected )
Feb 18 12:49:41 drbd9-01 kernel: drbd r0 drbd9-02: Restarting receiver
thread
Feb 18 12:49:41 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected ->
Connecting )
Feb 18 12:49:42 drbd9-01 kernel: drbd r0 tcp:drbd9-02: initial packet S
crossed
Feb 18 12:49:54 drbd9-01 kernel: drbd r0 tcp:drbd9-02: initial packet M
crossed
Feb 18 12:49:55 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state
change 2594601400 (primary_nodes=0, weak_nodes=0)
Feb 18 12:50:01 drbd9-01 systemd: Starting Session 295 of user root.
Feb 18 12:50:01 drbd9-01 systemd: Started Session 295 of user root.
Feb 18 12:50:25 drbd9-01 kernel: drbd r0 drbd9-03: Aborting remote state
change 2594601400
Feb 18 12:50:25 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state
change 1091225699 (primary_nodes=0, weak_nodes=0)
Feb 18 12:50:25 drbd9-01 kernel: drbd r0 drbd9-03: Committing remote state
change 1091225699
Feb 18 12:50:26 drbd9-01 kernel: drbd r0 drbd9-03: Preparing remote state
change 583992461 (primary_nodes=0, weak_nodes=0)
Feb 18 12:50:26 drbd9-01 kernel: drbd r0 drbd9-03: Committing remote state
change 583992461
Feb 18 12:51:11 drbd9-01 kernel: drbd r0 tcp:drbd9-02: initial packet S
crossed
Feb 18 12:51:23 drbd9-01 kernel: drbd r0 drbd9-02: Handshake successful:
Agreed network protocol version 111
Feb 18 12:51:23 drbd9-01 kernel: drbd r0 drbd9-02: Feature flags enabled on
protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
Feb 18 12:51:23 drbd9-01 kernel: drbd r0 drbd9-02: Starting ack_recv thread
(from drbd_r_r0 [32734])
Feb 18 12:51:23 drbd9-01 kernel: drbd r0: Preparing cluster-wide state
change 955356902 (0->1 499/146)
Feb 18 12:51:23 drbd9-01 kernel: drbd r0: State change 955356902:
primary_nodes=0, weak_nodes=0
Feb 18 12:51:23 drbd9-01 kernel: drbd r0: Committing cluster-wide state
change 955356902 (1ms)
Feb 18 12:51:23 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connecting ->
Connected ) peer( Unknown -> Secondary )
Feb 18 12:51:23 drbd9-01 kernel: drbd r0/0 drbd1: peer does not support
WRITE_SAME
Feb 18 12:51:23 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02:
drbd_sync_handshake:
Feb 18 12:51:23 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: self
0000000000000004:0000000000000000:0000000000000000:0000000000000000
bits:570368 flags:0
Feb 18 12:51:23 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: peer
0000000000000004:FFFFFFFFFFFFFFFF:0000000000000000:0000000000000000 bits:0
flags:24
Feb 18 12:51:23 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: uuid_compare()=0
by rule 10
Feb 18 12:51:23 drbd9-01 kernel: drbd r0/0 drbd1: No resync, but 570368
bits in bitmap!
Feb 18 12:51:23 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( DUnknown
-> Inconsistent ) repl( Off -> Established )
Feb 18 12:51:24 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 515638917 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:25 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 515638917
Feb 18 12:51:25 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 137570080 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:25 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 137570080
Feb 18 12:51:25 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 997229091 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:25 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 997229091
Feb 18 12:51:25 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 82178736 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:25 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 82178736
Feb 18 12:51:25 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 3821653145 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:25 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 3821653145
Feb 18 12:51:25 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 2763345815 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:25 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 2763345815
Feb 18 12:51:25 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 2378645705 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:25 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 2378645705
Feb 18 12:51:25 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 1701376328 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:25 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 1701376328
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 404563979 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 404563979
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 2322165605 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 2322165605
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 3116638354 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 3116638354
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 4171949499 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 4171949499
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 4153763848 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 4153763848
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 1547352803 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 1547352803
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 1194426093 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 1194426093
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 3141780427 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 3141780427
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 2111985163 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 2111985163
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 3255414054 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 3255414054
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 993220877 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 993220877
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 2752612106 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 2752612106
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 1639712018 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 1639712018
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 793028279 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 793028279
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 1975781053 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 1975781053
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 402090143 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 402090143
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 1357840858 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 1357840858
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 4293365755 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 4293365755
Feb 18 12:51:27 drbd9-01 kernel: drbd r0 drbd9-02: Preparing remote state
change 3296526104 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:27 drbd9-01 kernel: drbd r0 drbd9-02: Aborting remote state
change 3296526104
Feb 18 12:51:44 drbd9-01 kernel: drbd r0 drbd9-02: PingAck did not arrive
in time.
Feb 18 12:51:44 drbd9-01 kernel: drbd r0 drbd9-02: conn( Connected ->
NetworkFailure ) peer( Secondary -> Unknown )
Feb 18 12:51:44 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: repl(
Established -> Off )
Feb 18 12:51:44 drbd9-01 kernel: drbd r0 drbd9-02: ack_receiver terminated
Feb 18 12:51:44 drbd9-01 kernel: drbd r0 drbd9-02: Terminating ack_recv
thread
Feb 18 12:51:44 drbd9-01 kernel: drbd r0/0 drbd1: ASSERTION
list_empty(&device->done_ee) FAILED in drbd_disconnected
Feb 18 12:51:44 drbd9-01 kernel: drbd r0 drbd9-02: Connection closed
Feb 18 12:51:44 drbd9-01 kernel: drbd r0 drbd9-02: conn( NetworkFailure ->
Unconnected )
Feb 18 12:51:44 drbd9-01 kernel: drbd r0 drbd9-02: Restarting receiver
thread
Feb 18 12:51:44 drbd9-01 kernel: drbd r0 drbd9-02: conn( Unconnected ->
Connecting )
Feb 18 12:51:57 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: Resync done
(total 147 sec; paused 0 sec; 34000 K/sec)
Feb 18 12:51:57 drbd9-01 drbdadm[32809]: Don't know which config file
belongs to resource r0, trying default ones...
Feb 18 12:51:57 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: updated UUIDs
B6CAADFB7D215BC6:0000000000000000:0000000000000000:0000000000000000
Feb 18 12:51:57 drbd9-01 kernel: drbd r0/0 drbd1: disk( Inconsistent ->
UpToDate )
Feb 18 12:51:57 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-05: pdsk( DUnknown
-> Outdated ) resync-susp( connection dependency -> no )
Feb 18 12:51:57 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-04: resync-susp(
connection dependency -> no )
Feb 18 12:51:57 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: repl( SyncTarget
-> Established )
Feb 18 12:51:57 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: resync-susp(
connection dependency -> no )
Feb 18 12:51:57 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: helper command:
/sbin/drbdadm after-resync-target
Feb 18 12:51:57 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: helper command:
/sbin/drbdadm after-resync-target exit code 0 (0x0)




2) Node2

Feb 18 12:49:15 drbd9-02 drbdadm[17377]: Don't know which config file
belongs to resource r0, trying default ones...
Feb 18 12:49:15 drbd9-02 kernel: drbd r0/0 drbd1 drbd9-04: helper command:
/sbin/drbdadm before-resync-source exit code 0 (0x0)
Feb 18 12:49:15 drbd9-02 kernel: drbd r0/0 drbd1 drbd9-04: repl( WFBitMapS
-> PausedSyncS )
Feb 18 12:49:15 drbd9-02 kernel: drbd r0/0 drbd1 drbd9-04: Began resync as
PausedSyncS (will sync 4998328 KB [1249582 bits set]).
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 352665508 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-01: Rejecting concurrent
remote state change 3171251231 because of state change 352665508
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 352665508
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 1037382588 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-01: Rejecting concurrent
remote state change 141488321 because of state change 1037382588
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-01: Ignoring P_TWOPC_ABORT
packet 141488321.
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 1037382588
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 399118927 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-01: Rejecting concurrent
remote state change 1396949391 because of state change 399118927
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 399118927
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 1547038261 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 1547038261
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 90711453 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 90711453
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2906061427 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2906061427
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 110758586 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 110758586
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 19982401 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 19982401
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1229720926 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1229720926
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2599231352 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2599231352
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1975668868 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1975668868
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2505675278 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2505675278
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 4000831140 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 4000831140
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2750887982 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2750887982
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 2468909229 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 2468909229
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2662778291 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2662778291
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 4035033791 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 4035033791
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1708023363 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1708023363
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 575587423 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 575587423
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3005066576 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3005066576
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 2982970747 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 2982970747
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 1635237549 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 1635237549
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3629941899 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3629941899
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3563238485 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Rejecting concurrent
remote state change 2815311641 because of state change 3563238485
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3563238485
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3238325029 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Rejecting concurrent
remote state change 2126091279 because of state change 3238325029
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3238325029
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3638753626 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3638753626
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3599232118 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3599232118
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 113146377 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Rejecting concurrent
remote state change 776632002 because of state change 113146377
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 113146377
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3173991607 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3173991607
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3766324938 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3766324938
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1350394170 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1350394170
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2874348269 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2874348269
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1961866418 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1961866418
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1422080841 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1422080841
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1935970639 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1935970639
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 36989052 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 36989052
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 582050229 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 582050229
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 4192500224 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 4192500224
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 2039128137 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 2039128137
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 821093755 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 821093755
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3518597027 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3518597027
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 452858682 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 452858682
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 2321677588 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 2321677588
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3637280121 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3637280121
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 261689227 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 261689227
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 1843385190 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 1843385190
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3197178194 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3197178194
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 767463344 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 767463344
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3875723021 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3875723021
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3351946337 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3351946337
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3454915512 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3454915512
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2640937765 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2640937765
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3044822599 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3044822599
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3354987837 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3354987837
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3556374775 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3556374775
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2026795642 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2026795642
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1409529751 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1409529751
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3085364587 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3085364587
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1803219856 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1803219856
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2423822761 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2423822761
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 2070740492 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 2070740492
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 424571609 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 424571609
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1861094959 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1861094959
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 1439155988 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 1439155988
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1912776257 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1912776257
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3342040311 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3342040311
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3583634975 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3583634975
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3560986460 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3560986460
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1059596388 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1059596388
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2039774846 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2039774846
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 2984515839 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 2984515839
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2729731529 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2729731529
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3776435962 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3776435962
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 1499748024 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 1499748024
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 2633932659 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 2633932659
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3420883318 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3420883318
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3805539839 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3805539839
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2892821134 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2892821134
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3642844571 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3642844571
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 110768160 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 110768160
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 17859418 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 17859418
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 1919413000 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 1919413000
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1145386916 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1145386916
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2321101024 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2321101024
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3288824952 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3288824952
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2274965928 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2274965928
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3641522607 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3641522607
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3926057794 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3926057794
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 128435041 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 128435041
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 620951758 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 620951758
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1067274131 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1067274131
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3401606816 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3401606816
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 2464745589 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 2464745589
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3575638272 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3575638272
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 289378464 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 289378464
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 1793285500 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 1793285500
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 2159434546 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 2159434546
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3776803522 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3776803522
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 2020636307 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 2020636307
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2574235971 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2574235971
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1115473996 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1115473996
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 1681934234 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 1681934234
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 2926904129 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 2926904129
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 1651456969 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 1651456969
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1578249747 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1578249747
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 430284320 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 430284320
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 4168451443 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 4168451443
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3304566520 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3304566520
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 2489323610 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 2489323610
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2784036568 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2784036568
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 2444898555 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 2444898555
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2821131655 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2821131655
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 649862413 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 649862413
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 1360241560 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 1360241560
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 3610428486 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 3610428486
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2654692450 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2654692450
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 237694475 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 237694475
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 2561046587 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 2561046587
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 2123728468 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 2123728468
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 1716193777 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 1716193777
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 954801834 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 954801834
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 997680699 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 997680699
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1595210697 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1595210697
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 1795247459 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 1795247459
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1312694431 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1312694431
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 1531206635 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 1531206635
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1379557998 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1379557998
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3792084596 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3792084596
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1368060281 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1368060281
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 3569716009 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 3569716009
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1393085582 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1393085582
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 4267014762 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 4267014762
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 1428881181 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 1428881181
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 1718804050 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 1718804050
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 610769045 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 610769045
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 795605995 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-03: Aborting remote state
change 795605995
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Preparing remote state
change 2783224475 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Aborting remote state
change 2783224475
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: sock was shut down by
peer
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: conn( Connecting ->
BrokenPipe )
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: ack_receiver terminated
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Terminating ack_recv
thread
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Connection closed
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: conn( BrokenPipe ->
Unconnected )
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: Restarting receiver
thread
Feb 18 12:49:19 drbd9-02 kernel: drbd r0 drbd9-01: conn( Unconnected ->
Connecting )
Feb 18 12:49:30 drbd9-02 kernel: drbd r0 drbd9-03: Preparing remote state
change 444800473 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:30 drbd9-02 kernel: drbd r0 drbd9-03: Committing remote state
change 444800473
Feb 18 12:49:32 drbd9-02 kernel: drbd r0 drbd9-01: sock_recvmsg returned -11
Feb 18 12:49:32 drbd9-02 kernel: drbd r0 drbd9-01: conn( Connecting ->
BrokenPipe )
Feb 18 12:49:32 drbd9-02 kernel: drbd r0 drbd9-01: Connection closed
Feb 18 12:49:32 drbd9-02 kernel: drbd r0 drbd9-01: conn( BrokenPipe ->
Unconnected )
Feb 18 12:49:33 drbd9-02 kernel: drbd r0 drbd9-01: conn( Unconnected ->
Connecting )
Feb 18 12:49:41 drbd9-02 kernel: drbd r0 drbd9-01: sock was shut down by
peer
Feb 18 12:49:41 drbd9-02 kernel: drbd r0 drbd9-01: conn( Connecting ->
BrokenPipe )
Feb 18 12:49:41 drbd9-02 kernel: drbd r0 drbd9-01: Connection closed
Feb 18 12:49:41 drbd9-02 kernel: drbd r0 drbd9-01: conn( BrokenPipe ->
Unconnected )
Feb 18 12:49:42 drbd9-02 kernel: drbd r0 drbd9-01: conn( Unconnected ->
Connecting )
Feb 18 12:49:42 drbd9-02 kernel: drbd r0 tcp:drbd9-01: initial packet S
crossed
Feb 18 12:49:54 drbd9-02 kernel: drbd r0 tcp:drbd9-01: initial packet M
crossed
Feb 18 12:49:55 drbd9-02 kernel: drbd r0 drbd9-01: conn( Connecting ->
Disconnecting )
Feb 18 12:49:55 drbd9-02 kernel: drbd r0 drbd9-01: sock_recvmsg returned -4
Feb 18 12:49:55 drbd9-02 kernel: drbd r0 drbd9-01: Connection closed
Feb 18 12:49:55 drbd9-02 kernel: drbd r0 drbd9-01: conn( Disconnecting ->
StandAlone )
Feb 18 12:49:55 drbd9-02 kernel: drbd r0: State change failed: Need a
connection to start verify or resync
Feb 18 12:49:55 drbd9-02 kernel: drbd r0 drbd9-01: Failed: conn( StandAlone
-> Connecting )
Feb 18 12:49:55 drbd9-02 kernel: drbd r0 drbd9-01: Terminating receiver
thread
Feb 18 12:49:55 drbd9-02 kernel: drbd r0 drbd9-01: Terminating sender thread
Feb 18 12:49:56 drbd9-02 kernel: drbd r0 tcp:drbd9-05: Closing unexpected
connection from 100.100.10.11
Feb 18 12:50:01 drbd9-02 systemd: Starting Session 171 of user root.
Feb 18 12:50:01 drbd9-02 systemd: Started Session 171 of user root.
Feb 18 12:50:04 drbd9-02 kernel: drbd r0 tcp:drbd9-05: Closing unexpected
connection from 100.100.10.11
Feb 18 12:50:16 drbd9-02 kernel: drbd r0 tcp:drbd9-05: Closing unexpected
connection from 100.100.10.11
Feb 18 12:50:25 drbd9-02 kernel: drbd r0: Preparing cluster-wide state
change 2594601400 (1->2 496/16)
Feb 18 12:50:25 drbd9-02 kernel: drbd r0: Retrying cluster-wide state
change after 332ms
Feb 18 12:50:25 drbd9-02 kernel: drbd r0: Preparing cluster-wide state
change 1091225699 (1->2 496/16)
Feb 18 12:50:25 drbd9-02 kernel: drbd r0: State change 1091225699:
primary_nodes=0, weak_nodes=0
Feb 18 12:50:25 drbd9-02 kernel: drbd r0: Committing cluster-wide state
change 1091225699 (10ms)
Feb 18 12:50:25 drbd9-02 kernel: drbd r0 drbd9-03: conn( Connected ->
Disconnecting ) peer( Secondary -> Unknown )
Feb 18 12:50:25 drbd9-02 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( UpToDate
-> DUnknown ) repl( Established -> Off )
Feb 18 12:50:25 drbd9-02 kernel: drbd r0 drbd9-03: ack_receiver terminated
Feb 18 12:50:25 drbd9-02 kernel: drbd r0 drbd9-03: Terminating ack_recv
thread
Feb 18 12:50:25 drbd9-02 kernel: drbd r0 drbd9-03: Connection closed
Feb 18 12:50:25 drbd9-02 kernel: drbd r0 drbd9-03: conn( Disconnecting ->
StandAlone )
Feb 18 12:50:25 drbd9-02 kernel: drbd r0 drbd9-03: Terminating receiver
thread
Feb 18 12:50:25 drbd9-02 kernel: drbd r0 drbd9-03: Terminating sender thread
Feb 18 12:50:25 drbd9-02 kernel: drbd r0: Preparing cluster-wide state
change 1955398811 (1->3 496/16)
Feb 18 12:50:25 drbd9-02 kernel: drbd r0: Retrying cluster-wide state
change after 193ms
Feb 18 12:50:25 drbd9-02 kernel: drbd r0 tcp:drbd9-05: Closing unexpected
connection from 100.100.10.31
Feb 18 12:50:26 drbd9-02 kernel: drbd r0: Preparing cluster-wide state
change 583992461 (1->3 496/16)
Feb 18 12:50:26 drbd9-02 kernel: drbd r0: State change 583992461:
primary_nodes=0, weak_nodes=0
Feb 18 12:50:26 drbd9-02 kernel: drbd r0 drbd9-04: Cluster is now split
Feb 18 12:50:26 drbd9-02 kernel: drbd r0: Committing cluster-wide state
change 583992461 (43ms)
Feb 18 12:50:26 drbd9-02 kernel: drbd r0 drbd9-04: conn( Connected ->
Disconnecting ) peer( Secondary -> Unknown )
Feb 18 12:50:26 drbd9-02 kernel: drbd r0/0 drbd1 drbd9-04: repl(
PausedSyncS -> Off ) resync-susp( peer -> no )
Feb 18 12:50:26 drbd9-02 kernel: drbd r0 drbd9-04: ack_receiver terminated
Feb 18 12:50:26 drbd9-02 kernel: drbd r0 drbd9-04: Terminating ack_recv
thread
Feb 18 12:50:26 drbd9-02 kernel: drbd r0 drbd9-04: Connection closed
Feb 18 12:50:26 drbd9-02 kernel: drbd r0 drbd9-04: conn( Disconnecting ->
StandAlone )
Feb 18 12:50:26 drbd9-02 kernel: drbd r0 drbd9-04: Terminating receiver
thread
Feb 18 12:50:26 drbd9-02 kernel: drbd r0 drbd9-04: Terminating sender thread
Feb 18 12:50:26 drbd9-02 kernel: drbd r0 drbd9-05: conn( Connecting ->
Disconnecting )
Feb 18 12:50:26 drbd9-02 kernel: drbd r0 drbd9-05: Connection closed
Feb 18 12:50:26 drbd9-02 kernel: drbd r0 drbd9-05: conn( Disconnecting ->
StandAlone )
Feb 18 12:50:26 drbd9-02 kernel: drbd r0 drbd9-05: Terminating receiver
thread
Feb 18 12:50:26 drbd9-02 kernel: drbd r0 drbd9-05: Terminating sender thread
Feb 18 12:50:26 drbd9-02 kernel: drbd r0/0 drbd1: disk( UpToDate ->
Detaching )
Feb 18 12:50:26 drbd9-02 kernel: drbd r0/0 drbd1: disk( Detaching ->
Diskless )
Feb 18 12:50:26 drbd9-02 kernel: drbd r0/0 drbd1: drbd_bm_resize called
with capacity == 0
*Feb 18 12:50:26 drbd9-02 kernel: drbd r0: Terminating worker thread
 <--------------------------
----------------------------------------------------------------------------------
Last log before HANG!!!!!*

Feb 18 13:36:14 drbd9-02 rsyslogd: [origin software="rsyslogd"
swVersion="7.4.7" x-pid="899" x-info="http://www.rsyslog.com"] start
Feb 18 13:36:11 drbd9-02 journal: Runtime journal is using 6.1M (max 48.9M,
leaving 73.4M of free 483.6M, current limit 48.9M).
Feb 18 13:36:11 drbd9-02 kernel: Initializing cgroup subsys cpuset
Feb 18 13:36:11 drbd9-02 kernel: Initializing cgroup subsys cpu
Feb 18 13:36:11 drbd9-02 kernel: Initializing cgroup subsys cpuacct
Feb 18 13:36:11 drbd9-02 kernel: Linux version 3.10.0-229.7.2.el7.x86_64 (
builder at kbuilder.dev.centos.org) (gcc version 4.8.3 20140911 (Red Hat
4.8.3-9) (GCC) ) #1 SMP Tue Jun 23 22:06:11 UTC 2015
Feb 18 13:36:11 drbd9-02 kernel: Command line:
BOOT_IMAGE=/vmlinuz-3.10.0-229.7.2.el7.x86_64
root=/dev/mapper/cento-------s-root ro rd.lvm.lv=centos/root
rd.lvm.lv=centos/swap
net.ifnames=0 rhgb quiet systemd.debug LANG=ko_KR.UTF-8
Feb 18 13:36:11 drbd9-02 kernel: Disabled fast string operations
Feb 18 13:36:11 drbd9-02 kernel: e820: BIOS-provided physical RAM map:
Feb 18 13:36:11 drbd9-02 kernel: BIOS-e820: [mem
0x0000000000000000-0x000000000009ebff] usable
Feb 18 13:36:11 drbd9-02 kernel: BIOS-e820: [mem
0x000000000009ec00-0x000000000009ffff] reserved
Feb 18 13:36:11 drbd9-02 kernel: BIOS-e820: [mem
0x00000000000dc000-0x00000000000fffff] reserved
Feb 18 13:36:11 drbd9-02 kernel: BIOS-e820: [mem
0x0000000000100000-0x000000003fedffff] usable
Feb 18 13:36:11 drbd9-02 kernel: BIOS-e820: [mem
0x000000003fee0000-0x000000003fefefff] ACPI data
Feb 18 13:36:11 drbd9-02 kernel: BIOS-e820: [mem
0x000000003feff000-0x000000003fefffff] ACPI NVS
Feb 18 13:36:11 drbd9-02 kernel: BIOS-e820: [mem
0x000000003ff00000-0x000000003fffffff] usable
Feb 18 13:36:11 drbd9-02 kernel: BIOS-e820: [mem
0x00000000f0000000-0x00000000f7ffffff] reserved
Feb 18 13:36:11 drbd9-02 kernel: BIOS-e820: [mem
0x00000000fec00000-0x00000000fec0ffff] reserved
Feb 18 13:36:11 drbd9-02 kernel: BIOS-e820: [mem
0x00000000fee00000-0x00000000fee00fff] reserved
Feb 18 13:36:11 drbd9-02 kernel: BIOS-e820: [mem
0x00000000fffe0000-0x00000000ffffffff] reserved
Feb 18 13:36:11 drbd9-02 kernel: NX (Execute Disable) protection: active
Feb 18 13:36:11 drbd9-02 kernel: SMBIOS 2.4 present.
[root at drbd9-02 ~]#





3) Node3

Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 4148874408
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-01: Handshake successful:
Agreed network protocol version 111
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-01: Feature flags enabled on
protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-01: Starting ack_recv thread
(from drbd_r_r0 [27984])
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-01: sock was shut down by
peer
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-01: conn( Connecting ->
BrokenPipe )
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-01: ack_receiver terminated
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-01: Terminating ack_recv
thread
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 tcp:drbd9-05: Closing unexpected
connection from 100.100.10.11
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-01: Connection closed
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-01: conn( BrokenPipe ->
Unconnected )
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-01: Restarting receiver
thread
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-01: conn( Unconnected ->
Connecting )
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1700403818 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1700403818
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 27107912 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 27107912
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3704636436 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3704636436
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1124892736 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:10 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1124892736
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3041974229 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3041974229
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2044263190 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2044263190
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 4123278827 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 4123278827
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 58309047 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 58309047
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1424319647 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1424319647
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2146390635 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2146390635
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Handshake successful:
Agreed network protocol version 111
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Feature flags enabled on
protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Starting ack_recv thread
(from drbd_r_r0 [27984])
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3224851067 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3224851067
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3275921964 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3275921964
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2785425520 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2785425520
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3092566612 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3092566612
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3546571907 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3546571907
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2684586320 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2684586320
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2826388576 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2826388576
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3152419371 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3152419371
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 717442544 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 717442544
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1538773720 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1538773720
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3935479086 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3935479086
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1574758056 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1574758056
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1212157223 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1212157223
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1960346098 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1960346098
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3227317969 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3227317969
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 4262478632 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 4262478632
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3004867455 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3004867455
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1876684995 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1876684995
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 390087009 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 390087009
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2865628136 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2865628136
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 680960366 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:11 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 680960366
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1752965497 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1752965497
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3111596947 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3111596947
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2123586573 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2123586573
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2432880222 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2432880222
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3466823240 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3466823240
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3409262061 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3409262061
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3528423906 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3528423906
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 919401773 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 919401773
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2355827361 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2355827361
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 274217007 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 274217007
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1735994045 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1735994045
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 184247837 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 184247837
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3397010196 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3397010196
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2647943263 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2647943263
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2314118776 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2314118776
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2304216418 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2304216418
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2840076212 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2840076212
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2089786251 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2089786251
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1243463540 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1243463540
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3934530318 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3934530318
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1338535718 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1338535718
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3825464252 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3825464252
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 458138564 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 458138564
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3263001224 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3263001224
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1737345562 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1737345562
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 895380100 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 895380100
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1353873222 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1353873222
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1127265602 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1127265602
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2720890274 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2720890274
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 4153736246 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 4153736246
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3640994784 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3640994784
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2901412307 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2901412307
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1322472363 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1322472363
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1479893692 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1479893692
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3205669847 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3205669847
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1501697909 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1501697909
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2019004256 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2019004256
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3350229455 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3350229455
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1039571066 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1039571066
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 220257880 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:12 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 220257880
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 4026895487 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 4026895487
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1721931724 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1721931724
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1033546961 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1033546961
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3092763300 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3092763300
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 770538692 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 770538692
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1354057588 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1354057588
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1483793276 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1483793276
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3482039458 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3482039458
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2598992257 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2598992257
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 817000556 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 817000556
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 77974480 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 77974480
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3966174102 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3966174102
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 747047415 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 747047415
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2830150720 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2830150720
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2666597117 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2666597117
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3030671864 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3030671864
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2343253662 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2343253662
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3117955713 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3117955713
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3036692217 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3036692217
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2007453059 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2007453059
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 102602932 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 102602932
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 374656520 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 374656520
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2835460938 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2835460938
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 842771771 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 842771771
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 4190748897 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 4190748897
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2015816228 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2015816228
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1462726939 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1462726939
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2742749823 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2742749823
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1941161229 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1941161229
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2962336775 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2962336775
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2584607114 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2584607114
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1687607447 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1687607447
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2414299465 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2414299465
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 918122871 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 918122871
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2674395060 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2674395060
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2939585177 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2939585177
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1994730321 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1994730321
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1533339556 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1533339556
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3763733638 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:13 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3763733638
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3413396013 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3413396013
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 965408431 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 965408431
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2712598837 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2712598837
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2723235979 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2723235979
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1267855463 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1267855463
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2472306332 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2472306332
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3364150313 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3364150313
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2682382103 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2682382103
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 772789142 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 772789142
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2291238476 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2291238476
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1516864995 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1516864995
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 8357236 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 8357236
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3503255741 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3503255741
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2689137965 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2689137965
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3319268457 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3319268457
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 278690020 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 278690020
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3600586096 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3600586096
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3511376225 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3511376225
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 63685240 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 63685240
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 4238257769 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 4238257769
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 176339051 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 176339051
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3285874930 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3285874930
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 334220901 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 334220901
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 314034843 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 314034843
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3927423460 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3927423460
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 445007464 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 445007464
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1563966627 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1563966627
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2609728281 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2609728281
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3813816936 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3813816936
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3732916591 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3732916591
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3912334398 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3912334398
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2966831417 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2966831417
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 4103984360 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 4103984360
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1765942052 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1765942052
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2916219381 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2916219381
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2875115170 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2875115170
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3970442788 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3970442788
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3311773748 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3311773748
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 828078891 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 828078891
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 916340848 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 916340848
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3809938960 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3809938960
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 466030330 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 466030330
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3871624072 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3871624072
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 562578872 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 562578872
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3059617914 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3059617914
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1765006974 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1765006974
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 4282026993 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 4282026993
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 541907284 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 541907284
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3720310948 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3720310948
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2525581650 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2525581650
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 233526968 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 233526968
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1832763483 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1832763483
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 919412360 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 919412360
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3167526743 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3167526743
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1726750051 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1726750051
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 135300592 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 135300592
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1945757685 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1945757685
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 120559031 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 120559031
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1931376741 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1931376741
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2685589933 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2685589933
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2895871033 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2895871033
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1657331205 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Committing remote state
change 1657331205
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 352665508 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 352665508
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1037382588 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1037382588
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 399118927 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 399118927
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1547038261 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1547038261
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 90711453 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 90711453
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2906061427 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2906061427
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 110758586 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 110758586
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 19982401 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 19982401
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1229720926 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1229720926
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2599231352 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2599231352
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1975668868 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1975668868
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2505675278 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2505675278
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 4000831140 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 4000831140
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2750887982 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2750887982
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2468909229 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2468909229
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2662778291 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2662778291
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 4035033791 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 4035033791
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1708023363 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Rejecting concurrent
remote state change 1066177111 because of state change 1708023363
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1708023363
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 575587423 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 575587423
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3005066576 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3005066576
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2982970747 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2982970747
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1635237549 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1635237549
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3629941899 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Rejecting concurrent
remote state change 3986545484 because of state change 3629941899
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3629941899
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3563238485 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3563238485
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3238325029 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3238325029
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3638753626 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3638753626
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3599232118 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3599232118
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 113146377 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 113146377
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3173991607 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Rejecting concurrent
remote state change 1425635733 because of state change 3173991607
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3173991607
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3766324938 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Rejecting concurrent
remote state change 3678332951 because of state change 3766324938
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3766324938
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1350394170 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Rejecting concurrent
remote state change 3453543298 because of state change 1350394170
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1350394170
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2874348269 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2874348269
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1961866418 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1961866418
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1422080841 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Rejecting concurrent
remote state change 1106447724 because of state change 1422080841
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1422080841
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1935970639 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Rejecting concurrent
remote state change 1369156260 because of state change 1935970639
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1935970639
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 36989052 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 36989052
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 582050229 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 582050229
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 4192500224 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 4192500224
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2039128137 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2039128137
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 821093755 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 821093755
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3518597027 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3518597027
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 452858682 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 452858682
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2321677588 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2321677588
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3637280121 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3637280121
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 261689227 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 261689227
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1843385190 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1843385190
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3197178194 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3197178194
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 767463344 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 767463344
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3875723021 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3875723021
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3351946337 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3351946337
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3454915512 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3454915512
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2640937765 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2640937765
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3044822599 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3044822599
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3354987837 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3354987837
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3556374775 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3556374775
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2026795642 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2026795642
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1409529751 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1409529751
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3085364587 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3085364587
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1803219856 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1803219856
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2423822761 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2423822761
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2070740492 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2070740492
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 424571609 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 424571609
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1861094959 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1861094959
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1439155988 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1439155988
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1912776257 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1912776257
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3342040311 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3342040311
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3583634975 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3583634975
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3560986460 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3560986460
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1059596388 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1059596388
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2039774846 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2039774846
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2984515839 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2984515839
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2729731529 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2729731529
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3776435962 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3776435962
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1499748024 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1499748024
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2633932659 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2633932659
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3420883318 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3420883318
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3805539839 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3805539839
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2892821134 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2892821134
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3642844571 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3642844571
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 110768160 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 110768160
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 17859418 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 17859418
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1919413000 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1919413000
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1145386916 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1145386916
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2321101024 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2321101024
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3288824952 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3288824952
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2274965928 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2274965928
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3641522607 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3641522607
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3926057794 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3926057794
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 128435041 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 128435041
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 620951758 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 620951758
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1067274131 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1067274131
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3401606816 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3401606816
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2464745589 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2464745589
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3575638272 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3575638272
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 289378464 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 289378464
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1793285500 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1793285500
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2159434546 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2159434546
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3776803522 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3776803522
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2020636307 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2020636307
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2574235971 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2574235971
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1115473996 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1115473996
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1681934234 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1681934234
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2926904129 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2926904129
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1651456969 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1651456969
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1578249747 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1578249747
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 430284320 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 430284320
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 4168451443 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 4168451443
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3304566520 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3304566520
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2489323610 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2489323610
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2784036568 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2784036568
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2444898555 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2444898555
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2821131655 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2821131655
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 649862413 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 649862413
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1360241560 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1360241560
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 3610428486 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 3610428486
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2654692450 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2654692450
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 237694475 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 237694475
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 2561046587 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 2561046587
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2123728468 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2123728468
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1716193777 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1716193777
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 954801834 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 954801834
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 997680699 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 997680699
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1595210697 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1595210697
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1795247459 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1795247459
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1312694431 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1312694431
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1531206635 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1531206635
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1379557998 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1379557998
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3792084596 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3792084596
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1368060281 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1368060281
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 3569716009 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 3569716009
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1393085582 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1393085582
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 4267014762 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 4267014762
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1428881181 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 1428881181
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 1718804050 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 1718804050
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 610769045 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 610769045
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 795605995 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Aborting remote state
change 795605995
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2783224475 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2783224475
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: sock was shut down by
peer
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: conn( Connecting ->
BrokenPipe )
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: ack_receiver terminated
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Terminating ack_recv
thread
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Connection closed
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: conn( BrokenPipe ->
Unconnected )
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: Restarting receiver
thread
Feb 18 12:49:19 drbd9-03 kernel: drbd r0 drbd9-01: conn( Unconnected ->
Connecting )
Feb 18 12:49:30 drbd9-03 kernel: drbd r0 drbd9-01: Handshake successful:
Agreed network protocol version 111
Feb 18 12:49:30 drbd9-03 kernel: drbd r0 drbd9-01: Feature flags enabled on
protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
Feb 18 12:49:30 drbd9-03 kernel: drbd r0 drbd9-01: Starting ack_recv thread
(from drbd_r_r0 [27984])
Feb 18 12:49:30 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 444800473 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:30 drbd9-03 kernel: drbd r0 drbd9-01: Committing remote state
change 444800473
Feb 18 12:49:30 drbd9-03 kernel: drbd r0 drbd9-01: conn( Connecting ->
Connected ) peer( Unknown -> Secondary )
Feb 18 12:49:30 drbd9-03 kernel: drbd r0/0 drbd1: peer does not support
WRITE_SAME
Feb 18 12:49:30 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01:
drbd_sync_handshake:
Feb 18 12:49:30 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: self
B6CAADFB7D215BC6:0000000000000000:B6CAADFB7D215BC6:0000000000000000 bits:0
flags:0
Feb 18 12:49:30 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: peer
0000000000000004:FFFFFFFFFFFFFFFF:0000000000000000:0000000000000000 bits:0
flags:24
Feb 18 12:49:30 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: uuid_compare()=3
by rule 30
Feb 18 12:49:30 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: Writing the
whole bitmap, full sync required after drbd_sync_handshake.
Feb 18 12:49:30 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: pdsk( DUnknown
-> Inconsistent ) repl( Off -> WFBitMapS )
Feb 18 12:49:30 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: send bitmap
stats [Bytes(packets)]: plain 0(0), RLE 21(1), total 21; compression: 100.0%
Feb 18 12:49:30 drbd9-03 drbdadm[28024]: Don't know which config file
belongs to resource r0, trying default ones...
Feb 18 12:49:30 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: receive bitmap
stats [Bytes(packets)]: plain 0(0), RLE 21(1), total 21; compression: 100.0%
Feb 18 12:49:30 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: helper command:
/sbin/drbdadm before-resync-source
Feb 18 12:49:30 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: helper command:
/sbin/drbdadm before-resync-source exit code 0 (0x0)
Feb 18 12:49:30 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: repl( WFBitMapS
-> SyncSource )
Feb 18 12:49:30 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: Began resync as
SyncSource (will sync 4998328 KB [1249582 bits set]).
Feb 18 12:49:55 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 2594601400 (primary_nodes=0, weak_nodes=0)
Feb 18 12:50:01 drbd9-03 systemd: Starting Session 296 of user root.
Feb 18 12:50:01 drbd9-03 systemd: Started Session 296 of user root.
Feb 18 12:50:25 drbd9-03 kernel: drbd r0 drbd9-02: Aborting remote state
change 2594601400
Feb 18 12:50:25 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 1091225699 (primary_nodes=0, weak_nodes=0)
Feb 18 12:50:25 drbd9-03 kernel: drbd r0 drbd9-02: Committing remote state
change 1091225699
Feb 18 12:50:25 drbd9-03 kernel: drbd r0 drbd9-02: conn( Connected ->
TearDown ) peer( Secondary -> Unknown )
Feb 18 12:50:25 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( UpToDate
-> DUnknown ) repl( Established -> Off )
Feb 18 12:50:25 drbd9-03 kernel: drbd r0 drbd9-02: ack_receiver terminated
Feb 18 12:50:25 drbd9-03 kernel: drbd r0 drbd9-02: Terminating ack_recv
thread
Feb 18 12:50:25 drbd9-03 kernel: drbd r0 drbd9-04: Rejecting concurrent
remote state change 1955398811 because of state change 1091225699
Feb 18 12:50:25 drbd9-03 kernel: drbd r0 drbd9-04: Ignoring P_TWOPC_ABORT
packet 1955398811.
Feb 18 12:50:25 drbd9-03 kernel: drbd r0 drbd9-02: Connection closed
Feb 18 12:50:25 drbd9-03 kernel: drbd r0 drbd9-02: conn( TearDown ->
Unconnected )
Feb 18 12:50:25 drbd9-03 kernel: drbd r0 drbd9-02: Restarting receiver
thread
Feb 18 12:50:25 drbd9-03 kernel: drbd r0 drbd9-02: conn( Unconnected ->
Connecting )
Feb 18 12:50:25 drbd9-03 kernel: drbd r0 drbd9-04: Preparing remote state
change 583992461 (primary_nodes=0, weak_nodes=0)
Feb 18 12:50:26 drbd9-03 kernel: drbd r0 drbd9-04: Committing remote state
change 583992461
Feb 18 12:51:13 drbd9-03 kernel: drbd r0 drbd9-02: sock_recvmsg returned -11
Feb 18 12:51:13 drbd9-03 kernel: drbd r0 drbd9-02: conn( Connecting ->
BrokenPipe )
Feb 18 12:51:13 drbd9-03 kernel: drbd r0 drbd9-02: Connection closed
Feb 18 12:51:13 drbd9-03 kernel: drbd r0 drbd9-02: conn( BrokenPipe ->
Unconnected )
Feb 18 12:51:14 drbd9-03 kernel: drbd r0 drbd9-02: conn( Unconnected ->
Connecting )
Feb 18 12:51:23 drbd9-03 kernel: drbd r0 drbd9-01: Preparing remote state
change 955356902 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:23 drbd9-03 kernel: drbd r0 drbd9-01: Committing remote state
change 955356902
Feb 18 12:51:24 drbd9-03 kernel: drbd r0 drbd9-02: Handshake successful:
Agreed network protocol version 111
Feb 18 12:51:24 drbd9-03 kernel: drbd r0 drbd9-02: Feature flags enabled on
protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
Feb 18 12:51:24 drbd9-03 kernel: drbd r0 drbd9-02: Starting ack_recv thread
(from drbd_r_r0 [27986])
Feb 18 12:51:24 drbd9-03 kernel: drbd r0 drbd9-02: conn( Connecting ->
NetworkFailure )
Feb 18 12:51:24 drbd9-03 kernel: drbd r0 drbd9-02: ack_receiver terminated
Feb 18 12:51:24 drbd9-03 kernel: drbd r0 drbd9-02: Terminating ack_recv
thread
Feb 18 12:51:24 drbd9-03 kernel: drbd r0 drbd9-02: Connection closed
Feb 18 12:51:24 drbd9-03 kernel: drbd r0 drbd9-02: conn( NetworkFailure ->
Unconnected )
Feb 18 12:51:24 drbd9-03 kernel: drbd r0 drbd9-02: Restarting receiver
thread
Feb 18 12:51:24 drbd9-03 kernel: drbd r0 drbd9-02: conn( Unconnected ->
Connecting )
Feb 18 12:51:24 drbd9-03 kernel: drbd r0 tcp:drbd9-02: Error receiving
initial packet
Feb 18 12:51:24 drbd9-03 kernel: drbd r0 drbd9-02: Handshake successful:
Agreed network protocol version 111
Feb 18 12:51:24 drbd9-03 kernel: drbd r0 drbd9-02: Feature flags enabled on
protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
Feb 18 12:51:24 drbd9-03 kernel: drbd r0 drbd9-02: Starting ack_recv thread
(from drbd_r_r0 [27986])
Feb 18 12:51:24 drbd9-03 kernel: drbd r0 drbd9-02: Preparing remote state
change 515638917 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:25 drbd9-03 kernel: drbd r0 drbd9-02: sock_recvmsg returned
-104
Feb 18 12:51:25 drbd9-03 kernel: drbd r0 drbd9-02: conn( Connecting ->
NetworkFailure )
Feb 18 12:51:25 drbd9-03 kernel: drbd r0 drbd9-02: ack_receiver terminated
Feb 18 12:51:25 drbd9-03 kernel: drbd r0 drbd9-02: Terminating ack_recv
thread
Feb 18 12:51:25 drbd9-03 kernel: drbd r0 drbd9-02: Connection closed
Feb 18 12:51:25 drbd9-03 kernel: drbd r0 drbd9-02: conn( NetworkFailure ->
Unconnected )
Feb 18 12:51:25 drbd9-03 kernel: drbd r0 drbd9-02: Restarting receiver
thread
Feb 18 12:51:25 drbd9-03 kernel: drbd r0 drbd9-02: conn( Unconnected ->
Connecting )
Feb 18 12:51:26 drbd9-03 kernel: drbd r0 tcp:drbd9-02: initial packet S
crossed
Feb 18 12:51:27 drbd9-03 kernel: drbd r0 drbd9-02: Handshake successful:
Agreed network protocol version 111
Feb 18 12:51:27 drbd9-03 kernel: drbd r0 drbd9-02: Feature flags enabled on
protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
Feb 18 12:51:27 drbd9-03 kernel: drbd r0 drbd9-02: Starting ack_recv thread
(from drbd_r_r0 [27986])
Feb 18 12:51:27 drbd9-03 kernel: drbd r0 drbd9-02: Wrong magic value
0x83740267 in protocol version 111
Feb 18 12:51:27 drbd9-03 kernel: drbd r0 drbd9-02: conn( Connecting ->
ProtocolError )
Feb 18 12:51:27 drbd9-03 kernel: drbd r0 drbd9-02: ack_receiver terminated
Feb 18 12:51:27 drbd9-03 kernel: drbd r0 drbd9-02: Terminating ack_recv
thread
Feb 18 12:51:27 drbd9-03 kernel: drbd r0 drbd9-02: Connection closed
Feb 18 12:51:27 drbd9-03 kernel: drbd r0 drbd9-02: conn( ProtocolError ->
Unconnected )
Feb 18 12:51:27 drbd9-03 kernel: drbd r0 drbd9-02: Restarting receiver
thread
Feb 18 12:51:27 drbd9-03 kernel: drbd r0 drbd9-02: conn( Unconnected ->
Connecting )
Feb 18 12:51:32 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-04: updated UUIDs
B6CAADFB7D215BC6:0000000000000000:B6CAADFB7D215BC6:0000000000000000
Feb 18 12:51:32 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-04: Resync done
(total 144 sec; paused 0 sec; 34708 K/sec)
Feb 18 12:51:32 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-04: pdsk(
Inconsistent -> UpToDate ) repl( SyncSource -> Established )
Feb 18 12:51:54 drbd9-03 kernel: drbd r0: Two-phase commit 515638917 timeout
Feb 18 12:51:57 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: Resync done
(total 147 sec; paused 0 sec; 34000 K/sec)
Feb 18 12:51:57 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: pdsk(
Inconsistent -> UpToDate ) repl( SyncSource -> Established )




4)  Node4

Feb 18 12:49:14 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 828078891 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:14 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 828078891
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 916340848 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 916340848
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3809938960 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3809938960
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 466030330 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 466030330
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3871624072 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3871624072
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 562578872 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 562578872
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3059617914 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3059617914
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1765006974 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1765006974
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 4282026993 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 4282026993
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: Handshake successful:
Agreed network protocol version 111
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: Feature flags enabled on
protocol level: 0x7 TRIM THIN_RESYNC WRITE_SAME.
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: Starting ack_recv thread
(from drbd_r_r0 [21093])
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 541907284 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 541907284
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3720310948 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3720310948
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2525581650 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2525581650
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 233526968 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 233526968
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1832763483 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1832763483
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 919412360 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 919412360
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3167526743 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3167526743
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1726750051 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1726750051
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 135300592 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 135300592
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1945757685 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1945757685
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 120559031 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 120559031
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1931376741 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1931376741
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2685589933 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2685589933
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2895871033 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2895871033
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1657331205 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: Committing remote state
change 1657331205
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: conn( Connecting ->
Connected ) peer( Unknown -> Secondary )
Feb 18 12:49:15 drbd9-04 kernel: drbd r0/0 drbd1: peer does not support
WRITE_SAME
Feb 18 12:49:15 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-02:
drbd_sync_handshake:
Feb 18 12:49:15 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-02: self
0000000000000004:0000000000000000:0000000000000000:0000000000000000
bits:102960 flags:0
Feb 18 12:49:15 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-02: peer
B6CAADFB7D215BC6:B6CAADFB7D215BC6:B6CAADFB7D215BC6:0000000000000000
bits:758062 flags:120
Feb 18 12:49:15 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-02:
uuid_compare()=-3 by rule 20
Feb 18 12:49:15 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( DUnknown
-> UpToDate ) repl( Off -> WFBitMapT )
Feb 18 12:49:15 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-02: receive bitmap
stats [Bytes(packets)]: plain 0(0), RLE 21(1), total 21; compression: 100.0%
Feb 18 12:49:15 drbd9-04 drbdadm[21216]: Don't know which config file
belongs to resource r0, trying default ones...
Feb 18 12:49:15 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-02: send bitmap
stats [Bytes(packets)]: plain 0(0), RLE 21(1), total 21; compression: 100.0%
Feb 18 12:49:15 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-02: helper command:
/sbin/drbdadm before-resync-target
Feb 18 12:49:15 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-02: helper command:
/sbin/drbdadm before-resync-target exit code 0 (0x0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-02: repl( WFBitMapT
-> PausedSyncT )
Feb 18 12:49:15 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-02: Began resync as
PausedSyncT (will sync 4998328 KB [1249582 bits set]).
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 352665508 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 352665508
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1037382588 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1037382588
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 399118927 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 399118927
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1547038261 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1547038261
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 90711453 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 90711453
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2906061427 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2906061427
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 110758586 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 110758586
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 19982401 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 19982401
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1229720926 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1229720926
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2599231352 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2599231352
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1975668868 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1975668868
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2505675278 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2505675278
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 4000831140 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:15 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 4000831140
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2750887982 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2750887982
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2468909229 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2468909229
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2662778291 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2662778291
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 4035033791 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 4035033791
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1708023363 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1708023363
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 575587423 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 575587423
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3005066576 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3005066576
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2982970747 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2982970747
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1635237549 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1635237549
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3629941899 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3629941899
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3563238485 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3563238485
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3238325029 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3238325029
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3638753626 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3638753626
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3599232118 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3599232118
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 113146377 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 113146377
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3173991607 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3173991607
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3766324938 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3766324938
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1350394170 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1350394170
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2874348269 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2874348269
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1961866418 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1961866418
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1422080841 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1422080841
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1935970639 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1935970639
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 36989052 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 36989052
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 582050229 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 582050229
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 4192500224 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 4192500224
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2039128137 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2039128137
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 821093755 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 821093755
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3518597027 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3518597027
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 452858682 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 452858682
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2321677588 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:16 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2321677588
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3637280121 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3637280121
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 261689227 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 261689227
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1843385190 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1843385190
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3197178194 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3197178194
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 767463344 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 767463344
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3875723021 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3875723021
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3351946337 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3351946337
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3454915512 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3454915512
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2640937765 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2640937765
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3044822599 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3044822599
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3354987837 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Rejecting concurrent
remote state change 3556374775 because of state change 3354987837
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3354987837
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2026795642 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2026795642
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1409529751 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1409529751
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3085364587 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3085364587
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1803219856 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1803219856
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2423822761 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2423822761
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2070740492 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2070740492
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 424571609 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 424571609
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1861094959 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1861094959
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1439155988 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1439155988
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1912776257 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1912776257
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3342040311 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3342040311
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3583634975 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3583634975
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3560986460 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3560986460
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1059596388 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1059596388
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2039774846 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2039774846
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2984515839 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2984515839
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2729731529 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2729731529
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3776435962 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3776435962
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1499748024 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1499748024
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2633932659 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2633932659
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3420883318 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3420883318
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3805539839 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3805539839
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2892821134 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2892821134
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3642844571 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3642844571
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 110768160 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 110768160
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 17859418 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:17 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 17859418
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1919413000 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1919413000
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1145386916 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1145386916
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2321101024 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2321101024
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3288824952 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3288824952
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2274965928 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2274965928
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3641522607 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3641522607
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3926057794 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3926057794
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 128435041 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 128435041
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 620951758 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 620951758
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1067274131 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1067274131
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3401606816 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3401606816
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2464745589 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2464745589
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3575638272 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3575638272
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 289378464 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 289378464
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1793285500 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1793285500
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2159434546 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2159434546
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3776803522 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3776803522
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2020636307 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2020636307
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2574235971 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2574235971
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1115473996 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1115473996
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1681934234 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1681934234
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2926904129 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2926904129
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1651456969 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1651456969
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1578249747 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1578249747
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 430284320 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 430284320
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 4168451443 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 4168451443
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3304566520 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3304566520
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2489323610 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2489323610
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2784036568 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2784036568
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2444898555 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2444898555
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2821131655 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2821131655
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 649862413 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 649862413
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1360241560 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1360241560
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 3610428486 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 3610428486
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2654692450 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2654692450
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 237694475 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 237694475
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 2561046587 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 2561046587
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2123728468 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2123728468
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1716193777 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:18 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1716193777
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 954801834 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 954801834
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 997680699 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 997680699
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1595210697 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1595210697
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1795247459 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1795247459
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1312694431 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1312694431
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1531206635 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1531206635
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1379557998 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1379557998
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3792084596 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3792084596
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1368060281 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1368060281
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 3569716009 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 3569716009
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1393085582 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1393085582
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 4267014762 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 4267014762
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1428881181 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1428881181
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 1718804050 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 1718804050
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 610769045 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 610769045
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 795605995 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-03: Aborting remote state
change 795605995
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2783224475 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:19 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2783224475
Feb 18 12:49:29 drbd9-04 kernel: drbd r0 tcp:drbd9-05: Closing unexpected
connection from 100.100.10.11
Feb 18 12:49:30 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 444800473 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:30 drbd9-04 kernel: drbd r0 drbd9-03: Committing remote state
change 444800473
Feb 18 12:49:38 drbd9-04 kernel: drbd r0 tcp:drbd9-05: Closing unexpected
connection from 100.100.10.11
Feb 18 12:49:49 drbd9-04 kernel: drbd r0 tcp:drbd9-05: Closing unexpected
connection from 100.100.10.11
Feb 18 12:49:55 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 2594601400 (primary_nodes=0, weak_nodes=0)
Feb 18 12:49:55 drbd9-04 kernel: drbd r0 tcp:drbd9-05: Closing unexpected
connection from 100.100.10.11
Feb 18 12:50:01 drbd9-04 systemd: Starting Session 139 of user root.
Feb 18 12:50:01 drbd9-04 systemd: Started Session 139 of user root.
Feb 18 12:50:07 drbd9-04 kernel: drbd r0 tcp:drbd9-05: Closing unexpected
connection from 100.100.10.11
Feb 18 12:50:16 drbd9-04 kernel: drbd r0 tcp:drbd9-05: Closing unexpected
connection from 100.100.10.11
Feb 18 12:50:25 drbd9-04 kernel: drbd r0 tcp:drbd9-05: Closing unexpected
connection from 100.100.10.11
Feb 18 12:50:25 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 2594601400
Feb 18 12:50:25 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1091225699 (primary_nodes=0, weak_nodes=0)
Feb 18 12:50:25 drbd9-04 kernel: drbd r0 drbd9-02: Committing remote state
change 1091225699
Feb 18 12:50:25 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 1955398811 (primary_nodes=0, weak_nodes=0)
Feb 18 12:50:25 drbd9-04 kernel: drbd r0 drbd9-02: Aborting remote state
change 1955398811
Feb 18 12:50:25 drbd9-04 kernel: drbd r0 drbd9-02: Preparing remote state
change 583992461 (primary_nodes=0, weak_nodes=0)
Feb 18 12:50:26 drbd9-04 kernel: drbd r0 drbd9-02: Committing remote state
change 583992461
Feb 18 12:50:26 drbd9-04 kernel: drbd r0 drbd9-02: conn( Connected ->
TearDown ) peer( Secondary -> Unknown )
Feb 18 12:50:26 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( UpToDate
-> DUnknown ) repl( PausedSyncT -> Off )
Feb 18 12:50:26 drbd9-04 kernel: drbd r0 drbd9-02: ack_receiver terminated
Feb 18 12:50:26 drbd9-04 kernel: drbd r0 drbd9-02: Terminating ack_recv
thread
Feb 18 12:50:26 drbd9-04 kernel: drbd r0 drbd9-02: Connection closed
Feb 18 12:50:26 drbd9-04 kernel: drbd r0 drbd9-02: conn( TearDown ->
Unconnected )
Feb 18 12:50:26 drbd9-04 kernel: drbd r0 drbd9-02: Restarting receiver
thread
Feb 18 12:50:26 drbd9-04 kernel: drbd r0 drbd9-02: conn( Unconnected ->
Connecting )
Feb 18 12:50:36 drbd9-04 kernel: drbd r0 tcp:drbd9-02: Closing unexpected
connection from 100.100.10.11
Feb 18 12:50:48 drbd9-04 kernel: drbd r0 tcp:drbd9-02: Closing unexpected
connection from 100.100.10.11
Feb 18 12:51:00 drbd9-04 kernel: drbd r0 tcp:drbd9-02: Closing unexpected
connection from 100.100.10.11
Feb 18 12:51:12 drbd9-04 kernel: drbd r0 tcp:drbd9-05: Closing unexpected
connection from 100.100.10.11
Feb 18 12:51:13 drbd9-04 kernel: drbd r0 drbd9-02: sock_recvmsg returned -11
Feb 18 12:51:13 drbd9-04 kernel: drbd r0 drbd9-02: conn( Connecting ->
BrokenPipe )
Feb 18 12:51:13 drbd9-04 kernel: drbd r0/0 drbd1: ASSERTION
list_empty(&device->sync_ee) FAILED in drbd_disconnected
Feb 18 12:51:13 drbd9-04 kernel: drbd r0 drbd9-02: Connection closed
Feb 18 12:51:13 drbd9-04 kernel: drbd r0 drbd9-02: conn( BrokenPipe ->
Unconnected )
Feb 18 12:51:14 drbd9-04 kernel: drbd r0 drbd9-02: conn( Unconnected ->
Connecting )
Feb 18 12:51:20 drbd9-04 kernel: drbd r0 tcp:drbd9-02: Closing unexpected
connection from 100.100.10.11
Feb 18 12:51:23 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 955356902 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:23 drbd9-04 kernel: drbd r0 drbd9-03: Committing remote state
change 955356902
Feb 18 12:51:24 drbd9-04 kernel: drbd r0 drbd9-03: Preparing remote state
change 515638917 (primary_nodes=0, weak_nodes=0)
Feb 18 12:51:26 drbd9-04 kernel: drbd r0 drbd9-02: sock_recvmsg returned -11
Feb 18 12:51:26 drbd9-04 kernel: drbd r0 drbd9-02: conn( Connecting ->
BrokenPipe )
Feb 18 12:51:26 drbd9-04 kernel: drbd r0 drbd9-02: Connection closed
Feb 18 12:51:26 drbd9-04 kernel: drbd r0 drbd9-02: conn( BrokenPipe ->
Unconnected )
Feb 18 12:51:27 drbd9-04 kernel: drbd r0 drbd9-02: conn( Unconnected ->
Connecting )
Feb 18 12:51:32 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: Resync done
(total 144 sec; paused 0 sec; 34708 K/sec)
Feb 18 12:51:32 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: updated UUIDs
B6CAADFB7D215BC6:0000000000000000:0000000000000000:0000000000000000
Feb 18 12:51:32 drbd9-04 kernel: drbd r0/0 drbd1: disk( Inconsistent ->
UpToDate )
Feb 18 12:51:32 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-05: pdsk( DUnknown
-> Outdated ) resync-susp( connection dependency -> no )
Feb 18 12:51:32 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: repl( SyncTarget
-> Established )
Feb 18 12:51:32 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-02: resync-susp(
connection dependency -> no )
Feb 18 12:51:32 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-01: pdsk( DUnknown
-> Outdated ) resync-susp( connection dependency -> no )
Feb 18 12:51:32 drbd9-04 kernel: drbd r0/0 drbd1 drbd9-03: helper command:
/sbin/drbdadm after-resync-target


4. Question
 - Could you please check HANG position at Node 2 log?




Thanks.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linbit.com/pipermail/drbd-dev/attachments/20160218/65df571a/attachment-0001.htm>


More information about the drbd-dev mailing list