<div dir="ltr">Hello,<div><br></div><div>After upgrading the kernel to 6.5 the system can't connect to the peer (6.4.11) anymore.</div><div>I checked 6.5.1 - same issue.</div><div>All previous kernels including 6.4.14 are working just fine.</div><div>Checking the 6.5 changelog, I found commit 9ae440b8fdd6772b6c007fa3d3766530a09c9045 which mentioned some changes to DRBD.</div><div><br></div><div>On the 6.5.X system I have the following in the kernel log (<span style="font-family:"Helvetica Neue";font-size:13px">drbd_send_block() failed</span>):</div><div><br></div>
<div>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>2.473497] drbd: initialized. Version: 8.4.11 (api:1/proto:86-101)</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>2.475394] drbd: built-in</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>2.477254] drbd: registered as block device major 147</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.421400] drbd drbd0: Starting worker thread (from drbdsetup-84 [3844])</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.421509] drbd drbd0/0 drbd0: disk( Diskless -> Attaching )</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.421552] drbd drbd0: Method to ensure write ordering: flush</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.421554] drbd drbd0/0 drbd0: max BIO size = 131072</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.421557] drbd drbd0/0 drbd0: drbd_bm_resize called with capacity == 1845173184</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.428017] drbd drbd0/0 drbd0: resync bitmap: bits=230646648 words=3603854 pages=7039</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.467370] drbd0: detected capacity change from 0 to 1845173184</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.467372] drbd drbd0/0 drbd0: size = 880 GB (922586592 KB)</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.486005] drbd drbd0/0 drbd0: recounting of set bits took additional 0 jiffies</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.486010] drbd drbd0/0 drbd0: 0 KB (0 bits) marked out-of-sync by on disk bit-map.</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.486017] drbd drbd0/0 drbd0: disk( Attaching -> UpToDate )</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.486021] drbd drbd0/0 drbd0: attached to UUIDs 32DDB2019708F68A:0000000000000000:7D97648599B446DD:7D96648599B446DD</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.486863] drbd drbd0: conn( StandAlone -> Unconnected )</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.486871] drbd drbd0: Starting receiver thread (from drbd_w_drbd0 [3847])</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.486918] drbd drbd0: receiver (re)started</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[<span class="gmail-Apple-converted-space"> </span>7.486929] drbd drbd0: conn( Unconnected -> WFConnection )</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>12.340212] drbd drbd0: initial packet S crossed</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.310856] drbd drbd0: Handshake successful: Agreed network protocol version 101</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.311087] drbd drbd0: Feature flags enabled on protocol level: 0xf TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES.</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.311425] drbd drbd0: conn( WFConnection -> WFReportParams )</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.311621] drbd drbd0: Starting ack_recv thread (from drbd_r_drbd0 [4071])</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.400702] drbd drbd0/0 drbd0: drbd_sync_handshake:</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.400869] drbd drbd0/0 drbd0: self 32DDB2019708F68A:0000000000000000:7D97648599B446DD:7D96648599B446DD bits:0 flags:0</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.401205] drbd drbd0/0 drbd0: peer 32DDB2019708F68A:0000000000000000:7D97648599B446DC:7D96648599B446DD bits:0 flags:0</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.401538] drbd drbd0/0 drbd0: uuid_compare()=0 by rule 40</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.401709] drbd drbd0/0 drbd0: peer( Unknown -> Secondary ) conn( WFReportParams -> Connected ) pdsk( DUnknown -> UpToDate )</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.415394] drbd drbd0/0 drbd0: role( Secondary -> Primary )</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.506540] drbd drbd0/0 drbd0: _drbd_send_page: size=4096 len=4096 sent=-5</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.506773] drbd drbd0: peer( Secondary -> Unknown ) conn( Connected -> NetworkFailure ) pdsk( UpToDate -> DUnknown )</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.507109] drbd drbd0/0 drbd0: new current UUID 7F8B15C04AF49C4D:32DDB2019708F68B:7D97648599B446DD:7D96648599B446DD</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.507451] drbd drbd0: ack_receiver terminated</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.507588] drbd drbd0: Terminating drbd_a_drbd0</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.600693] drbd drbd0: Connection closed</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.600937] drbd drbd0: conn( NetworkFailure -> Unconnected )</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.601115] drbd drbd0: receiver terminated</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.601238] drbd drbd0: Restarting receiver thread</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.601378] drbd drbd0: receiver (re)started</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>22.601508] drbd drbd0: conn( Unconnected -> WFConnection )</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.260624] drbd drbd0: Handshake successful: Agreed network protocol version 101</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.260859] drbd drbd0: Feature flags enabled on protocol level: 0xf TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES.</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.261187] drbd drbd0: conn( WFConnection -> WFReportParams )</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.261367] drbd drbd0: Starting ack_recv thread (from drbd_r_drbd0 [4071])</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.340593] drbd drbd0/0 drbd0: drbd_sync_handshake:</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.340771] drbd drbd0/0 drbd0: self 7F8B15C04AF49C4D:32DDB2019708F68B:7D97648599B446DD:7D96648599B446DD bits:1 flags:0</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.341192] drbd drbd0/0 drbd0: peer 32DDB2019708F68A:0000000000000000:7D97648599B446DC:7D96648599B446DD bits:0 flags:0</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.341649] drbd drbd0/0 drbd0: uuid_compare()=1 by rule 70</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.341824] drbd drbd0/0 drbd0: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( DUnknown -> Consistent )</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.344911] drbd drbd0/0 drbd0: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.396792] drbd drbd0/0 drbd0: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.397210] drbd drbd0/0 drbd0: helper command: /sbin/drbdadm before-resync-source minor-0</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.407965] drbd drbd0/0 drbd0: helper command: /sbin/drbdadm before-resync-source minor-0 exit code 0 (0x0)</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.417547] drbd drbd0/0 drbd0: conn( WFBitMapS -> SyncSource ) pdsk( Consistent -> Inconsistent )</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.426697] drbd drbd0/0 drbd0: Began resync as SyncSource (will sync 4 KB [1 bits set]).</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.435638] drbd drbd0/0 drbd0: updated sync UUID 7F8B15C04AF49C4D:32DEB2019708F68B:32DDB2019708F68B:7D97648599B446DD</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.488608] drbd drbd0/0 drbd0: _drbd_send_page: size=4096 len=4096 sent=-5</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.498182] drbd drbd0/0 drbd0: drbd_send_block() failed</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.508498] drbd drbd0: peer( Secondary -> Unknown ) conn( SyncSource -> NetworkFailure )</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.517597] drbd drbd0: ack_receiver terminated</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.527513] drbd drbd0: Terminating drbd_a_drbd0</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.690598] drbd drbd0: Connection closed</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.701857] drbd drbd0: conn( NetworkFailure -> Unconnected )</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.712017] drbd drbd0: receiver terminated</p>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[ <span class="gmail-Apple-converted-space"> </span>23.721597] drbd drbd0: Restarting receiver thread</p><p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue""><br></p><p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue""><br></p><p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">On the peer:</p><p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue""><br></p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.038278] drbd drbd0: conn( Unconnected -> WFConnection )</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.558245] drbd drbd0: Handshake successful: Agreed network protocol version 101</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.562105] drbd drbd0: Feature flags enabled on protocol level: 0xf TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES.</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.569889] drbd drbd0: conn( WFConnection -> WFReportParams )</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.573802] drbd drbd0: Starting ack_recv thread (from drbd_r_drbd0 [2660])</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.688547] drbd drbd0/0 drbd0: drbd_sync_handshake:</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.692323] drbd drbd0/0 drbd0: self 3375B2019708F68A:0000000000000000:7D97648599B446DC:7D96648599B446DD bits:1 flags:0</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.699871] drbd drbd0/0 drbd0: peer 7F8B15C04AF49C4D:3375B2019708F68B:3374B2019708F68B:3373B2019708F68B bits:1 flags:0</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.707687] drbd drbd0/0 drbd0: uuid_compare()=-1 by rule 50</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.711563] drbd drbd0/0 drbd0: Becoming sync target due to disk states.</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.715381] drbd drbd0/0 drbd0: peer( Unknown -> Primary ) conn( WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate )</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.723039] drbd drbd0/0 drbd0: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.732489] drbd drbd0/0 drbd0: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.740178] drbd drbd0/0 drbd0: conn( WFBitMapT -> WFSyncUUID )</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.787113] drbd drbd0/0 drbd0: updated sync uuid 3376B2019708F68A:0000000000000000:7D97648599B446DC:7D96648599B446DD</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.794907] drbd drbd0/0 drbd0: helper command: /sbin/drbdadm before-resync-target minor-0</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.800006] drbd drbd0/0 drbd0: helper command: /sbin/drbdadm before-resync-target minor-0 exit code 0 (0x0)</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.807737] drbd drbd0/0 drbd0: conn( WFSyncUUID -> SyncTarget )</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.811639] drbd drbd0/0 drbd0: Began resync as SyncTarget (will sync 4 KB [1 bits set]).</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.916117] drbd drbd0: sock was shut down by peer</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.919955] drbd drbd0: peer( Primary -> Unknown ) conn( SyncTarget -> BrokenPipe ) pdsk( UpToDate -> DUnknown )</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.927796] drbd drbd0: short read (expected size 4096)</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.931812] drbd drbd0: error receiving RSDataReply, e: -5 l: 4096!</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.935864] drbd drbd0: ack_receiver terminated</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349071.939906] drbd drbd0: Terminating drbd_a_drbd0</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349072.088385] drbd drbd0: Connection closed</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349072.092398] drbd drbd0: conn( BrokenPipe -> Unconnected )</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349072.096436] drbd drbd0: receiver terminated</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349072.100469] drbd drbd0: Restarting receiver thread</p><p class="gmail-p1" style="margin:0px;font:13px "Helvetica Neue"">[349072.104454] drbd drbd0: receiver (re)started</p><p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">
</p><p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">[349072.108373] drbd drbd0: conn( Unconnected -> WFConnection )</p><p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue""><br></p><p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">--</p><p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue""> Best Regards,</p><p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue""> Serguei</p><br></div></div>