<div dir="ltr">After digging a bit more in both user&#39;s guide and in ML, managed to assign the resource on the 3rd node.<div>It was required to manually dump,modify and restore the metadata. </div><div>I had to increase the value of the &#39;max-peers&#39; option, which for this particular resource was set to &#39;0&#39; for some reason.</div><div><br></div><div>All other resources seem to have the correct values.</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Apr 9, 2018 at 2:44 PM, Yannis Milios <span dir="ltr">&lt;<a href="mailto:yannis.milios@gmail.com" target="_blank">yannis.milios@gmail.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hello,<div><br></div><div>On a 3 node/zfs backed drbd9 cluster, while trying to assign-resource on an additional node, I&#39;m getting &quot;Not enough free bitmap slots&quot; and the resync does not start.</div><div><br></div><div>Removing/reassigning the resource does not help either. I couldn&#39;t find enough information about this error when searching ML archives.</div><div><br></div><div>Any ideas what is causing this ?</div><div><br></div><div>Thanks</div><div><br></div><div>Some logs:</div><div>========</div><div><div>│[137368.869743] drbd vm-122-disk-1: Preparing cluster-wide state change 3649068569 (0-&gt;-1 3/1)                                                                                  │</div><div>│[137368.870076] drbd vm-122-disk-1: State change 3649068569: primary_nodes=5, weak_nodes=FFFFFFFFFFFFFFF8                                                                       │</div><div>│[137368.870078] drbd vm-122-disk-1: Committing cluster-wide state change 3649068569 (0ms)                                                                                       │</div><div>│[137368.870082] drbd vm-122-disk-1: role( Secondary -&gt; Primary )                                                                                                                │</div><div>│[142124.120066] drbd vm-122-disk-1 pve1: Preparing remote state change 152764597 (primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC)                                                 │</div><div>│[142124.120284] drbd vm-122-disk-1 pve1: Committing remote state change 152764597                                                                                               │</div><div>│[142124.120289] drbd vm-122-disk-1: State change failed: Refusing to be Outdated while Connected                                                                                │</div><div>│[142124.120399] drbd vm-122-disk-1/0 drbd103: Failed: disk( UpToDate -&gt; Outdated )                                                                                              │</div><div>│[142124.120410] drbd vm-122-disk-1: FATAL: Local commit of prepared 152764597 failed!                                                                                           │</div><div>│[142124.350767] drbd vm-122-disk-1: Preparing cluster-wide state change 3667315219 (0-&gt;1 496/16)                                                                                │</div><div>│[142124.350948] drbd vm-122-disk-1: State change 3667315219: primary_nodes=5, weak_nodes=FFFFFFFFFFFFFFFB                                                                       │</div><div>│[142124.350949] drbd vm-122-disk-1 pve2: Cluster is now split                                                                                                                   │</div><div>│[142124.350950] drbd vm-122-disk-1: Committing cluster-wide state change 3667315219 (0ms)                                                                                       │</div><div>│[142124.350970] drbd vm-122-disk-1 pve2: conn( Connected -&gt; Disconnecting ) peer( Secondary -&gt; Unknown )                                                                        │</div><div>│[142124.350973] drbd vm-122-disk-1/0 drbd103 pve2: pdsk( Diskless -&gt; DUnknown ) repl( Established -&gt; Off )                                                                      │</div><div>│[142124.350994] drbd vm-122-disk-1 pve2: ack_receiver terminated                                                                                                                │</div><div>│[142124.350996] drbd vm-122-disk-1 pve2: Terminating ack_recv thread                                                                                                            │</div><div>│[142124.467248] drbd vm-122-disk-1 pve2: Connection closed                                                                                                                      │</div><div>│[142124.467428] drbd vm-122-disk-1 pve2: conn( Disconnecting -&gt; StandAlone )                                                                                                    │</div><div>│[142124.467432] drbd vm-122-disk-1 pve2: Terminating receiver thread                                                                                                            │</div><div>│[142124.467504] drbd vm-122-disk-1 pve2: Terminating sender thread                                                                                                              │</div><div>│[142133.966538] drbd vm-122-disk-1 pve2: Starting sender thread (from drbdsetup [1502468])                                                                                      │</div><div>│[142133.968349] drbd vm-122-disk-1/0 drbd103 pve2: Not enough free bitmap slots                                                                                                 │</div><div>│[142135.077014] drbd vm-122-disk-1/0 drbd103 pve2: Not enough free bitmap slots                                                                                                 │</div><div>│[142227.488145] drbd vm-122-disk-1/0 drbd103 pve2: Not enough free bitmap slots                                                                                                 │</div><div>│[142232.509729] drbd vm-122-disk-1/0 drbd103 pve2: Not enough free bitmap slots                                                                                                 │</div><div>│[142272.526580] drbd vm-122-disk-1/0 drbd103 pve2: Not enough free bitmap slots                                                                                                 │</div><div>│[143361.840005] drbd vm-122-disk-1 pve2: Terminating sender thread                                                                                                              │</div><div>│[143505.002551] drbd vm-122-disk-1 pve2: Starting sender thread (from drbdsetup [3396832])                                                                                      │</div><div>│[143505.004330] drbd vm-122-disk-1/0 drbd103 pve2: Not enough free bitmap slots                                                                                                 │</div><div>│[143506.090369] drbd vm-122-disk-1/0 drbd103 pve2: Not enough free bitmap slots                                                                                                 │</div><div>│[143633.980319] drbd vm-122-disk-1 pve2: Terminating sender thread </div></div></div>
</blockquote></div><br></div>