<div dir="ltr"><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Hi Alex,</span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br></span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">I used it too, not with keep-res option (didn&#39;t know it), I &#39;ll try it :)</span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br></span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">And yes it is expected. I read the proxmox plugin code and change somethings to work with one vm which contains linstor-controller. The problem is your device is not writable.</span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br></span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">To do it writable, I had to change the proxmox plugin code.</span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">In the file </span>/usr/share/perl5/PVE/Storage/Custom/LINSTORPlugin.pm, you have to change the code with :</div><div><br></div><div>sub activate_volume {<br>    my ( $class, $storeid, $scfg, $volname, $snapname, $cache ) = @_;<br><br>    die &quot;Snapshot not implemented on DRBD\n&quot; if $snapname;<br><br>   ###THE IMPORTANT PART###<br>   if( ignore_volume( $scfg, $volname ) ) {<br>          print &quot;It is the controller vm volume, so set blockdev r/w\n&quot;;<br>          system (&#39;blockdev --setrw &#39; . get_dev_path $volname);<br>          return undef;<br>    }<br>    ###########################<br>    return undef if ignore_volume( $scfg, $volname );<br></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">   ....</span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br></span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">With it, when your proxmox start the vm it will call the activate_volume function and most importantly the blockdev system call. It will put your device in rw state, and proxmox will start your vm.</span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br></span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Give it a try. I wrote some code to get vm controller starting after a complete cluster outage, and it is working like a charm :)</span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">When I&#39;ll finish it, I&#39;ll publish it.</span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br></span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br></span></div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Best regards</span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Brice</span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br></span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br></span></div><div><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br></span></div><div>------------------------</div>Hello, </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">To be honest, I&#39;m not sure if that&#39;s a linstor-satellite issue. Please, correct </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">me. </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">There&#39;re two proxmox nodes pve1 and pve2. DRBD resource has been configured: </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">root@linstor-controller:~# linstor resource list </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">??????????????????????????????????????????????????? </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">? ResourceName ? Node ? Port ? Usage ? State ? </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">??????????????????????????????????????????????????? </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">? vm-100-disk-0 ? pve1 ? 7000 ? InUse ? UpToDate ? </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">? vm-100-disk-0 ? pve2 ? 7000 ? Unused ? UpToDate ? </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">??????????????????????????????????????????????????? </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">The linstor-controller itself is stored onto that DRBD resource: </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">root@pve1:~# pct config 100 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">arch: amd64 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">cores: 2 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">hostname: linstor-controller </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">memory: 512 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">net0: name=eth0,bridge=vmbr10,gw=10.1.1.1,hwaddr=26:81:53:50:FB:48,ip=<a href="http://10.1.1.254/24,type=veth">10.1.1.254/24,type=veth</a> </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">onboot: 1 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">ostype: debian </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">rootfs: drbdpool:vm-100-disk-0,mountoptions=noatime,size=2G </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">swap: 512 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">unprivileged: 1 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Linstor-satellite is started on both pve nodes within this systemd service: </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">root@pve1:~# systemctl cat linstor-satellite.service </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><font color="#660066" style="box-sizing:border-box;font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"># /lib/systemd/system/linstor-satellite.service <br style="box-sizing:border-box"></font><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">[Unit] </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Description=LINSTOR Satellite Service </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Wants=network-online.target </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">After=network-online.target </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">[Service] </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Type=simple </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">ExecStart=/usr/share/linstor-server/bin/Satellite --logs=/var/log/linstor-satellite --config-directory=/etc/linstor </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><font color="#660066" style="box-sizing:border-box;font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"># if killed by signal 143 -&gt; SIGTERM, 129 -&gt; SIGHUP <br style="box-sizing:border-box"></font><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">SuccessExitStatus=0 143 129 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">User=root </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">PrivateTmp=yes </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">[Install] </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">WantedBy=multi-user.target </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><font color="#660066" style="box-sizing:border-box;font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"># /etc/systemd/system/linstor-satellite.service.d/override.conf <br style="box-sizing:border-box"></font><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">[Service] </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">ExecStart= </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">ExecStart=/usr/share/linstor-server/bin/Satellite --logs=/var/log/linstor-satellite --config-directory=/etc/linstor --keep-res=vm-100 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">The Satellite does have the drbd resource in /var/lib/linstor.d and it&#39;s got </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">read when the service was started: </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">root@pve1:~# cat /var/lib/linstor.d/vm-100-disk-0.res </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><font color="#660066" style="box-sizing:border-box;font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"># This file was generated by linstor(1.0.1), do not edit manually. <br style="box-sizing:border-box"></font><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"></span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">resource &quot;vm-100-disk-0&quot; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">{ </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">template-file &quot;linstor_common.conf&quot;; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">net </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">{ </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">cram-hmac-alg sha1; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">shared-secret &quot;6cKQWOfF+w97AlSyyLZT&quot;; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">} </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">on pve1 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">{ </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">volume 0 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">{ </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">disk /dev/drbdpool/vm-100-disk-0_00000; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">disk </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">{ </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">discard-zeroes-if-aligned yes; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">rs-discard-granularity 65536; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">} </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">meta-disk internal; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">device minor 1000; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">} </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">node-id 0; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">} </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">on pve2 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">{ </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">volume 0 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">{ </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">disk /dev/drbd/this/is/not/used; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">disk </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">{ </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">discard-zeroes-if-aligned yes; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">rs-discard-granularity 65536; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">} </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">meta-disk internal; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">device minor 1000; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">} </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">node-id 1; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">} </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">connection </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">{ </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">host pve1 address ipv4 <a href="http://10.1.1.1:7000">10.1.1.1:7000</a>; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">host pve2 address ipv4 <a href="http://10.1.1.2:7000">10.1.1.2:7000</a>; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">} </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">} </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:24 pve1 systemd[1]: Started LINSTOR Satellite Service. </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:25 pve1 Satellite[3223]: LINSTOR, Module Satellite </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:25 pve1 Satellite[3223]: Version: 1.0.1 (98a9905de43631b745c7c0741c2ef8f577513b23) </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:25 pve1 Satellite[3223]: Build time: 2019-08-09T06:50:31+00:00 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:25 pve1 Satellite[3223]: Java Version: 11 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:25 pve1 Satellite[3223]: Java VM: Debian, Version 11.0.4+11-post-Debian-1deb10u1 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:25 pve1 Satellite[3223]: Operating system: Linux, Version 5.0.18-1-pve </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:25 pve1 Satellite[3223]: Environment: amd64, 2 processors, 351 MiB memory reserved for allocations </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:25 pve1 Satellite[3223]: System components initialization in progress </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:25 pve1 Satellite[3223]: 13:03:25.657 [main] INFO LINSTOR/Satellite - Log directory set to: &#39;/var/log/linstor-satellite&#39; </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:25 pve1 Satellite[3223]: 13:03:25.662 [Main] INFO LINSTOR/Satellite - Loading API classes started. </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:26 pve1 Satellite[3223]: 13:03:26.126 [Main] INFO LINSTOR/Satellite - API classes loading finished: 462ms </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:26 pve1 Satellite[3223]: 13:03:26.126 [Main] INFO LINSTOR/Satellite - Dependency injection started. </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:26 pve1 Satellite[3223]: WARNING: An illegal reflective access operation has occurred </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:26 pve1 Satellite[3223]: WARNING: Illegal reflective access by com.google.inject.internal.cglib.core.$ReflectUtils$1 (file:/usr/share/linstor-server/lib/guice-4.2.2.jar) to method java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain) </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:26 pve1 Satellite[3223]: WARNING: Please consider reporting this to the maintainers of com.google.inject.internal.cglib.core.$ReflectUtils$1 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:26 pve1 Satellite[3223]: WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:26 pve1 Satellite[3223]: WARNING: All illegal access operations will be denied in a future release </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:27 pve1 Satellite[3223]: 13:03:27.544 [Main] INFO LINSTOR/Satellite - Dependency injection finished: 1417ms </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:28 pve1 Satellite[3223]: 13:03:28.397 [Main] INFO LINSTOR/Satellite - Removing res files from /var/lib/linstor.d, keeping files matching regex: vm-100 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:28 pve1 Satellite[3223]: 13:03:28.401 [Main] INFO LINSTOR/Satellite - Starting service instance &#39;DeviceManager&#39; of type DeviceManager </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:28 pve1 Satellite[3223]: 13:03:28.403 [Main] INFO LINSTOR/Satellite - Starting service instance &#39;DrbdEventPublisher-1&#39; of type DrbdEventPublisher </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:28 pve1 Satellite[3223]: 13:03:28.404 [Main] INFO LINSTOR/Satellite - Starting service instance &#39;DrbdEventService-1&#39; of type DrbdEventService </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:28 pve1 Satellite[3223]: 13:03:28.410 [Main] INFO LINSTOR/Satellite - Starting service instance &#39;FileEventService&#39; of type FileEventService </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:28 pve1 Satellite[3223]: 13:03:28.415 [Main] INFO LINSTOR/Satellite - Starting service instance &#39;TimerEventService&#39; of type TimerEventService </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:28 pve1 Satellite[3223]: 13:03:28.416 [Main] INFO LINSTOR/Satellite - Initializing main network communications service </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Aug 15 13:03:28 pve1 Satellite[3223]: 13:03:28.441 [Main] INFO LINSTOR/Satellite - NetComService started on port /0:0:0:0:0:0:0:0:3366 </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">So, I expect the controller will be started up automatically at system startup. </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">However, after both pve nodes got started, the controller is not starting up. </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">It&#39;s b/c the drbd resource (vm-100-disk-0) is not up: </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">root@pve1:~# drbdadm status </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><font color="#660066" style="box-sizing:border-box;font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"># No currently configured DRBD found. <br style="box-sizing:border-box"></font><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"></span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">I had to manually bring it up (drbdadm up vm-100-disk-0) and after that the </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">controller was able to get started. </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Is that a bug or an expected behavior? </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">-- </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Best regards, </span><br style="box-sizing:border-box;color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)"><span style="color:rgb(79,76,73);font-family:Lato,Arial,sans-serif;font-size:14px;background-color:rgb(246,246,246)">Alex Kolesnik </span>  <br></div>