<div dir="ltr"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">Hello,</span><br style="margin-top:0px;color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">My project is to build a 3 nodes proxmox 5.4 cluster first, then add DRBD to it (a 3 nodes linstor cluster with node 1 and node 2 as Satellites, plus node 3 as a diskless Controller for quorum).</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250);text-decoration-line:underline">Nodes 1 and 2 hardware configuration :</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">- Intel Xeon 4c/8t at 3.8 Ghz / 4.2 Ghz</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">- 32 Go DDR4 ECC 2133 Mhz</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">- 1 Gbps public network + 1 Gbps private network (vRACK from ovh)</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">- 3x960Go SSD in raid 1 (2 used disks and 1 unused) for VMs</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250);text-decoration-line:underline">Node 3 hardware configuration :</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">- Intel Xeon 4c/8t at 3.5 Ghz / 3.9 Ghz</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">- 16 Go DDR4 ECC 2400 Mhz</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">- 1 Gbps public network + 1 Gbps private network (vRACK from ovh)</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">- 2x4 To HDD in &quot;soft raid&quot; for backups</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">I started by installing Proxmox 5.4 on all nodes than I properly configured each nodes&#39;s /etc/hosts with theirs vRACK IP Addresses, then I created my Proxmox&#39;s cluster, everything went good.</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">(The fact that you can create a cluster at this day only with few clicks is, indeed, amazing)</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><i style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">/!\ Sources that I tried, will be put at the bottom of this post /!\</i><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">After this step, I began to install the pve-headers package then add linbit&#39;s repository and downloaded some packages (drbd-dkms drbd-utils drbd-top) on all nodes.</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">It&#39;s now time to install linstor&#39;s (satellite,client) packages on each nodes and linstor-controller package on my 3rd node (The 2x4 To one).</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><i style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">As I said above, nodes 1-2 (SSDs) are going to be satellites that hold VMs, node 3 (HDD) is the diskless controller for quorum and will hold backups later.<br><br><br></i><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">The next step that I did is to enable and start each node&#39;s services. Nodes 1-2 will need linstor-satellite, node 3 both linstor-satellite and linstor-controller.</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">I verified that these services are started with systemctl status.</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">Now, I need to create my linstor node, so I start by adding the node 3 as a &quot;Combined&quot; node-type and the last nodes as &quot;Combined&quot; too which is recommended in the documentations I&#39;ve seen.</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><i style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">Nodes 1-2 are named &quot;second&quot; and &quot;third&quot;, node 3 is named &quot;first&quot; as an example.<br>I verified again that the nodes are created, which is the case.<br><br><br></i><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">I need to create a LVM partition on both nodes (1-2) that supports snapshots, so I chose a lvmthin partition of 760 Go named drbdpool which is in the VG (volume group) pve. (You can verifiy all of this with commands like &quot;pvs&quot;, &quot;vgs&quot;, &quot;lvs&quot;)</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">Here comes my problem at this step : (I tried so many times and different ways to do it, but I&#39;m getting the same errors at the same step on a different setup. I even did it on some VMs to try if it wasn&#39;t a hardware problem.)</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">I need to create a resource-definition, name it and create a volume-definition, it worked.</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">But after this, I need to create this resource on the node 1 (second) and the node 2 (third) and they gave me the same error description.</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">&quot;Satellite &#39;second/third&#39; does not support the following layers : [DRBD]&quot;</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">At first, I told myself that it isn&#39;t a big deal if this step doesn&#39;t work but, after this I had to install the linstor-proxmox package and then, &quot;declare&quot; the storage that will be used and seen by DRBD.</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">This storage will appear on the Proxmox interface, but in my case it appear as a Unknown type of storage but active, and I can&#39;t create any VM on it, or see the remaining storage capacity.</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">Then, I was thinking back at this step that gave me one error and I drew a conclusion that either my proxmox has a problem, either because of this error, proxmox cannot recognize the storage at all. (I tried with a different setup, same error)</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">Even with the tool drbdtop, I was able to see that there was no activity at all from DRBD. I created a folder and a file on node 1 to see if it was going to be replicated on node 2, but it wasn&#39;t.</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">This is where I&#39;ve been stuck for days, without finding any information about it.</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">Thanks a lot for reading and helping,</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">Sources :</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">- Linbit&#39;s official DRBD documentation with a special chapter for Proxmox</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">- &quot;How to setup LINSTOR on Proxmox VE&quot; by Roland Kammerer on Linbit website the 26th of July 2018</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><span style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)">- &quot;Configuring Linstor storage plugin for Proxmox VE&quot; by yannis-itwiki&#39;s on his blogspot the 29th of July 2018</span><br style="color:rgb(44,44,44);font-family:&quot;Open Sans&quot;,Helvetica,Arial,sans-serif;font-size:14.6667px;background-color:rgb(250,250,250)"><br><div><br></div></div>