<div dir="ltr">Hello again,<div><br></div><div>Ok, I have resolved the issue, it was the interface used to communicate between hosts.</div><div><br></div><div>host H has 1 NIC with 2 ports. </div><div>host T has 1 NIC with 2 ports.</div><div>host C has 1 NIC with 1 port.</div><div><br></div><div>H and T are connected with a crossover cable using port 1.</div><div>H, T and C are connected through a virtual switch using port 2.</div><div><br></div><div>So I defined a "Data" interface that goes through the crossover table and I assigned it as PrefNic to the storagepool.</div><div>And I defined a "NormalTraffic" interface that goes through the virtualswitch in order to communicate the 3 nodes. I have rebuild the nodes with "linstor create node" using this interface.</div><div><br></div><div>I couldn't make it work, it only works if the PrefNic of the storagepool is also the the NormalTraffic interface.</div><div><br></div><div>Is it possible to have a Data interface for the drbdadm to exchange data and another interface for the node communication?</div><div><br></div><div>cheers,</div><div>Ferran</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">Missatge de Ferran Alchimia <<a href="mailto:ferran.alchimia@gmail.com">ferran.alchimia@gmail.com</a>> del dia dc., 3 de març 2021 a les 13:41:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>Hi,</div><div><br></div>Thank you for your help I reloaded de drbd so it now has the correct version:<div><br></div><div><div>DRBDADM_BUILDTAG=GIT-hash:\ a7820b3c14497a34f955ba5ce56cf1bc9d2d353e\ build\ by\ @buildsystem\,\ 2021-02-09\ 09:27:27</div><div>DRBDADM_API_VERSION=2</div><div>DRBD_KERNEL_VERSION_CODE=0x09001c</div><div>DRBD_KERNEL_VERSION=9.0.28</div><div>DRBDADM_VERSION_CODE=0x091000</div><div>DRBDADM_VERSION=9.16.0</div></div><div><br></div><div>Now, when I try to create the test resource it fails with another message:</div><div><br></div><div><div>linstor resource create C test</div><div>INFO:</div><div> Resource-definition property 'DrbdOptions/Resource/quorum' updated from 'off' to 'majority' by auto-quorum</div><div>INFO:</div><div> Resource-definition property 'DrbdOptions/Resource/on-no-quorum' updated from 'off' to 'io-error' by auto-quorum</div><div>SUCCESS:</div><div>Description:</div><div> New resource 'test' on node 'C' registered.</div><div>Details:</div><div> Resource 'test' on node 'C' UUID is: 25c11e12-d136-41fb-ad25-68049a7a6bac</div><div>SUCCESS:</div><div>Description:</div><div> Volume with number '0' on resource 'test' on node 'C' successfully registered</div><div>Details:</div><div> Volume UUID is: 70309d61-bf39-43aa-a41f-532587031ccd</div><div>ERROR:</div><div> (Node: 'C') An unknown exception occurred while processing the resource test</div><div>Show reports:</div><div> linstor error-reports show 603F7FA5-7AC40-000000</div><div>SUCCESS:</div><div> Added peer(s) 'C' to resource 'test' on 'T'</div><div>SUCCESS:</div><div> Added peer(s) 'C' to resource 'test' on 'H'</div></div><div><br></div><div><br></div><div><div># drbdadm status</div><div>test role:Secondary</div><div> disk:UpToDate</div><div> C connection:<b>Connecting</b></div><div> H role:Secondary</div><div> peer-disk:UpToDate</div></div><div><br></div><div>And the error in linstor-satellite:</div><div><br></div><div><div>ERROR REPORT 603F7FA5-7AC40-000004</div><div><br></div><div>============================================================</div><div><br></div><div>Application: LINBIT® LINSTOR</div><div>Module: Satellite</div><div>Version: 1.11.1</div><div>Build ID: fe95a94d86c66c6c9846a3cf579a1a776f95d3f4</div><div>Build time: 2021-01-13T08:34:55+00:00</div><div>Error time: 2021-03-03 13:31:51</div><div>Node: C</div><div><br></div><div>============================================================</div><div><br></div><div>Reported error:</div><div>===============</div><div><br></div><div>Category: RuntimeException</div><div>Class name: NullPointerException</div><div>Class canonical name: java.lang.NullPointerException</div><div>Generated at: Method 'normalizeAndCheck', Source file 'UnixPath.java', Line #75</div><div><br></div><div><br></div><div>Error context:</div><div> An error occurred while processing resource 'Node: 'C', Rsc: 'test''</div><div><br></div><div>Call backtrace:</div><div><br></div><div> Method Native Class:Line number</div><div> normalizeAndCheck N sun.nio.fs.UnixPath:75</div><div> <init> N sun.nio.fs.UnixPath:69</div><div> getPath N sun.nio.fs.UnixFileSystem:279</div><div> readObject N com.linbit.linstor.layer.drbd.utils.MdSuperblockBuffer:73</div><div> hasMetaData N com.linbit.linstor.layer.drbd.DrbdLayer:906</div><div> adjustDrbd N com.linbit.linstor.layer.drbd.DrbdLayer:580</div><div> process N com.linbit.linstor.layer.drbd.DrbdLayer:387</div><div> process N com.linbit.linstor.core.devmgr.DeviceHandlerImpl:789</div><div> processResourcesAndSnapshots N com.linbit.linstor.core.devmgr.DeviceHandlerImpl:335</div><div> dispatchResources N com.linbit.linstor.core.devmgr.DeviceHandlerImpl:145</div><div> dispatchResources N com.linbit.linstor.core.devmgr.DeviceManagerImpl:268</div><div> phaseDispatchDeviceHandlers N com.linbit.linstor.core.devmgr.DeviceManagerImpl:924</div><div> devMgrLoop N com.linbit.linstor.core.devmgr.DeviceManagerImpl:627</div><div> run N com.linbit.linstor.core.devmgr.DeviceManagerImpl:545</div><div> run N java.lang.Thread:834</div><div><br></div><div><br></div><div>END OF ERROR REPORT.</div></div><div><br></div><div><br></div><div>Note that the lvm storage is not defined on C, do I have to define some dummy space for the diskless "allocations"?</div><div><br></div><div>regards,</div><div>Ferran</div></div></div></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">Missatge de Rene Peinthor <<a href="mailto:rene.peinthor@linbit.com" target="_blank">rene.peinthor@linbit.com</a>> del dia dc., 3 de març 2021 a les 13:08:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><span style="font-family:monospace">DRBD_KERNEL_VERSION_CODE=</span><span style="font-family:monospace">0x08040b</span><div><font face="monospace"><br></font></div><div><font face="arial, sans-serif">Says you have the old DRBD8 kernel module loaded, Linstor only supports DRBD9 >=</font><br><div></div><div><br></div><div>Btw. you don't need to create a diskless storage pool (until you want special properties on that pool), Linstor already has <span style="font-family:monospace">DfltDisklessStorPool.</span></div><div>Also diskless-on-remaing is not really needed, as you will get a tiebreaker diskless resource anyway on a 3 node cluster, with auto-quorum enabled.</div></div><div><br></div><div>Cheers,</div><div>Rene</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Mar 3, 2021 at 12:48 PM Gábor Hernádi <<a href="mailto:gabor.hernadi@linbit.com" target="_blank">gabor.hernadi@linbit.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hello,</div><div><br></div><div>when you executed `linstor node create C ...` Linstor should have given you a list of supported layers + providers or reasons why layers / providers are not supported. You can recheck that list with</div><div> linstor node info</div><div>That command should tell you why Linstor thinks that C does not support DRBD.</div><div><br></div><div>Best regards,</div><div>Gabor<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Mar 3, 2021 at 12:29 PM Ferran Alchimia <<a href="mailto:ferran.alchimia@gmail.com" target="_blank">ferran.alchimia@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><font face="monospace">Hi,</font></div><div dir="ltr"><font face="monospace"><br></font></div><div dir="ltr"><font face="monospace">I currently have a 2 node (combined) cluster and I want to add an HA linstor-controller. I was following this guide <a href="https://www.linbit.com/drbd-user-guide/linstor-guide-1_0-en/#s-linstor_ha" target="_blank">https://www.linbit.com/drbd-user-guide/linstor-guide-1_0-en/#s-linstor_ha</a></font></div><div dir="ltr"><font face="monospace"><br></font></div><div dir="ltr"><font face="monospace">The first step asks for an AutoQuorum capable resource. So I think I have to add a third node to my cluster. This is my starting position:</font></div><div dir="ltr"><font face="monospace"><br></font></div><div dir="ltr"><font face="monospace">╭─────────────────────────────────────────────────────╮</font></div><div dir="ltr"><font face="monospace">┊ Node ┊ NodeType ┊ Addresses ┊ State ┊</font></div><div dir="ltr"><font face="monospace">╞═════════════════════════════════════════════════════╡</font></div><div dir="ltr"><font face="monospace">┊ H ┊ COMBINED ┊ <a href="http://10.0.7.106:3366" target="_blank">10.0.7.106:3366</a> (PLAIN) ┊ Online ┊</font></div><div dir="ltr"><font face="monospace">┊ T ┊ COMBINED ┊ <a href="http://10.0.7.105:3366" target="_blank">10.0.7.105:3366</a> (PLAIN) ┊ Online ┊</font></div><div dir="ltr"><font face="monospace">╰─────────────────────────────────────────────────────╯</font></div><div dir="ltr"><font face="monospace">╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮</font></div><div dir="ltr"><font face="monospace">┊ StoragePool ┊ Node ┊ Driver ┊ PoolName ┊ FreeCapacity ┊ TotalCapacity ┊ CanSnapshots ┊ State ┊</font></div><div dir="ltr"><font face="monospace">╞══════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╡</font></div><div dir="ltr"><font face="monospace">┊ DfltDisklessStorPool ┊ H ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊</font></div><div dir="ltr"><font face="monospace">┊ DfltDisklessStorPool ┊ T ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊</font></div><div dir="ltr"><font face="monospace">┊ drbdpool ┊ H ┊ LVM_THIN ┊ vgthc1/drbdpool ┊ 3.13 TiB ┊ 3.49 TiB ┊ True ┊ Ok ┊</font></div><div dir="ltr"><font face="monospace">┊ drbdpool ┊ T ┊ LVM_THIN ┊ vgthc1/drbdpool ┊ 3.13 TiB ┊ 3.49 TiB ┊ True ┊ Ok ┊</font></div><div dir="ltr"><font face="monospace">╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯</font></div><div dir="ltr"><font face="monospace"><br></font></div><div dir="ltr"><font face="monospace">Since my third node won't have any storage devices dedicated to drbd I presumed that I could add a DISKLESS node (I don't know if this is true), just for quorum and not for replica.</font></div><div dir="ltr"><font face="monospace"><br></font></div><div dir="ltr"><font face="monospace">linstor n create --node-type satellite C 10.100.1.3</font></div><div dir="ltr"><font face="monospace"><br></font></div><div dir="ltr"><font face="monospace">linstor n l</font></div><div dir="ltr"><font face="monospace">╭───────────────────────────────────────────────────────────╮</font></div><div dir="ltr"><font face="monospace">┊ Node ┊ NodeType ┊ Addresses ┊ State ┊</font></div><div dir="ltr"><font face="monospace">╞═══════════════════════════════════════════════════════════╡</font></div><div dir="ltr"><font face="monospace">┊ C ┊ SATELLITE ┊ <a href="http://10.100.1.3:3366" target="_blank">10.100.1.3:3366</a> (PLAIN) ┊ Online ┊</font></div><div dir="ltr"><font face="monospace">┊ H ┊ COMBINED ┊ <a href="http://10.0.7.106:3366" target="_blank">10.0.7.106:3366</a> (PLAIN) ┊ Online ┊</font></div><div dir="ltr"><font face="monospace">┊ T ┊ COMBINED ┊ <a href="http://10.0.7.105:3366" target="_blank">10.0.7.105:3366</a> (PLAIN) ┊ Online ┊</font></div><div dir="ltr"><font face="monospace">╰───────────────────────────────────────────────────────────╯</font></div><div dir="ltr"><font face="monospace">linstor sp create diskless C drbdpool</font></div><div dir="ltr"><font face="monospace"><br></font></div><div dir="ltr"><font face="monospace">╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮</font></div><div dir="ltr"><font face="monospace">┊ StoragePool ┊ Node ┊ Driver ┊ PoolName ┊ FreeCapacity ┊ TotalCapacity ┊ CanSnapshots ┊ State ┊</font></div><div dir="ltr"><font face="monospace">╞══════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╡</font></div><div dir="ltr"><font face="monospace">┊ DfltDisklessStorPool ┊ C ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊</font></div><div dir="ltr"><font face="monospace">┊ DfltDisklessStorPool ┊ H ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊</font></div><div dir="ltr"><font face="monospace">┊ DfltDisklessStorPool ┊ T ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊</font></div><div dir="ltr"><font face="monospace">┊ drbdpool ┊ C ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊</font></div><div dir="ltr"><font face="monospace">┊ drbdpool ┊ H ┊ LVM_THIN ┊ vgthc1/drbdpool ┊ 3.13 TiB ┊ 3.49 TiB ┊ True ┊ Ok ┊</font></div><div dir="ltr"><font face="monospace">┊ drbdpool ┊ T ┊ LVM_THIN ┊ vgthc1/drbdpool ┊ 3.13 TiB ┊ 3.49 TiB ┊ True ┊ Ok ┊</font></div><div dir="ltr"><font face="monospace">╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯</font></div><div dir="ltr"><font face="monospace"><br></font></div><div><font face="monospace">I add the --diskless-on-remaining flag for the rg definition (I don't know if this is needed)</font></div><div><font face="monospace">linstor rg m drbdpoolvm --place-count 2 --diskless-on-remaining<br></font></div><div><font face="monospace"><br></font></div><div dir="ltr"><font face="monospace"><div dir="ltr">linstor rg l</div><div dir="ltr">╭──────────────────────────────────────────────────────────────────╮</div><div dir="ltr">┊ ResourceGroup ┊ SelectFilter ┊ VlmNrs ┊ Description ┊</div><div dir="ltr">╞══════════════════════════════════════════════════════════════════╡</div><div dir="ltr">┊ DfltRscGrp ┊ PlaceCount: 2 ┊ ┊ ┊</div><div dir="ltr">╞┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄╡</div><div dir="ltr">┊ drbdpoolvm ┊ PlaceCount: 2 ┊ 0 ┊ ┊</div><div dir="ltr">┊ ┊ StoragePool(s): drbdpool ┊ ┊ ┊</div><div dir="ltr">┊ ┊ DisklessOnRemaining: True ┊ ┊ ┊</div><div dir="ltr">╰──────────────────────────────────────────────────────────────────╯</div></font></div><div dir="ltr"><font face="monospace"><br></font></div><div dir="ltr"><font face="monospace">And then I try to create a test resource</font></div><div dir="ltr"><font face="monospace">linstor resource create T test</font></div><div dir="ltr"><font face="monospace">SUCCESS:(...)</font></div><div dir="ltr"><font face="monospace"><br></font></div><div dir="ltr"><font face="monospace">linstor resource create H test</font></div><div dir="ltr"><font face="monospace">WARNING: Could not find suitable node to automatically create a tie breaking resource for 'test'.</font></div><div dir="ltr"><font face="monospace">SUCCESS:(...)</font></div><div dir="ltr"><font face="monospace"><br></font></div><div dir="ltr"><font face="monospace">linstor resource create C test</font></div><div dir="ltr"><font face="monospace">ERROR:Description: Satellite 'C' does not support the following layers: [DRBD]Details: Node(s): 'C', Resource: 'test'Show reports: linstor error-reports show 603F507D-00000-000005</font></div><div dir="ltr"><font face="monospace"><br></font></div><div><font face="monospace">As you can see the resource creation fails on C node. I have installed drbd on that node just in case, here goes the output:</font></div><div><font face="monospace"><div>drbdadm --version</div><div>DRBDADM_BUILDTAG=GIT-hash:\ a7820b3c14497a34f955ba5ce56cf1bc9d2d353e\ build\ by\ @buildsystem\,\ 2021-02-09\ 09:27:27</div><div>DRBDADM_API_VERSION=1</div><div>DRBD_KERNEL_VERSION_CODE=0x08040b</div><div>DRBDADM_VERSION_CODE=0x091000</div><div>DRBDADM_VERSION=9.16.0</div><div><br></div><div>Overall my C node does not have any "storage" for the drbd cluster, I just want it to be a diskless node in order to achieve HA for the resources. It seems I have misunderstood something but I just don't know where to look for more info. Any hints/help would be appreciated.</div><div><br></div><div>Regards,</div><div>Ferran</div></font></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>
_______________________________________________<br>
Star us on GITHUB: <a href="https://github.com/LINBIT" rel="noreferrer" target="_blank">https://github.com/LINBIT</a><br>
drbd-user mailing list<br>
<a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a><br>
<a href="https://lists.linbit.com/mailman/listinfo/drbd-user" rel="noreferrer" target="_blank">https://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
</blockquote></div><br clear="all"><br>-- <br><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div>Best regards,<br></div>Gabor Hernadi<br></div></div></div></div>
_______________________________________________<br>
Star us on GITHUB: <a href="https://github.com/LINBIT" rel="noreferrer" target="_blank">https://github.com/LINBIT</a><br>
drbd-user mailing list<br>
<a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a><br>
<a href="https://lists.linbit.com/mailman/listinfo/drbd-user" rel="noreferrer" target="_blank">https://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
</blockquote></div>
_______________________________________________<br>
Star us on GITHUB: <a href="https://github.com/LINBIT" rel="noreferrer" target="_blank">https://github.com/LINBIT</a><br>
drbd-user mailing list<br>
<a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a><br>
<a href="https://lists.linbit.com/mailman/listinfo/drbd-user" rel="noreferrer" target="_blank">https://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
</blockquote></div>
</blockquote></div>