<div><div dir="auto">I would test it first without proxmox gui. That is, by creating a test resource and volume definition via linstor command. Then after, I would create a test resource based on the above and assign that resource to each node. </div><div dir="auto"><br></div><div dir="auto">If your configuration is correct, then the resource should become diskful on one node and diskless on the rest. You can use drbdtop or drbdadm command to verify the above.</div></div><div dir="auto"><br></div><div dir="auto">Regarding why proxmox gui is not showing stuff correctly when you add the entries in storage.cfg, it may be a syntax error somewhere in that file or you may have to check syslog over cli to see why it doesn't like it.</div><div dir="auto"><br></div><div dir="auto">G.</div><div dir="auto"><br></div><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, 27 Jan 2020 at 06:47, Rob Tongue <<a href="mailto:phunyguy@neverserio.us">phunyguy@neverserio.us</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Greetings!<br>
<br>
I have been trying for some time to solve this, hopefully someone here <br>
can help. I currently have a working three node proxmox/drbd/linstor <br>
cluster, but have an interesting use case in addition that I cannot seem <br>
to make work.<br>
<br>
One of the 3 nodes has a large amount of spinning disks that I would <br>
like to use throughout the cluster as well, but I have no way to <br>
replicate that storage to the other two. So I want to use two of the <br>
three nodes as "diskless" clients, while only the one node provides <br>
actual storage. I do not care about redundancy for this storage <br>
instance, I only want to be able to mount the storage from any node, <br>
mainly because the two without the storage are more powerful machines as <br>
far as CPU and memory are concerned, but do not have the ability to host <br>
the actual storage. I understand it is not ideal, but in this home lab, <br>
it is all I have.<br>
<br>
I could use NFS for this, but would rather use drbd, as I am fairly <br>
certain it would perform better due to the nature of the raw storage, <br>
rather than qcow2 images.<br>
<br>
So here is what I have tried:<br>
<br>
I have created as a test, a small lvm thinpool as a storage-pool on node1<br>
<br>
# linstor storage-pool create lvmthin tank1 test test/pve<br>
<br>
Then I created on tank2/tank3 diskless storage-pools.<br>
<br>
# linstor storage-pool create diskless tank2 test<br>
# linstor storage-pool create diskless tank3 test<br>
<br>
This is the result:<br>
<br>
# linstor storage-pool list<br>
┊ StoragePool ┊ Node ┊ Driver ┊ PoolName ┊ FreeCapacity ┊ <br>
TotalCapacity ┊ SupportsSnapshots ┊ State ┊<br>
╞═══════════════════════════════════════════════════════════════════════════════════════════════════════════╡<br>
<br>
*snip*<br>
<br>
<br>
┊ test ┊ tank1 ┊ LVM_THIN ┊ test/pve ┊ 4.98 GiB ┊ 4.98 <br>
GiB ┊ True ┊ Ok ┊<br>
┊ test ┊ tank2 ┊ DISKLESS ┊ ┊ ┊ ┊ <br>
False ┊ Ok ┊<br>
┊ test ┊ tank3 ┊ DISKLESS ┊ ┊ ┊ ┊ <br>
False ┊ Ok ┊<br>
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────╯<br>
<br>
I then created the resource group:<br>
<br>
# linstor resource-group create --storage-pool test --place-count 1 <br>
--diskless-on-remaining test<br>
<br>
(For clarity, I am not sure what to put for --place-count, so I tried 3 <br>
as well with the same result. I also tried without <br>
--diskless-on-remaining... same.)<br>
<br>
Then I finally created the volume-group<br>
<br>
# linstor volume-group create test<br>
<br>
When adding this storage to proxmox's storage.cfg, I lose the web <br>
interface of proxmox, and refreshing the page only provides the <br>
Datacenter top level section in the left pane, with nothing underneath <br>
it. No nodes or anything. Removing the storage.cfg entries, makes it <br>
all come back. Very strange, and want to verify I did everything correctly.<br>
<br>
drbd: test<br>
content images,rootdir<br>
controller 10.128.1.100<br>
resourcegroup test<br>
controllervm 100<br>
<br>
Any ideas? Thanks in advance.<br>
<br>
-phunyguy<br>
<br>
_______________________________________________<br>
Star us on GITHUB: <a href="https://github.com/LINBIT" rel="noreferrer" target="_blank">https://github.com/LINBIT</a><br>
drbd-user mailing list<br>
<a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a><br>
<a href="https://lists.linbit.com/mailman/listinfo/drbd-user" rel="noreferrer" target="_blank">https://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
</blockquote></div></div>