<div dir="ltr"><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Mar 28, 2019 at 7:07 AM Nicholas Morton <<a href="mailto:kmorton@cancinc.com">kmorton@cancinc.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">I am using Linstor to manage DRBD volumes on a 4 node Proxmox cluster and I<br>
am having an issue during node reboots.<br>
After a reboot the node is usually missing some of the .res files in<br>
/var/lib/linstor.d<br>
For whatever reason they aren't being repopulated correctly.<br>
I have a few times manually recreated the .res files but with so many<br>
resources this is arduous.<br>
<br>
Does Linstor have an export function to write out the .res files?<br>
I remember drbdmanage having a feature that did that, it had a similar<br>
problem.<br>
<br>
It could be something simple I missed, but I haven't found it in the hours<br>
I've put in.<br>
I have a 7 storage pool setup, 3 NVMe, 3 SSD, 1 HDD, with 27 drbd resources<br>
spread across 22 VMs.<br>
<br>
All nodes have the same package versions.<br>
----------------<br>
Kernel Version: Linux 4.15.18-11-pve #1 SMP PVE 4.15.18-34 (Mon, 25 Feb 2019<br>
14:51:06 +0100)<br>
PVE Manager Version: pve-manager/5.3-11/d4907f84<br>
<br>
cat /proc/drbd<br>
version: 9.0.16-1 (api:2/proto:86-114)<br>
GIT-hash: ab9777dfeaf9d619acc9a5201bfcae8103e9529c build by root@vmhost1,<br>
2019-03-13 15:28:08<br>
Transports (api:16): tcp (9.0.16-1)<br>
<br>
drbdadm<br>
Version: 9.8.0 (api:2)<br>
GIT-hash: c30216b49330216bf8a567b7727da6e24f099f08 build by<br>
@buildsystem.linbit, 2019-01-16 12:50:14<br>
<br>
linstor 0.7.3; GIT-hash: b99bcbba16e98b0c55d695795deebfafeef93636<br>
<br>
LINSTOR ==> c version<br>
linstor controller 0.7.5; GIT-hash: d74305b420fdc878182afa162378a317e6a4a3b9<br>
<br>
<br>
<br>
_______________________________________________<br>
drbd-user mailing list<br>
<a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a><br>
<a href="http://lists.linbit.com/mailman/listinfo/drbd-user" rel="noreferrer" target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
</blockquote></div><br clear="all"><div><br></div><div>Hello,</div><div><br></div><div>Linstor basically only deletes its own .res files (within /var/lib/linstor.d/*.res) when the satellite starts (that is to make sure to clean up possibly already removed / lost resources). Usually that is not an issue, because as soon as the controller connects to the satellite, the satellite receives all information needed to regenerate the corresponding .res files. <br></div><div><br></div><div>If your .res files are (still) missing, then I guess the satellite was able to start up (as apparently it was able to delete the .res files) but the controller failed to connect and therefor the satellite did not receive the information needed for the regeneration. That could be because of a version missmatch, or something else. Check the `linstor node list` or something "new" in `linstor err list` where error reports can be viewed with `linstor err show <error-report-id>`</div><div><br></div><div>If you need those .res files for whatever reason before the controller is able to connect the the satellite, you will have to modify the service file starting the satellite and add a `--keep-res "your regex here"`. Every full path like "/var/lib/linstor.d/resource_name.res" that matches your regular expression will not be deleted on startup.<br></div><div><br></div><div>Hope that helps.</div><div>Regards,</div><div>Gabor<br></div></div>