<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Sep 6, 2016 at 12:49 AM, Jean-Daniel TISSOT <span dir="ltr"><<a href="mailto:Jean-Daniel.Tissot@univ-fcomte.fr" target="_blank">Jean-Daniel.Tissot@univ-fcomte.fr</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<p><font size="-1">Hi again,</font></p>
<p><font size="-1">In fact there is other problems, when I migrate a
VM on another node, it's fail with this error message :</font></p>
<p><font size="-1">sept. 05 16:26:32 starting migration of VM 100 to
node 'dmz-pve2' (192.168.0.20)<br>
sept. 05 16:26:32 copying disk images<br>
sept. 05 16:26:32 starting VM 100 on remote node 'dmz-pve2'<br>
sept. 05 16:26:34 start failed: command '/usr/bin/kvm -id 100
-chardev
'socket,id=qmp,path=/var/run/<wbr>qemu-server/100.qmp,server,<wbr>nowait'
-mon 'chardev=qmp,mode=control' -pidfile
/var/run/qemu-server/100.pid -daemonize -smbios
'type=1,uuid=644673aa-fb7e-<wbr>4b11-9fa3-2f3ec9098235' -name vm100
-smp '4,sockets=2,cores=2,maxcpus=<wbr>4' -nodefaults -boot
'menu=on,strict=on,reboot-<wbr>timeout=1000' -vga cirrus -vnc
unix:/var/run/qemu-server/100.<wbr>vnc,x509,password -cpu
kvm64,+lahf_lm,+sep,+kvm_pv_<wbr>unhalt,+kvm_pv_eoi,enforce -m 4096
-k fr -device
'pci-bridge,id=pci.2,chassis_<wbr>nr=2,bus=pci.0,addr=0x1f' -device
'pci-bridge,id=pci.1,chassis_<wbr>nr=1,bus=pci.0,addr=0x1e' -device
'piix3-usb-uhci,id=uhci,bus=<wbr>pci.0,addr=0x1.0x2' -device
'usb-tablet,id=tablet,bus=<wbr>uhci.0,port=1' -device
'virtio-balloon-pci,id=<wbr>balloon0,bus=pci.0,addr=0x3' -iscsi
'initiator-name=iqn.1993-08.<wbr>org.debian:01:96495c6512a9' -drive
'if=none,id=drive-ide2,media=<wbr>cdrom,aio=threads' -device
'ide-cd,bus=ide.1,unit=0,<wbr>drive=drive-ide2,id=ide2,<wbr>bootindex=200'
-drive
'file=/dev/drbd/by-res/vm-100-<wbr>disk-2/0,if=none,id=drive-<wbr>virtio0,cache=writethrough,<wbr>format=raw,aio=threads,detect-<wbr>zeroes=on'
-device
'virtio-blk-pci,drive=drive-<wbr>virtio0,id=virtio0,bus=pci.0,<wbr>addr=0xa,bootindex=100'
-netdev
'type=tap,id=net0,ifname=<wbr>tap100i0,script=/var/lib/qemu-<wbr>server/pve-bridge,downscript=/<wbr>var/lib/qemu-server/pve-<wbr>bridgedown,vhost=on'
-device
'virtio-net-pci,mac=B6:35:60:<wbr>34:BD:DD,netdev=net0,bus=pci.<wbr>0,addr=0x12,id=net0,bootindex=<wbr>300'
-machine 'type=pc-i440fx-2.6' -incoming
unix:/run/qemu-server/100.<wbr>migrate -S' failed: exit code 1<br>
sept. 05 16:26:34 ERROR: online migrate failure - command
'/usr/bin/ssh -o 'BatchMode=yes' <a href="mailto:root@192.168.0.20" target="_blank">root@192.168.0.20</a> qm start 100
--skiplock --migratedfrom dmz-pve3 --stateuri unix --machine
pc-i440fx-2.6' failed: exit code 255<br>
sept. 05 16:26:34 aborting phase 2 - cleanup resources<br>
sept. 05 16:26:34 migrate_cancel<br>
sept. 05 16:26:34 ERROR: migration finished with problems
(duration 00:00:02)<br>
TASK ERROR: migration problems</font></p>
<p><font size="-1">Proxmox search for </font><font size="-1">/dev/drbd/by-res/vm-100-disk-<wbr>2/0
which is not present (/dev/drbdpool/vm-100-disk-2_<wbr>00 exist).<br></font></p></div></blockquote><div><br></div><div>AFAIK, you need to create a LVM from the DRBD device under Datacenter -> Storage in the PVE UI, have the "shared" check box ticked and have the nodes (all or some, its up to you how do you want to organize your migration cluster) selected in the drop down menu if you want support for live migration. Then you need to add the VM to the HA under Datacenter as well and only then the VM will be eligible for migration.<br><br></div><div>If you go with "one DRBD device per VM" approach, it means that you need to create a LVM for each DRBD backed VM you create which, unless some kind of automation used, might become heavy task. It is much easier to create a single LVM VG on top of one large DRBD device and than just create VM's on that storage the same way you would do in case of local storage.<br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div bgcolor="#FFFFFF" text="#000000"><p><font size="-1">
If I do:</font></p>
<p><font size="-1">mkdir </font><font size="-1">/dev/drbd/by-res/vm-100-disk-2<br>
cd </font><font size="-1"><font size="-1">/dev/drbd/by-res/vm-100-disk-2<br>
ln -s ../../../drbd101 0</font></font></p>
<p><font size="-1"><font size="-1">My virtual machine can start.<br>
How to have </font></font><font size="-1"><font size="-1">/dev/drbd/by-res
automatically filled by resources for all VMs ?</font></font></p>
<p><font size="-1"><font size="-1">PS : I do some apt-get purge `
deborphan --guess-all ` (until nothing need to be purged) on
all Proxmox nodes as I do for all my Debian servers.<br>
</font></font></p>
<p><font size="-1">Thanks in advance.</font><br>
</p><div><div class="h5">
<br>
<div>Le 05/09/2016 à 12:53, Jean-Daniel
TISSOT a écrit :<br>
</div>
<blockquote type="cite">
<p><font size="-1">Hi Robert,</font></p>
<p><font size="-1">Thanks a lot. This export solve my problem. A
drbdadm adjust all and after a drbdadm status show me good
results.</font><br>
</p>
<br>
<div>Le 05/09/2016 à 11:54, Robert
Altnoeder a écrit :<br>
</div>
<blockquote type="cite">
<div>On 09/02/2016 06:05 PM, Jean-Daniel
TISSOT wrote:<br>
</div>
<blockquote type="cite">
<font size="-1">Hi list,<br>
<br>
I remark i have a file
/var/lib/drbd.d/drbdmanage_vm-<wbr>100-disk-2.res [...]<br>
If i reboot a node, this file disappear on this node [...]</font><font size="-1"><br>
</font></blockquote>
<blockquote type="cite"><font size="-1">[...] if i do drbdadm connect
vm-100-disk-2 i receive :<br>
'vm-100-disk-2' not defined in your config (for this host).<br>
</font><br>
</blockquote>
The DRBD resources on ProxMox with DRBD9 are managed by
drbdmanage instead of just by drbdadm.<br>
You can run:<br>
drbdmanage export vm-100-disk-2<br>
which will recreate the configuration file in /var/lib/drbd.d
for use with drbdadm<br>
<br>
This command will also implicitly start the drbdmanage server if
it is not yet started (otherwise, drbdmanage startup can be used
to start the drbdmanage server, which also starts all resources
managed by drbdmanage).<br>
<br>
Apart from that, since the resource appears to be running, but
is marked as Outdated and StandAlone, there might also be
something wrong with the resource itself. If the resource does
not reconnect/resync after a 'drbdadm adjust' command, the
system log should be checked for messages regarding the state of
that resource (such as e.g. a split-brain alert)<br>
<br>
<div>-- <br>
Robert Altnoeder<br>
DRBD - Corosync - Pacemaker<br>
<a href="tel:43181782920" style="color:#000000;text-decoration:none" target="_blank">+43 (1) 817 82
92 - 0</a><br>
<a href="mailto:robert.altnoeder@linbit.com" style="color:#000000;text-decoration:none" target="_blank">robert.altnoeder@linbit.com</a><br>
<p>DRBD® and LINBIT® are registered trademarks of LINBIT,
Austria.</p>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>______________________________<wbr>_________________
drbd-user mailing list
<a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a>
<a href="http://lists.linbit.com/mailman/listinfo/drbd-user" target="_blank">http://lists.linbit.com/<wbr>mailman/listinfo/drbd-user</a>
</pre>
</blockquote>
<br>
<div>-- <br>
Bien cordialement, <a href="http://chrono-environnement.univ-fcomte.fr/spip.php?article457" target="_blank">Jean-Daniel
TISSOT</a><br>
Administrateur Systèmes et Réseaux<br>
Tel: +33 3 81 666 440 Fax: +33 3 81 666 568<br>
<br>
<a href="http://chrono-environnement.univ-fcomte.fr/" target="_blank">Laboratoire
Chrono-environnement</a><br>
16, Route de Gray<br>
25030 BESANÇON Cédex<br>
<br>
<a href="https://mapsengine.google.com/map/viewer?mid=zjsxW4ZzZPLY.kp2qPHUBD45c" target="_blank">Plan
et Accès</a> </div>
</blockquote>
<br>
<div>-- <br>
Bien cordialement, <a href="http://chrono-environnement.univ-fcomte.fr/spip.php?article457" target="_blank">Jean-Daniel
TISSOT</a><br>
Administrateur Systèmes et Réseaux<br>
Tel: +33 3 81 666 440 Fax: +33 3 81 666 568<br>
<br>
<a href="http://chrono-environnement.univ-fcomte.fr/" target="_blank">Laboratoire
Chrono-environnement</a><br>
16, Route de Gray<br>
25030 BESANÇON Cédex<br>
<br>
<a href="https://mapsengine.google.com/map/viewer?mid=zjsxW4ZzZPLY.kp2qPHUBD45c" target="_blank">Plan
et Accès</a>
</div>
</div></div></div>
<br>______________________________<wbr>_________________<br>
drbd-user mailing list<br>
<a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a><br>
<a href="http://lists.linbit.com/mailman/listinfo/drbd-user" rel="noreferrer" target="_blank">http://lists.linbit.com/<wbr>mailman/listinfo/drbd-user</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><font face="arial, helvetica, sans-serif"><span style="color:rgb(0,176,240);font-size:10pt">Igor Cicimov </span><span style="font-size:10pt"><font color="#999999">|</font></span><span style="color:rgb(0,176,240);font-size:10pt"> DevOps<br></span></font><div>
<font color="#00b0f0" face="arial, helvetica, sans-serif"><br></font><div><div><font color="#00b0f0" face="arial, helvetica, sans-serif"><img src="https://docs.google.com/uc?export=download&id=0B7WaFrYzRSehSWUtN0FieHppVGs&revid=0B7WaFrYzRSehYldDVmJlV0JhUUdXOUl3Mm5FRzlsb1JacS9FPQ"><br></font><div><div>
<p><font face="arial, helvetica, sans-serif"><b><span style="color:rgb(0,112,192)"><span></span><span></span></span></b><span style="color:rgb(0,112,192)" lang="EN-US"></span></font></p><p><font face="arial, helvetica, sans-serif"><span style="font-size:10pt;color:rgb(0,176,240)">p. </span><span style="font-size:10pt" lang="EN-US"><a><font color="#666666">+61 (0) 433 078 728</font></a><br>
</span><span style="font-size:10pt;color:rgb(0,176,240)" lang="EN-US">e. </span><span style="font-size:10pt" lang="EN-US"><a href="http://encompasscorporation.com/" target="_blank"><font color="#666666">igorc@encompasscorporation.com</font></a><br>
</span><span style="font-size:10pt;color:rgb(0,176,240)" lang="EN-US">w<b>.</b> <a href="http://www.encompasscorporation.com" target="_blank">www.encompasscorporation.com</a></span><span style="font-size:10pt" lang="EN-US"><br>
</span><span style="font-size:10pt;color:rgb(0,176,240)" lang="EN-US">a. </span><span style="font-size:10pt" lang="EN-US"><font color="#666666">Level 4, 65 York Street, Sydney 2000</font></span></font></p></div></div></div></div></div></div></div></div></div></div></div>
</div></div>