<div dir="ltr">This does not seem to work for me either, I&#39;m on the latest pve and drbd9/drbdmanage versions. For me, it fails with a different kind of error though.<div>I&#39;ve executed the command on the &quot;leader&quot; node. The source vm disk is local zfs but I tried it also with a qemu raw image and had the same result.</div><div><br class="gmail-Apple-interchange-newline"><div class="gmail-x-css-shadow" id="ext-element-380" style="box-sizing:border-box;border-radius:5px;color:rgb(0,0,0);font-family:helvetica,arial,verdana,sans-serif;font-size:13px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:300;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial;width:800px;height:396px"></div><div class="gmail-x-window gmail-x-layer gmail-x-window-default gmail-x-closable gmail-x-window-closable gmail-x-window-default-closable gmail-x-border-box gmail-x-resizable gmail-x-window-resizable gmail-x-window-default-resizable" id="gmail-proxmoxTaskViewer-1328" tabindex="-1" style="box-sizing:border-box;overflow:hidden;outline:none;border-color:rgb(245,245,245);border-radius:4px;padding:0px;border-width:1px;border-style:solid;background-color:rgb(255,255,255);color:rgb(0,0,0);font-family:helvetica,arial,verdana,sans-serif;font-size:13px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:300;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial;width:800px;height:400px"><div class="gmail-x-window-header gmail-x-header gmail-x-header-draggable gmail-x-docked gmail-x-unselectable gmail-x-window-header-default gmail-x-horizontal gmail-x-window-header-horizontal gmail-x-window-header-default-horizontal gmail-x-top gmail-x-window-header-top gmail-x-window-header-default-top gmail-x-box-layout-ct" id="gmail-proxmoxTaskViewer-1328_header" tabindex="0" style="box-sizing:border-box;overflow:hidden;font-size:15px;border-color:rgb(245,245,245);background-color:rgb(245,245,245);border-radius:4px 4px 0px 0px;padding:9px;border-style:solid;width:800px;border-width:1px"><div id="gmail-proxmoxTaskViewer-1328_header-innerCt" class="gmail-x-box-inner" style="box-sizing:border-box;overflow:visible;width:780px;height:16px"><div id="gmail-proxmoxTaskViewer-1328_header-targetEl" class="gmail-x-box-target" style="box-sizing:border-box;width:780px;height:1px"><div class="gmail-x-title gmail-x-window-header-title gmail-x-window-header-title-default gmail-x-box-item gmail-x-title-default gmail-x-title-rotate-none gmail-x-title-align-left" id="gmail-proxmoxTaskViewer-1328_header-title" style="box-sizing:border-box;display:table;table-layout:fixed;text-align:left;color:rgb(21,127,204);font-size:15px;font-weight:300;font-family:helvetica,arial,verdana,sans-serif;line-height:16px;margin:0px;width:758px"><div id="gmail-proxmoxTaskViewer-1328_header-title-textEl" class="gmail-x-title-text gmail-x-title-text-default gmail-x-title-item" style="box-sizing:border-box;display:table-cell;overflow:hidden;white-space:nowrap;text-overflow:ellipsis;vertical-align:middle;padding:0px;text-transform:none">Task viewer: VM 108 - Move disk</div></div><div class="gmail-x-tool gmail-x-box-item gmail-x-tool-default gmail-x-tool-after-title" id="gmail-tool-1344" tabindex="-1" style="box-sizing:border-box;font-size:0px;line-height:0;margin:0px"><div id="gmail-tool-1344-toolEl" class="gmail-x-tool-img gmail-x-tool-close" style="box-sizing:border-box;overflow:hidden;width:16px;height:16px;background-image:url(&quot;images/tools/tool-sprites.png&quot;);margin:0px;opacity:0.8;background-position:0px 0px;background-color:rgb(245,245,245)"></div></div></div></div></div><div id="gmail-proxmoxTaskViewer-1328-body" class="gmail-x-window-body gmail-x-window-body-default gmail-x-closable gmail-x-window-body-closable gmail-x-window-body-default-closable gmail-x-window-body-default gmail-x-window-body-default-closable gmail-x-resizable gmail-x-window-body-resizable gmail-x-window-body-default-resizable" style="box-sizing:border-box;overflow:hidden;border-color:rgb(245,245,245);border-width:1px;border-style:solid;background:rgb(255,255,255);color:rgb(0,0,0);font-size:13px;font-weight:300;font-family:helvetica,arial,verdana,sans-serif;width:798px;height:363px"><div class="gmail-x-panel gmail-x-fit-item gmail-x-window-item gmail-x-panel-default" id="gmail-tabpanel-1340" style="box-sizing:border-box;overflow:hidden;outline:none;border-color:rgb(245,245,245);padding:0px;margin:0px;width:796px;height:361px"><div class="gmail-x-tab-bar gmail-x-docked gmail-x-tab-bar-default gmail-x-horizontal gmail-x-tab-bar-horizontal gmail-x-tab-bar-default-horizontal gmail-x-top gmail-x-tab-bar-top gmail-x-tab-bar-default-top gmail-x-docked-top gmail-x-tab-bar-docked-top gmail-x-tab-bar-default-docked-top" id="gmail-tabbar-1341" tabindex="0" style="box-sizing:border-box;background-color:rgb(245,245,245);width:796px;border-bottom-width:0px"><div id="gmail-tabbar-1341-body" class="gmail-x-tab-bar-body gmail-x-tab-bar-body-default gmail-x-box-layout-ct" style="box-sizing:border-box;overflow:hidden;padding:6px;min-height:36px;width:796px"><div id="gmail-tabbar-1341-innerCt" class="gmail-x-box-inner gmail-x-box-scroller-body-horizontal" style="box-sizing:border-box;overflow:hidden;width:784px;height:24px"><div id="gmail-tabbar-1341-targetEl" class="gmail-x-box-target" style="box-sizing:border-box;width:784px;height:1px"><a class="gmail-x-tab gmail-x-unselectable gmail-x-tab-active gmail-x-box-item gmail-x-tab-default gmail-x-top gmail-x-tab-top gmail-x-tab-default-top" id="gmail-tab-1342" tabindex="-1" style="box-sizing:border-box;display:block;outline:0px;white-space:nowrap;text-decoration:none;vertical-align:top;overflow:hidden;border-radius:2px;padding:3px 8px;border-width:1px;border-style:solid;background-color:rgb(56,146,212);border-color:rgb(56,146,212);margin:0px"><span id="gmail-tab-1342-btnWrap" class="gmail-x-tab-wrap gmail-x-tab-wrap-default" style="box-sizing:border-box;height:16px;width:39px;display:table"><span id="gmail-tab-1342-btnEl" class="gmail-x-tab-button gmail-x-tab-button-default gmail-x-tab-text gmail-x-tab-button-center" style="box-sizing:border-box;white-space:nowrap;line-height:0;display:table-cell;vertical-align:middle;text-align:center;height:16px"><span id="gmail-tab-1342-btnInnerEl" class="gmail-x-tab-inner gmail-x-tab-inner-default" style="box-sizing:border-box;overflow:hidden;text-overflow:ellipsis;display:inline-block;vertical-align:middle;font-style:normal;font-variant:normal;font-weight:300;font-stretch:normal;font-size:13px;line-height:16px;font-family:helvetica,arial,verdana,sans-serif;color:rgb(255,255,255);max-width:100%">Output</span></span></span></a><a class="gmail-x-tab gmail-x-unselectable gmail-x-box-item gmail-x-tab-default gmail-x-top gmail-x-tab-top gmail-x-tab-default-top" id="gmail-tab-1343" tabindex="-1" style="box-sizing:border-box;display:block;outline:0px;white-space:nowrap;text-decoration:none;vertical-align:top;overflow:hidden;border-radius:2px;padding:3px 8px;border-width:1px;border-style:solid;background-color:rgb(245,245,245);border-color:rgb(245,245,245);margin:0px"><span id="gmail-tab-1343-btnWrap" class="gmail-x-tab-wrap gmail-x-tab-wrap-default" style="box-sizing:border-box;height:16px;width:38px;display:table"><span id="gmail-tab-1343-btnEl" class="gmail-x-tab-button gmail-x-tab-button-default gmail-x-tab-text gmail-x-tab-button-center" style="box-sizing:border-box;white-space:nowrap;line-height:0;display:table-cell;vertical-align:middle;text-align:center;height:16px"><span id="gmail-tab-1343-btnInnerEl" class="gmail-x-tab-inner gmail-x-tab-inner-default" style="box-sizing:border-box;overflow:hidden;text-overflow:ellipsis;display:inline-block;vertical-align:middle;font-style:normal;font-variant:normal;font-weight:300;font-stretch:normal;font-size:13px;line-height:16px;font-family:helvetica,arial,verdana,sans-serif;color:rgb(0,0,0);max-width:100%">Status</span></span></span></a></div></div></div><div id="gmail-tabbar-1341-strip" class="gmail-x-tab-bar-strip gmail-x-tab-bar-strip-default" style="box-sizing:border-box;line-height:0;font-size:0px;width:796px"></div></div><div id="gmail-tabpanel-1340-body" class="gmail-x-panel-body gmail-x-panel-body-default gmail-x-panel-body-default" style="box-sizing:border-box;overflow:hidden;background:rgb(255,255,255);border-color:rgb(207,207,207);color:rgb(0,0,0);font-size:13px;font-weight:300;font-family:helvetica,arial,verdana,sans-serif;border-width:1px;border-style:solid;width:796px;height:325px"><div class="gmail-x-panel gmail-x-tabpanel-child gmail-x-panel-default" id="gmail-proxmoxLogView-1337" style="box-sizing:border-box;overflow:hidden;outline:none;border-color:rgb(245,245,245);padding:0px;margin:0px;width:794px;height:323px"><div class="gmail-x-toolbar gmail-x-docked gmail-x-toolbar-default gmail-x-docked-top gmail-x-toolbar-docked-top gmail-x-toolbar-default-docked-top gmail-x-box-layout-ct gmail-x-docked-noborder-top gmail-x-docked-noborder-right gmail-x-docked-noborder-left" id="gmail-toolbar-1339" style="box-sizing:border-box;overflow:hidden;border-width:1px;padding:6px 0px 6px 8px;border-style:solid;border-color:rgb(207,207,207);background-image:none;background-color:rgb(255,255,255);width:794px"><div id="gmail-toolbar-1339-innerCt" class="gmail-x-box-inner" style="box-sizing:border-box;overflow:hidden;width:786px;height:24px"><div id="gmail-toolbar-1339-targetEl" class="gmail-x-box-target" style="box-sizing:border-box;width:786px;height:1px"><a class="gmail-x-btn gmail-x-unselectable gmail-x-box-item gmail-x-toolbar-item gmail-x-btn-default-toolbar-small gmail-x-item-disabled gmail-x-btn-disabled" id="gmail-button-1330" style="box-sizing:border-box;display:inline-block;outline:0px;white-space:nowrap;text-decoration:none;vertical-align:top;overflow:hidden;border-radius:3px;padding:3px;border-width:1px;border-style:solid;background-color:rgb(245,245,245);border-color:rgb(216,216,216);opacity:0.5;margin:0px;background-image:none"><span id="gmail-button-1330-btnWrap" class="gmail-x-btn-wrap gmail-x-btn-wrap-default-toolbar-small" style="box-sizing:border-box;height:16px;width:35px;display:flex"><span id="gmail-button-1330-btnEl" class="gmail-x-btn-button gmail-x-btn-button-default-toolbar-small gmail-x-btn-text gmail-x-btn-button-center" style="box-sizing:border-box;white-space:nowrap;line-height:0;display:flex;min-width:0px;text-align:center;min-height:16px"><span id="gmail-button-1330-btnInnerEl" class="gmail-x-btn-inner gmail-x-btn-inner-default-toolbar-small" style="box-sizing:border-box;overflow:hidden;text-overflow:ellipsis;display:block;font-style:normal;font-variant:normal;font-weight:300;font-stretch:normal;font-size:12px;line-height:16px;font-family:helvetica,arial,verdana,sans-serif;color:rgb(0,0,0);padding:0px 5px;max-width:100%">Stop</span></span></span></a></div></div></div><div id="gmail-proxmoxLogView-1337-body" class="gmail-x-panel-body gmail-x-panel-body-default gmail-x-panel-body-default gmail-x-docked-noborder-right gmail-x-docked-noborder-bottom gmail-x-docked-noborder-left" style="box-sizing:border-box;border-width:1px;overflow:auto;background:rgb(255,255,255);border-color:rgb(207,207,207);color:rgb(0,0,0);font-size:13px;font-weight:300;font-family:helvetica,arial,verdana,sans-serif;border-style:solid;padding:0px;width:794px;height:287px"><div id="gmail-proxmoxLogView-1337-outerCt" class="gmail-x-autocontainer-outerCt" style="box-sizing:border-box;display:table;width:1000px;height:298px"><div id="gmail-proxmoxLogView-1337-innerCt" class="gmail-x-autocontainer-innerCt" style="box-sizing:border-box;display:table-cell;height:298px;vertical-align:top;padding:5px"><div class="gmail-x-component gmail-x-component-default" id="gmail-component-1338" style="box-sizing:border-box;font-style:normal;font-variant:normal;font-weight:normal;font-stretch:normal;font-size:11px;font-family:tahoma,arial,verdana,sans-serif;line-height:16px;white-space:pre;padding-top:0px;height:288px">create full clone of drive scsi1 (local-zfs:vm-108-disk-2)<br style="box-sizing:border-box">pong<br style="box-sizing:border-box">Operation completed successfully<br style="box-sizing:border-box">Operation completed successfully<br style="box-sizing:border-box">pong<br style="box-sizing:border-box">Operation completed successfully<br style="box-sizing:border-box">Operation completed successfully<br style="box-sizing:border-box">pong<br style="box-sizing:border-box">Operation completed successfully<br style="box-sizing:border-box">pong<br style="box-sizing:border-box">Operation completed successfully<br style="box-sizing:border-box">Operation completed successfully<br style="box-sizing:border-box">transferred: 0 bytes remaining: 34359738368 bytes total: 34359738368 bytes progression: 0.00 %<br style="box-sizing:border-box">qemu-img: Could not open &#39;/dev/drbd/by-res/vm-108-disk-1/0&#39;: Could not open &#39;/dev/drbd/by-res/vm-108-disk-1/0&#39;: No such file or directory<br style="box-sizing:border-box">pong<br style="box-sizing:border-box">Operation completed successfully<br style="box-sizing:border-box">Operation completed successfully<br style="box-sizing:border-box">TASK ERROR: storage migration failed: copy failed: command &#39;/usr/bin/qemu-img convert -p -n -T none -f raw -O raw /dev/zvol/rpool/data/vm-108-disk-2 /dev/drbd/by-res/vm-108-disk-1/0&#39; failed: exit code 1</div></div></div></div></div></div></div></div></div><br></div><div><br></div><br><div class="gmail_quote"><div dir="ltr">On Wed, Jun 6, 2018 at 8:30 AM Roland Kammerer &lt;<a href="mailto:roland.kammerer@linbit.com">roland.kammerer@linbit.com</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On Tue, Jun 05, 2018 at 03:46:10PM +0200, Christophe NOUVEL wrote:<br>
&gt; Hi all,<br>
&gt; <br>
&gt; Our new 2 nodes proxmox cluster (PVE 5.2) + drbd9 (Linbit repository) works<br>
&gt; fine.<br>
&gt; <br>
&gt; But when we try to move an existing disk, from an external USB hard drive<br>
&gt; to DRB storage, we have :<br>
&gt; <br>
&gt; create full clone of drive ide1 (local-lvm:vm-107-disk-1)<br>
&gt; pong<br>
&gt; Operation completed successfully<br>
&gt; Operation completed successfully<br>
&gt; pong<br>
&gt; Operation completed successfully<br>
&gt; &quot;.&quot; is not a valid unit!<br>
&gt; usage: drbdmanage add-volume [-h] [-m MINOR] [-d DEPLOY] [-s SITE] name size<br>
&gt; ...<br>
&gt; Valid units: pib,gb,kib,kb,g,mb,k,mib,m,pb,p,t,tb,tib,gib<br>
&gt; pong<br>
&gt; Operation completed successfully<br>
&gt; pong<br>
&gt; Operation completed successfully<br>
&gt; Operation completed successfully<br>
&gt; drive mirror is starting for drive-ide1<br>
&gt; drive-ide1: Cancelling block job<br>
&gt; drive-ide1: Done.<br>
&gt; pong<br>
&gt; Operation completed successfully<br>
&gt; Operation completed successfully<br>
&gt; TASK ERROR: storage migration failed: mirroring error: VM 107 qmp command<br>
&gt; &#39;drive-mirror&#39; failed - Could not open &#39;/dev/drbd/by-res/vm-107-disk-3/0&#39;:<br>
&gt; No such file or directory<br>
&gt; <br>
&gt; We found a similar problem here :<br>
&gt; <a href="http://lists.linbit.com/pipermail/drbd-user/2017-September/023679.html" rel="noreferrer" target="_blank">http://lists.linbit.com/pipermail/drbd-user/2017-September/023679.html</a><br>
&gt; <br>
&gt; And tried to patch /usr/share/perl5/PVE/Storage/Custom/DRBDplugin.pm, but<br>
&gt; nothing changed...<br>
&gt; I even tried to hide this file, and nothing changes again??<br>
<br>
1. Don&#39;t manually patch something<br>
2. To me that looks like a bug that got fixed by now probably more than<br>
a year ago, IIRC. Back then the bug was that this &quot;debug output&quot;<br>
including &#39;.&#39; was printend on stdout, and then got mixed into other<br>
commands.<br>
<br>
So my best guess is you are using very very outdated versions.<br>
<br>
dpkg -l | grep drbd # would help<br>
<br>
Regards, rck<br>
_______________________________________________<br>
drbd-user mailing list<br>
<a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a><br>
<a href="http://lists.linbit.com/mailman/listinfo/drbd-user" rel="noreferrer" target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
</blockquote></div></div>