<div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>Not really clear to me but no we&#39;re not using an SSD.</div><div><br></div><div>(I&#39;m not an expert on LVM so bear with me)</div>Are you saying that I would add some of the new PV to the existing LV so it can be utilized and then perform a pvmove later?<div>If I&#39;m using part of the new PV as part of the LV how would I ensure that it&#39;s not overwritten when performing the pvmove later?</div><div><br></div><div>Here are my scenarios below maybe you can add what you&#39;re thinking into it and it will make more sense to me.</div><div><br></div><div>Original Scenario:</div><div>DISK_1   2TB<br>pvcreate /dev/sdd<br></div><div>vgcreate vg01 /dev/sdd<br></div><div>lvcreate -n 01lv -l 100%FREE vg01<br></div><div>Device: /dev/vg01/01lv<br></div><div># drbd setup</div><div>drbdadm create-md clusterdb<br></div><div>drbdadm up clusterdb<br></div><div>drbdadm primary --force clusterdb<br></div><div>mkfs.ext4 /dev/drbd0<br></div><div>mkdir /01<br></div><div>mount /dev/drbd0 /01<br></div><div><br></div><div>RESIZE (ONLINE) - really slow currently takes over 20hours for the migration, final outcome is that we have only one Physical disk after the move</div><div>DISK_2   3TB</div><div>pvcreate /dev/sde</div><div><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px">vgextend vg01 /dev/sde</span><br></div><div><font color="#333333" face="Arial, sans-serif"><span style="font-size:14px">pvmove /dev/sdd /dev/sde</span></font><br></div><div><font color="#333333" face="Arial, sans-serif"><div><span style="font-size:14px">vgreduce vg01 /dev/sdd</span></div><div><span style="font-size:14px">pvremove /dev/sdd</span></div><div style="font-size:14px">lvextend -l +100%FREE /dev/vg01/01lv<br></div></font></div><div><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px">drbdadm -- --assume-clean resize </span>clusterdb<br></div><div><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px">resize2fs /dev/drbd0</span><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px"><br></span></div><div><br></div><div>RESIZE (OFFLINE) - attempted so far</div><div>umount /u01<br></div><div><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px">drbdadm down clusterdb</span><br></div><div><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px">drbdadm dump-md clusterdb &gt; /tmp/metadata</span><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px"><br></span></div><div><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px">... receive error here, unable to move past</span></div><div><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px"><br></span></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><br><div class="gmail_quote"><div dir="ltr">On Thu, Dec 6, 2018 at 4:47 PM Adam Goryachev &lt;<a href="mailto:mailinglists@websitemanagers.com.au">mailinglists@websitemanagers.com.au</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
  
    
  
  <div text="#000000" bgcolor="#FFFFFF">
    <div class="m_3101535479746416947moz-cite-prefix">On 7/12/18 9:44 am, G C wrote:<br>
    </div>
    <blockquote type="cite">
      
      <div dir="ltr">Correct we&#39;re adding a new physical device with
        larger capacity then using pvmove to relocate to new device,
        etc...
        <div><br>
        </div>
        <div>The problem is that it takes a long time to complete the
          pvmove and it out of space on the original device (hence the
          move) we wouldn&#39;t be able to use the system until the
          migration was completed.</div>
        <div><br>
        </div>
      </div>
    </blockquote>
    <p><br>
    </p>
    <p>I am pretty sure you could just allocate space from the new PV to
      the existing LV, that way, the LV will span both the old PV and
      the new PV. If you are using SSD storage, then this won&#39;t matter,
      if you are using spinning disks, then you might want to
      specifically allocate blocks from the new PV in the physical
      position where it will end up when finished, and then when you do
      the pvmove later, it will be contiguous with the old and new data
      all on the new PV.</p>
    <p>Does that make sense?</p>
    <p>Regards,<br>
      Adam<br>
    </p>
    <p><br>
    </p>
    <blockquote type="cite"><br>
      <div class="gmail_quote">
        <div dir="ltr">On Thu, Dec 6, 2018 at 4:35 PM Adam Goryachev
          &lt;<a href="mailto:mailinglists@websitemanagers.com.au" target="_blank">mailinglists@websitemanagers.com.au</a>&gt;
          wrote:<br>
        </div>
        <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
          <div text="#000000" bgcolor="#FFFFFF">
            <div class="m_3101535479746416947m_-7460380869597852741moz-cite-prefix">On
              7/12/18 9:30 am, G C wrote:<br>
            </div>
            <blockquote type="cite">
              <div dir="ltr">
                <div>Thank you for your response.</div>
                <div><br>
                </div>
                In our scenario we&#39;re limited to a single PV on the LVM
                and while online does work it takes a long time for the
                pvmove to complete from say 2TB to a 3TB PV.
                <div><br>
                </div>
                <div>We&#39;re trying the offline in hopes that it would
                  speed things up a lot.</div>
              </div>
            </blockquote>
            <p>Sorry, I still don&#39;t understand. If you have a single PV,
              what are you using pvmove for?</p>
            <p>In my scenario, I use lvextend and then drbdadm resize.</p>
            <p>Or do you mean you are adding additional physical devices
              with larger capacity, and then using pvmove to relocate to
              the new device, and then using lvextend to increase the
              size, and then drbdadm resize? and instead you are
              planning to drbdadm down &lt;resource&gt; and then fiddle
              with the underlying devices, and then drbdadm up ?</p>
            <p>Is the problem that pvmove takes a long time to complete,
              or that it affects performance too much during the move?
              Just curious...</p>
            <p>Regards,<br>
              Adam<br>
            </p>
            <p><br>
            </p>
            <blockquote type="cite"><br>
              <div class="gmail_quote">
                <div dir="ltr">On Thu, Dec 6, 2018 at 4:26 PM Adam
                  Goryachev &lt;<a href="mailto:mailinglists@websitemanagers.com.au" target="_blank">mailinglists@websitemanagers.com.au</a>&gt;
                  wrote:<br>
                </div>
                <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                  <div text="#000000" bgcolor="#FFFFFF"> <br>
                    <div class="m_3101535479746416947m_-7460380869597852741m_6422385764702612165moz-cite-prefix">On
                      7/12/18 8:54 am, G C wrote:<br>
                    </div>
                    <blockquote type="cite">
                      <div dir="ltr">
                        <div dir="ltr">
                          <div dir="ltr">
                            <div dir="ltr">
                              <div dir="ltr">
                                <div dir="ltr">Version: </div>
                                <div dir="ltr">drbd84-utils.x86_64   
                                   8.9.2-1.0.1.el7<br>
                                </div>
                                <div dir="ltr"><br>
                                </div>
                                <div>
                                  <div>cat /proc/drbd</div>
                                  <div>version: 8.4.10
                                    (api:1/proto:86-101)</div>
                                  <div>srcversion:
                                    75EFA3DCEBEF5C771A0FCFC</div>
                                </div>
                                <div><br>
                                </div>
                                <div>Following instructions located here
                                  for offline with internal metadata</div>
                                <div><a href="https://docs.linbit.com/docs/users-guide-8.4/#s-resizing" target="_blank">https://docs.linbit.com/docs/users-guide-8.4/#s-resizing</a><br>
                                </div>
                                <div>I always get this error, I&#39;ve found
                                  several issues that are similar but
                                  haven&#39;t found anyway to get past this
                                  issue.</div>
                                <div>Architecture</div>
                                <div>LVM &gt; DRBD</div>
                                <div><br>
                                </div>
                                <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
                                  <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">#
                                    drbdadm down &lt;resource&gt;</blockquote>
                                  <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">#
                                    drbdadm dump-md clusterdb &gt;
                                    /tmp/metadata</blockquote>
                                  <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Found
                                    meta data is &quot;unclean&quot;, please
                                    apply-al first</blockquote>
                                  <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Command
                                    &#39;drbdmeta 0 v08 /dev/drbd/clusterdb
                                    internal dump-md&#39; terminated with
                                    exit code 255</blockquote>
                                </blockquote>
                              </div>
                            </div>
                          </div>
                        </div>
                      </div>
                      <br>
                    </blockquote>
                    <div class="m_3101535479746416947m_-7460380869597852741m_6422385764702612165moz-cite-prefix"><br>
                    </div>
                    <div class="m_3101535479746416947m_-7460380869597852741m_6422385764702612165moz-cite-prefix">Out
                      of interest, why do you need to use offline
                      resize? I always have used the online resize with
                      no issues (LVM underneath). Simply increase the LV
                      (on both nodes) and then issue a &quot;drbdadm resize
                      &lt;resource&gt;&quot; command.</div>
                    <div class="m_3101535479746416947m_-7460380869597852741m_6422385764702612165moz-cite-prefix"><br>
                    </div>
                    <div class="m_3101535479746416947m_-7460380869597852741m_6422385764702612165moz-cite-prefix">Not
                      sure if that helps, or if you have a reason for
                      using offline resize, maybe someone else can
                      assist with that.<br>
                    </div>
                    <div class="m_3101535479746416947m_-7460380869597852741m_6422385764702612165moz-cite-prefix"><br>
                    </div>
                    <div class="m_3101535479746416947m_-7460380869597852741m_6422385764702612165moz-cite-prefix">PS,
                      using 8.4.x versions.<br>
                    </div>
                    <div class="m_3101535479746416947m_-7460380869597852741m_6422385764702612165moz-cite-prefix"><br>
                    </div>
                    <div class="m_3101535479746416947m_-7460380869597852741m_6422385764702612165moz-cite-prefix">Regards,</div>
                    <div class="m_3101535479746416947m_-7460380869597852741m_6422385764702612165moz-cite-prefix">Adam<br>
                    </div>
                    <div class="m_3101535479746416947m_-7460380869597852741m_6422385764702612165moz-cite-prefix"><br>
                    </div>
                    <div class="m_3101535479746416947m_-7460380869597852741m_6422385764702612165moz-signature">--
                      <br>
                      Adam Goryachev Website Managers <a class="m_3101535479746416947m_-7460380869597852741m_6422385764702612165moz-txt-link-abbreviated" href="http://www.websitemanagers.com.au" target="_blank">www.websitemanagers.com.au</a></div>
                    <div><br>
                      <span>-- The information in this e-mail is
                        confidential and may be legally privileged. It
                        is intended solely for the addressee. Access to
                        this e-mail by anyone else is unauthorised. If
                        you are not the intended recipient, any
                        disclosure, copying, distribution or any action
                        taken or omitted to be taken in reliance on it,
                        is prohibited and may be unlawful. If you have
                        received this message in error, please notify us
                        immediately. Please also destroy and delete the
                        message from your computer. Viruses - Any
                        loss/damage incurred by receiving this email is
                        not the sender&#39;s responsibility.</span><br>
                    </div>
                  </div>
                  _______________________________________________<br>
                  drbd-user mailing list<br>
                  <a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a><br>
                  <a href="http://lists.linbit.com/mailman/listinfo/drbd-user" rel="noreferrer" target="_blank">http://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
                </blockquote>
              </div>
            </blockquote>
            <p><br>
            </p>
            <div class="m_3101535479746416947m_-7460380869597852741moz-signature">-- <br>
              Adam Goryachev Website Managers <a class="m_3101535479746416947m_-7460380869597852741moz-txt-link-abbreviated" href="http://www.websitemanagers.com.au" target="_blank">www.websitemanagers.com.au</a></div>
            <div><br>
              <span>-- The information in this e-mail is confidential
                and may be legally privileged.
                It is intended solely for the addressee. Access to this
                e-mail by anyone else
                is unauthorised. If you are not the intended recipient,
                any disclosure,
                copying, distribution or any action taken or omitted to
                be taken in reliance
                on it, is prohibited and may be unlawful. If you have
                received this message
                in error, please notify us immediately. Please also
                destroy and delete the
                message from your computer. Viruses - Any loss/damage
                incurred by receiving
                this email is not the sender&#39;s responsibility.</span><br>
            </div>
          </div>
        </blockquote>
      </div>
    </blockquote>
    <p><br>
    </p>
    <div class="m_3101535479746416947moz-signature">-- <br>
      Adam Goryachev
      Website Managers
      <a class="m_3101535479746416947moz-txt-link-abbreviated" href="http://www.websitemanagers.com.au" target="_blank">www.websitemanagers.com.au</a></div>
  <div><br><span>-- 
The information in this e-mail is confidential and may be legally privileged.
It is intended solely for the addressee. Access to this e-mail by anyone else
is unauthorised. If you are not the intended recipient, any disclosure,
copying, distribution or any action taken or omitted to be taken in reliance
on it, is prohibited and may be unlawful. If you have received this message
in error, please notify us immediately. Please also destroy and delete the
message from your computer. Viruses - Any loss/damage incurred by receiving
this email is not the sender&#39;s responsibility.</span><br></div>
</div>

</blockquote></div>