Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.
Hello Jasmin
Thanks for all your clarifications.
And let me to do a comments...
> The only thing which is currently not supported is life migration. The
> plugin checks if the other side is in secondary, otherwise it will not
> activate the DRBD8 volume.
> It might be possible to implement this (remove the check in the plugin)
> and use dual primary mode, but ... .
> In my opinion it is not necessary to life migrate, but others may see this
> different and extend the plugin to allow this and ofcourse test, if this
> is really working without getting a split brain.
In my experience of several years working with DRBD and PVE on mode
primary-primary, is that sometimes i have my DRBD resources desynchronized,
but never due to the "split brains", from that i configure the PVE Nodes in
bonding-rr in mode NIC-to-NIC between my PVE hosts only for the DRBD
resources (without a switch in the middle), and i think that this error is
due to a bug(s) in the DRBD code.
For me, this ugly behavior is avoided completely if i change the
configuration of the DRBD resources to primary-secondary mode, that is as i
have it configured now.
Then, as I compile, install and configure the DRBD software (in mode
primary-secondary), i have a perfect control of everything, and I can do:
- Live migration of VMs (with previous and subsequent manual steps of DRBD
commands(change status of primary and secondary DRBD resources)).
- Apply HA manually (changing manually to primary the DRBD resource in the
host that is live, and after, also manually execute the command
"fence_ack_manual name_of_the_host_that_is_dead").
But if i want to use your plugin, i will lose the option of use live
migration, that it is important for me, and that's why i need to have and
second plugin (or something similar) that can mitigate with the primary and
secondary DRBD resources and do a live migrations of VMs successfully.
Moreover, I think that if the PVE developer team do a API (or something
similar) that can execute commands previous and subsequent to the live
migration, of this way, we will have the better of PVE for our DRBD
resources ("HA" and "live migration").
So, my question is if you can to talk with the PVE developer team for that
them can do the API (or something similar) so that can work the "Live
Migration" sucessfully without the need of execute manually some previous
and subsequent DRBD commands, ie, change the state of the primary and
secondary DRBD resources as part of the process of the live migration.
For example, vzdump has the option of execute commands previous and
subsequent of his own execution, and i guess that also will be possible have
it available for the live migration.
And finally, after of that (as i am not a developer nor know your plugin
inwardly), maybe also be need to change something in the code of your plugin
for that works well (due to that for a short time, in the process of the
live migration, we will need that both of them DRBD resources are in primary
mode).
So I'd like to know what you think about all that.
> I had a similar configuration before, but now I am free with the number of
> disks and number of VMs which I have.
Please, excuse me for my error, I meant to say that i use one or more
partitions of disk for each VM (without limit), of this way, if my DRBD
resources are desynchronized, quickly and in online mode, i can
resynchronize them without some risk (generally some few seconds for
resynchronize them).
> To be honest, I don't trust the PVE cluster manager here. Or better, I
> don't know if it would be possible to write really from both sides the
> same disk blocks. If someone likes to test it, I wrote above how it might
> work with the existing plugin by simply removing the check for the other
> side being secondary.
If write really from both sides to the same disk at the same time, we will
get a serious and real disaster.
> If someone likes to test it, I wrote above how it might work with the
> existing plugin by simply removing the check for the other side being
> secondary.
I would like to use your plugin in primary-secondary mode, and never of
other way, but as also i need the live migration, then, i need that both
features work well.
For this reason i use my own DRBD compiled (as i explained above), but as
the manual execution of DRBD commands isn't elegant for apply a "HA" or a
"Live Migration" (as also i explained above), then, i would like to have
these features availables without have that manually execute some command.
> > I did several tests about that, and i can say with certainty that in
> > DRBD8
> > the online resize only is possible if the VM is not running and the DRBD
> > resource is unmounted in the host (very tested in my lab with his
> > possible
> > alternatives, always with the condition that resource DRBD be as small
> > as
> > possible, ie, according to the size of the Virtual disk)
> Thanks for sharing this information!
> So you need to shutdown the VM first. Then the plugin will change to
> secondary on both sides and then you can do the LVM/DRBD8 shrink/extend.
> And
> ofcourse shrinking requires more attention and intelligence to do it.
I don't know if your schema is as the mine...
LVM-Partition / DRBD / LVM-PV / LVM-VG / LVM-LV(The virtual disk)
Or this...
LVM-Partition / LVM-PV / LVM-VG / LVM-LV /DRBD(The virtual disk)
or what ???
But i can to say that my process of extend the vitual disk is very complex,
due to that i do several things, as delete the partition and recreate it
more big, up and down the DRBD resources as part of the process, as well as
some other things, but very tested in my lab, and inclusive realized in
production environments.
If you are interested in knowing the complete procedure, i can send you by
email my own manual for this procedure, but as i speak spanish, my manual is
done in my own language.
Also i think that this procedure not will be util for create a development
for PVE due to the complexity of the same, as also i have the primordial
condition that each DRBD resource not be more big that the virtual disk.
But if you find a easy way for extend a virtual disk with such condition,
please, let me know it !!!.
>
> BR
> Jasmin
BR
Cesar