[DRBD-user] Issue creating storage volume with linstor-proxmox

Wolfgang Walkowiak walkowiak at hep.physik.uni-siegen.de
Thu Sep 16 11:25:43 CEST 2021 

Hello again,

just in case someone runs into a similar issue in the future:  We
solved it by creating a second resource group 'vmstore' (using the same
storage pool), creating a volume group 'vmstore' and then changing
the resource group for all resource definitions to 'vmstore'.  Then
We had to adjust the 'resourcegroup' in /etc/pve/storage.cfg to
'vmstore'.

In terms of commands:

# linstor resource-group create --storage-pool drbdpool --place-count 2 vmstore
# linstor volume-group create vmstore
# linstor resource-group list
# linstor rd modify --resource-group vmstore vm-100-disk-0
# # etc for any other resources.
# linstor resource-definition list

Then we adjusted /etc/pve/storage.cfg to contain:
...
drbd: drbdstor-1
         content rootdir,images
         controller 10.0.7.32
         controllervm 100
         resourcegroup vmstore
         preferlocal yes
         nodes pmbase1,pmbase2
...
and restarted the pvedaemon.service.

Now it is possible to create and delete hard disk volumes again using
the proxmox web interface with linstor-proxmox.

Cheers,

w.w.

On Wed, 15 Sep 2021, Wolfgang Walkowiak wrote:

>
> Hello,
>
> we are recently experiencing an issue which prevents us from creating
> storage volumes for proxmox VMs using the linstor-proxmox plugin.
> We had been able to create them in the past, but now it stopped working/
> (We upgrade both proxmox and the linstor/drbd software regularly.)
>
> It appears to relate to something with volumes:
>
> Message: Could not create resource definition vm-101-disk-1 from resource 
> group DfltRscGrp, because: 
> [{"ret_code":-4611686018406154012,"message":"Invalid count of volume sizes to 
> spawn resource group 'DfltRscGrp'","correction":"Either provide the correct 
> count of volume sizes or use the 'partial' option","details":"The resource 
> group 'DfltRscGrp' has 0 Volume groups, but only 1 sizes were provided.
> ....
> [See below for the full message.]
>
> The entry we have in /etc/pve/storage.cfg:
>
> drbd: drbdstor-1
>        content rootdir,images
>        controller 10.0.7.32
>        controllervm 100
>        resourcegroup DfltRscGrp
>        preferlocal yes
>        nodes pmbase1,pmbase2
>
> There is already a resource defined (done > 1 year ago):
> +------------------------------------------------------------------------+
> | ResourceName  | Node    | Port | Usage  | Conns |    State | CreatedOn |
> |========================================================================|
> | vm-100-disk-0 | pmbase1 | 7000 | Unused | Ok    | UpToDate |           |
> | vm-100-disk-0 | pmbase2 | 7000 | InUse  | Ok    | UpToDate |           |
> +------------------------------------------------------------------------+
>
> Today, I deleted some VMs and their volumes and just wanted to create
> new ones.
>
> Software versions:
>
> pve-manager/6.4-13/9f411e79 (running kernel: 5.4.140-1-pve)
>
> linstor-client                       1.10.1-1
> linstor-common                       1.14.0-1 linstor-controller 
> 1.14.0-1 linstor-proxmox                      5.2.1-1 linstor-satellite 
> 1.14.0-1
> python-linstor                       1.10.1-1
>
> Please advise how we may correct the situation.
>
> Thank you very much,
>
> w.w.
>
> Issue as it appears in syslog:
> ==============================
> Sep 15 14:16:03 pmbase1 pvedaemon[2577]: unable to create VM 101 - API 
> Return-Code: 500. Message: Could not create resource definition vm-101-disk-1 
> from resource group DfltRscGrp, because: 
> [{"ret_code":-4611686018406154012,"message":"Invalid count of volume sizes to 
> spa
> wn resource group 'DfltRscGrp'","correction":"Either provide the correct 
> count of volume sizes or use the 'partial' option","details":"The resource 
> group 'DfltRscGrp' has 0 Volume groups, but only 1 sizes were 
> provided.\nResource group: DfltRscGrp","obj_refs":{"RscDfn":"
> vm-101-disk-1","RscGrp":"DfltRscGrp"}}]  at 
> /usr/share/perl5/PVE/Storage/Custom/LINSTORPlugin.pm line 363. 
> #011PVE::Storage::Custom::LINSTORPlugin::alloc_image("PVE::Storage::Custom::LINSTORPlugin", 
> "drbdstor-1", HASH(0x55e84ee08b60), 101, "raw", undef, 33554432) called
> at /usr/share/perl5/PVE/Storage.pm line 896 #011eval {...} called at 
> /usr/share/perl5/PVE/Storage.pm line 896 #011PVE::Storage::__ANON__() called 
> at /usr/share/perl5/PVE/Cluster.pm line 621 #011eval {...} called at 
> /usr/share/perl5/PVE/Cluster.pm line 587 #011PVE::Cluste
> r::__ANON__("storage-drbdstor-1", undef, CODE(0x55e84e53ca18)) called at 
> /usr/share/perl5/PVE/Cluster.pm line 666 
> #011PVE::Cluster::cfs_lock_storage("drbdstor-1", undef, CODE(0x55e84e53ca18)) 
> called at /usr/share/perl5/PVE/Storage/Plugin.pm line 478 
> #011PVE::Storage::Plu
> gin::cluster_lock_storage("PVE::Storage::Custom::LINSTORPlugin", 
> "drbdstor-1", 1, undef, CODE(0x55e84e53ca18)) called at 
> /usr/share/perl5/PVE/Storage.pm line 901 
> #011PVE::Storage::vdisk_alloc(HASH(0x55e84edfd200), "drbdstor-1", 101, "raw", 
> undef, 33554432) called at /usr
> /share/perl5/PVE/API2/Qemu.pm line 188 #011PVE::API2::Qemu::__ANON__("scsi0", 
> HASH(0x55e84ed8b148)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 
> 475 #011PVE::AbstractConfig::foreach_volume_full("PVE::QemuConfig", 
> HASH(0x55e84ee34928), undef, CODE(0x55e84ef6e628)
> ) called at /usr/share/perl5/PVE/AbstractConfig.pm line 484 
> #011PVE::AbstractConfig::foreach_volume("PVE::QemuConfig", 
> HASH(0x55e84ee34928), CODE(0x55e84ef6e628)) called at 
> /usr/share/perl5/PVE/API2/Qemu.pm line 221 #011eval {...} called at 
> /usr/share/perl5/PVE/API2/Qemu
> .pm line 221 
> #011PVE::API2::Qemu::__ANON__(PVE::RPCEnvironment=HASH(0x55e84ed7c868), 
> "walkowia\@pam", HASH(0x55e84ee34928), "x86_64", HASH(0x55e84edfd200), 101, 
> undef, HASH(0x55e84ee34928), ...) called at /usr/share/perl5/PVE/API2/Qemu.pm 
> line 707 #011eval {...} called a
> t /usr/share/perl5/PVE/API2/Qemu.pm line 706 #011PVE::API2::Qemu::__ANON__() 
> called at /usr/share/perl5/PVE/AbstractConfig.pm line 299 
> #011PVE::AbstractConfig::__ANON__() called at /usr/share/perl5/PVE/Tools.pm 
> line 220 #011eval {...} called at /usr/share/perl5/PVE/Tools
> .pm line 220 
> #011PVE::Tools::lock_file_full("/var/lock/qemu-server/lock-101.conf", 1, 0, 
> CODE(0x55e847afcb70)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 
> 302 #011PVE::AbstractConfig::__ANON__("PVE::QemuConfig", 101, 1, 0, 
> CODE(0x55e848524908)) called at /usr/s
> hare/perl5/PVE/AbstractConfig.pm line 322 
> #011PVE::AbstractConfig::lock_config_full("PVE::QemuConfig", 101, 1, 
> CODE(0x55e848524908)) called at /usr/share/perl5/PVE/API2/Qemu.pm line 747 
> #011PVE::API2::Qemu::__ANON__() called at /usr/share/perl5/PVE/API2/Qemu.pm 
> line 777
> #011eval {...} called at /usr/share/perl5/PVE/API2/Qemu.pm line 777 
> #011PVE::API2::Qemu::__ANON__("UPID:pmbase1:00000A11:007609F3:6141E402:qmcreate:101:walkowia"...) 
> called at /usr/share/perl5/PVE/RESTEnvironment.pm line 615 #011eval {...} 
> called at /usr/share/perl5/PVE/
> RESTEnvironment.pm line 606 
> #011PVE::RESTEnvironment::fork_worker(PVE::RPCEnvironment=HASH(0x55e84ed7c868), 
> "qmcreate", 101, "walkowia\@pam", CODE(0x55e84ee25d88)) called at 
> /usr/share/perl5/PVE/API2/Qemu.pm line 789 
> #011PVE::API2::Qemu::__ANON__(HASH(0x55e84ee34928)) ca
> lled at /usr/share/perl5/PVE/RESTHandler.pm line 452 
> #011PVE::RESTHandler::handle("PVE::API2::Qemu", HASH(0x55e84c9664a8), 
> HASH(0x55e84ee34928)) called at /usr/share/perl5/PVE/HTTPServer.pm line 178 
> #011eval {...} called at /usr/share/perl5/PVE/HTTPServer.pm line 139 #01
> 1PVE::HTTPServer::rest_handler(PVE::HTTPServer=HASH(0x55e84ed7c9a0), 
> "::ffff:127.0.0.1", "POST", "/nodes/pmbase1/qemu", HASH(0x55e84ee31338), 
> HASH(0x55e84ef6e8c8), "extjs") called at 
> /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 877 #011eval {...} called at 
> /usr/share/
> perl5/PVE/APIServer/AnyEvent.pm line 851 
> #011PVE::APIServer::AnyEvent::handle_api2_request(PVE::HTTPServer=HASH(0x55e84ed7c9a0), 
> HASH(0x55e84eebd3b0), HASH(0x55e84ee31338), "POST", 
> "/api2/extjs/nodes/pmbase1/qemu") called at 
> /usr/share/perl5/PVE/APIServer/AnyEvent.pm lin
> e 1101 #011eval {...} called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm 
> line 1093 
> #011PVE::APIServer::AnyEvent::handle_request(PVE::HTTPServer=HASH(0x55e84ed7c9a0), 
> HASH(0x55e84eebd3b0), HASH(0x55e84ee31338), "POST", 
> "/api2/extjs/nodes/pmbase1/qemu") called at /usr/sh
> are/perl5/PVE/APIServer/AnyEvent.pm line 1500 
> #011PVE::APIServer::AnyEvent::__ANON__(AnyEvent::Handle=HASH(0x55e84ee096d0), 
> "ide2=nfsmoroni6%3Aiso%2Fdebian-11.0.0-amd64-netinst.iso%2Cmed"...) called at 
> /usr/lib/x86_64-linux-gnu/perl5/5.28/AnyEvent/Handle.pm line 1505 #01
> 1AnyEvent::Handle::__ANON__(AnyEvent::Handle=HASH(0x55e84ee096d0)) called at 
> /usr/lib/x86_64-linux-gnu/perl5/5.28/AnyEvent/Handle.pm line 1315 
> #011AnyEvent::Handle::_drain_rbuf(AnyEvent::Handle=HASH(0x55e84ee096d0)) 
> called at /usr/lib/x86_64-linux-gnu/perl5/5.28/AnyEvent
> /Handle.pm line 2015 
> #011AnyEvent::Handle::__ANON__(EV::IO=SCALAR(0x55e84ef81168), 1) called at 
> /usr/lib/x86_64-linux-gnu/perl5/5.28/AnyEvent/Impl/EV.pm line 88 #011eval 
> {...} called at /usr/lib/x86_64-linux-gnu/perl5/5.28/AnyEvent/Impl/EV.pm line 
> 88 #011AnyEvent::CondVa
> r::Base::_wait(AnyEvent::CondVar=HASH(0x55e84e549418)) called at 
> /usr/lib/x86_64-linux-gnu/perl5/5.28/AnyEvent.pm line 2026 
> #011AnyEvent::CondVar::Base::recv(AnyEvent::CondVar=HASH(0x55e84e549418)) 
> called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1814 #011PVE::A
> PIServer::AnyEvent::run(PVE::HTTPServer=HASH(0x55e84ed7c9a0)) called at 
> /usr/share/perl5/PVE/Service/pvedaemon.pm line 52 
> #011PVE::Service::pvedaemon::run(PVE::Service::pvedaemon=HASH(0x55e84e46edf0)) 
> called at /usr/share/perl5/PVE/Daemon.pm line 171 #011eval {...} calle
> d at /usr/share/perl5/PVE/Daemon.pm line 171 
> #011PVE::Daemon::__ANON__(PVE::Service::pvedaemon=HASH(0x55e84e46edf0)) 
> called at /usr/share/perl5/PVE/Daemon.pm line 391 #011eval {...} called at 
> /usr/share/perl5/PVE/Daemon.pm line 380 
> #011PVE::Daemon::__ANON__(PVE::Service:
> :pvedaemon=HASH(0x55e84e46edf0), undef) called at 
> /usr/share/perl5/PVE/Daemon.pm line 552 #011eval {...} called at 
> /usr/share/perl5/PVE/Daemon.pm line 550 
> #011PVE::Daemon::start(PVE::Service::pvedaemon=HASH(0x55e84e46edf0), undef) 
> called at /usr/share/perl5/PVE/Daemon.pm
> line 661 #011PVE::Daemon::__ANON__(HASH(0x55e847af1fd0)) called at 
> /usr/share/perl5/PVE/RESTHandler.pm line 452 
> #011PVE::RESTHandler::handle("PVE::Service::pvedaemon", HASH(0x55e84e46f138), 
> HASH(0x55e847af1fd0), 1) called at /usr/share/perl5/PVE/RESTHandler.pm line 
> 864
> #011eval {...} called at /usr/share/perl5/PVE/RESTHandler.pm line 847 
> #011PVE::RESTHandler::cli_handler("PVE::Service::pvedaemon", "pvedaemon 
> start", "start", ARRAY(0x55e847e28d78), ARRAY(0x55e84ed73eb8), undef, undef, 
> undef) called at /usr/share/perl5/PVE/CLIHandler.pm
> line 591 #011PVE::CLIHandler::__ANON__(ARRAY(0x55e847af21f8), 
> CODE(0x55e847e6fab8), undef) called at /usr/share/perl5/PVE/CLIHandler.pm 
> line 668 #011PVE::CLIHandler::run_cli_handler("PVE::Service::pvedaemon", 
> "prepare", CODE(0x55e847e6fab8)) called at /usr/bin/pvedaemon
> line 27
>
>
> ==========================================================2021-09-15==14:42==
>
>  Dr. Wolfgang Walkowiak     Phone: +49-271-740-3889
>  Fakultaet IV / Physik      Fax  : +49-271-740-3886
>  Emmy Noether Campus
>  Universitaet Siegen    --> Wolfgang.Walkowiak at hep.physik.uni-siegen.de
>  Walter-Flex-Str. 3         Wolfgang.Walkowiak at gmx.net
>  57068 Siegen
>  Germany
>
> =============================================================================
> _______________________________________________
> Star us on GITHUB: https://github.com/LINBIT
> drbd-user mailing list
> drbd-user at lists.linbit.com
> https://lists.linbit.com/mailman/listinfo/drbd-user
>
>

==========================================================2021-09-16==11:17==

   Dr. Wolfgang Walkowiak     Phone: +49-271-740-3889
   Fakultaet IV / Physik      Fax  : +49-271-740-3886
   Emmy Noether Campus
   Universitaet Siegen    --> Wolfgang.Walkowiak at hep.physik.uni-siegen.de
   Walter-Flex-Str. 3         Wolfgang.Walkowiak at gmx.net
   57068 Siegen
   Germany

=============================================================================

More information about the drbd-user mailing list