[DRBD-user] snapshot backup under proxmox 6

Alex Kolesnik drbd-user at abisoft.biz
Wed Aug 14 17:51:53 CEST 2019


Hello,

Snapshot backup seems to have an issue:

root at pve1:~# pveversion
pve-manager/6.0-5/f8a710d7 (running kernel: 5.0.18-1-pve)

root at pve1:~# cat /etc/pve/storage.cfg
...
drbd: drbdpool
        content rootdir,images
        controller 10.1.1.254
        controllervm 100
        redundancy 2
...

root at pve1:~# pct config 100
arch: amd64
cores: 2
hostname: linstor-controller
memory: 512
net0: name=eth0,bridge=vmbr10,gw=10.1.1.1,hwaddr=26:81:53:50:FB:48,ip=10.1.1.254/24,type=veth
onboot: 1
ostype: debian
rootfs: drbdpool:vm-100-disk-0,mountoptions=noatime,size=2100760K
swap: 512
unprivileged: 1

root at pve1:~# lvdisplay
  --- Logical volume ---
  LV Name                drbdpool
  VG Name                drbdpool
  LV UUID                tkjP2X-Awds-tAFD-nxHM-Q3sr-OxY5-nhRfp2
  LV Write Access        read/write
  LV Creation host, time pve1, 2019-08-14 16:43:05 +0300
  LV Pool metadata       drbdpool_tmeta
  LV Pool data           drbdpool_tdata
  LV Status              available
  # open                 2
  LV Size                <3.99 GiB
  Allocated pool data    50.21%
  Allocated metadata     36.91%
  Current LE             1021
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     256
  Block device           253:2

  --- Logical volume ---
  LV Path                /dev/drbdpool/vm-100-disk-0_00000
  LV Name                vm-100-disk-0_00000
  VG Name                drbdpool
  LV UUID                9kksyt-thRO-21pw-r3Ko-Bq3u-OUPO-VGwKgS
  LV Write Access        read/write
  LV Creation host, time pve1, 2019-08-14 17:31:29 +0300
  LV Pool name           drbdpool
  LV Status              available
  # open                 2
  LV Size                2.00 GiB
  Mapped size            99.93%
  Current LE             513
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     256
  Block device           253:4

root at pve1:~# drbdadm status
vm-100-disk-0 role:Primary suspended:user
  disk:UpToDate blocked:upper
  pve2 role:Secondary
    peer-disk:UpToDate

root at pve1:~# df -h | grep Backup
/dev/sdc1             4.9G  571M  4.1G  13% /mnt/pve/Backup

root at pve1:~# grep global_filter /etc/lvm/lvm.conf
        global_filter = [ "r|/dev/zd.*|", "r|/dev/mapper/pve-.*|" "r|/dev/mapper/.*-(vm|base)--[0-9]+--disk--[0-9]+|", "r|/dev/drbd.*|" ]

INFO: starting new backup job: vzdump 100 --node pve1 --compress lzo --remove 0 --mode snapshot --storage Backup
INFO: Starting Backup of VM 100 (lxc)
INFO: Backup started at 2019-08-14 18:43:10
INFO: status = running
INFO: CT Name: linstor-controller
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: create storage snapshot 'vzdump'
snapshot create failed: starting cleanup
no lock found trying to remove 'backup'  lock
ERROR: Backup of VM 100 failed - Could not create cluster wide snapshot snap_vm-100-disk-0_vzdump of vm-100-disk-0, because:
ERROR: read timeout at /usr/share/perl5/Net/HTTP/Methods.pm line 268.
ERROR: 
ERROR:  at /usr/share/perl5/PVE/Storage/Custom/LINSTORPlugin.pm line 399.
ERROR:  PVE::Storage::Custom::LINSTORPlugin::volume_snapshot("PVE::Storage::Custom::LINSTORPlugin", HASH(0x55b80e6fb1d0), "drbdpool", "vm-100-disk-0", "vzdump") called at /usr/share/perl5/PVE/Storage.pm line 240
ERROR:  PVE::Storage::volume_snapshot(HASH(0x55b80e6faff0), "drbdpool:vm-100-disk-0", "vzdump") called at /usr/share/perl5/PVE/LXC/Config.pm line 116
ERROR:  PVE::LXC::Config::__snapshot_create_vol_snapshot("PVE::LXC::Config", 100, "rootfs", HASH(0x55b80e6faf30), "vzdump") called at /usr/share/perl5/PVE/AbstractConfig.pm line 474
ERROR:  PVE::AbstractConfig::__ANON__("rootfs", HASH(0x55b80e6faf30)) called at /usr/share/perl5/PVE/LXC/Config.pm line 1368
ERROR:  PVE::LXC::Config::foreach_mountpoint_full("PVE::LXC::Config", HASH(0x55b80e6fac90), 0, CODE(0x55b80e6a7fe0)) called at /usr/share/perl5/PVE/LXC/Config.pm line 1375
ERROR:  PVE::LXC::Config::foreach_mountpoint("PVE::LXC::Config", HASH(0x55b80e6fac90), CODE(0x55b80e6a7fe0)) called at /usr/share/perl5/PVE/LXC/Config.pm line 210
ERROR:  PVE::LXC::Config::__snapshot_foreach_volume("PVE::LXC::Config", HASH(0x55b80e6fac90), CODE(0x55b80e6a7fe0)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 476
ERROR:  eval {...} called at /usr/share/perl5/PVE/AbstractConfig.pm line 464
ERROR:  PVE::AbstractConfig::snapshot_create("PVE::LXC::Config", 100, "vzdump", 0, "vzdump backup snapshot") called at /usr/share/perl5/PVE/VZDump/LXC.pm line 203
ERROR:  PVE::VZDump::LXC::__ANON__() called at /usr/share/perl5/PVE/Tools.pm line 201
ERROR:  eval {...} called at /usr/share/perl5/PVE/Tools.pm line 201
ERROR:  PVE::Tools::lock_file_full("/run/lock/lxc/pve-config-100.lock", 10, 0, CODE(0x55b80e6dd650)) called at /usr/share/perl5/PVE/Tools.pm line 210
ERROR:  PVE::Tools::lock_file("/run/lock/lxc/pve-config-100.lock", 10, CODE(0x55b80e6dd650)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 78
ERROR:  PVE::AbstractConfig::lock_config_full("PVE::LXC::Config", 100, 10, CODE(0x55b80e6dd650)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 117
ERROR:  PVE::AbstractConfig::lock_config("PVE::LXC::Config", 100, CODE(0x55b80e6dd650)) called at /usr/share/perl5/PVE/VZDump/LXC.pm line 205
ERROR:  PVE::VZDump::LXC::snapshot(PVE::VZDump::LXC=HASH(0x55b80e66cbd0), HASH(0x55b807d56b78), 100) called at /usr/share/perl5/PVE/VZDump.pm line 940
ERROR:  eval {...} called at /usr/share/perl5/PVE/VZDump.pm line 762
ERROR:  PVE::VZDump::exec_backup_task(PVE::VZDump=HASH(0x55b80e64c668), HASH(0x55b807d56b78)) called at /usr/share/perl5/PVE/VZDump.pm line 1123
ERROR:  eval {...} called at /usr/share/perl5/PVE/VZDump.pm line 1118
ERROR:  PVE::VZDump::exec_backup(PVE::VZDump=HASH(0x55b80e64c668), PVE::RPCEnvironment=HASH(0x55b807d57148), "root\@pam") called at /usr/share/perl5/PVE/API2/VZDump.pm line 152
ERROR:  PVE::API2::VZDump::__ANON__("UPID:pve1:000009B4:000053F6:5D542C0B:vzdump:100:root\@pam:") called at /usr/share/perl5/PVE/RESTEnvironment.pm line 610
ERROR:  eval {...} called at /usr/share/perl5/PVE/RESTEnvironment.pm line 601
ERROR:  PVE::RESTEnvironment::fork_worker(PVE::RPCEnvironment=HASH(0x55b807d57148), "vzdump", 100, "root\@pam", CODE(0x55b80e6b8930)) called at /usr/share/perl5/PVE/API2/VZDump.pm line 174
ERROR:  PVE::API2::VZDump::__ANON__(HASH(0x55b80e6d7570)) called at /usr/share/perl5/PVE/RESTHandler.pm line 446
ERROR:  PVE::RESTHandler::handle("PVE::API2::VZDump", HASH(0x55b80d58a430), HASH(0x55b80e6d7570)) called at /usr/share/perl5/PVE/HTTPServer.pm line 167
ERROR:  eval {...} called at /usr/share/perl5/PVE/HTTPServer.pm line 133
ERROR:  PVE::HTTPServer::rest_handler(PVE::HTTPServer=HASH(0x55b807d57238), "10.0.2.2", "POST", "/nodes/pve1/vzdump", HASH(0x55b80e6b8420), HASH(0x55b80e66c288), "extjs") called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 712
ERROR:  eval {...} called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 686
ERROR:  PVE::APIServer::AnyEvent::handle_api2_request(PVE::HTTPServer=HASH(0x55b807d57238), HASH(0x55b80e6dc960), HASH(0x55b80e6b8420), "POST", "/api2/extjs/nodes/pve1/vzdump") called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 939
ERROR:  eval {...} called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 931
ERROR:  PVE::APIServer::AnyEvent::handle_request(PVE::HTTPServer=HASH(0x55b807d57238), HASH(0x55b80e6dc960), HASH(0x55b80e6b8420), "POST", "/api2/extjs/nodes/pve1/vzdump") called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1325
ERROR:  PVE::APIServer::AnyEvent::__ANON__(AnyEvent::Handle=HASH(0x55b80de11460), "vmid=100&remove=0&mode=snapshot&compress=lzo&storage=Backup") called at /usr/lib/x86_64-linux-gnu/perl5/5.28/AnyEvent/Handle.pm line 1505
ERROR:  AnyEvent::Handle::__ANON__(AnyEvent::Handle=HASH(0x55b80de11460)) called at /usr/lib/x86_64-linux-gnu/perl5/5.28/AnyEvent/Handle.pm line 1315
ERROR:  AnyEvent::Handle::_drain_rbuf(AnyEvent::Handle=HASH(0x55b80de11460)) called at /usr/lib/x86_64-linux-gnu/perl5/5.28/AnyEvent/Handle.pm line 2015
ERROR:  AnyEvent::Handle::__ANON__(EV::IO=SCALAR(0x55b807d570a0), 1) called at /usr/lib/x86_64-linux-gnu/perl5/5.28/AnyEvent/Impl/EV.pm line 88
ERROR:  eval {...} called at /usr/lib/x86_64-linux-gnu/perl5/5.28/AnyEvent/Impl/EV.pm line 88
ERROR:  AnyEvent::CondVar::Base::_wait(AnyEvent::CondVar=HASH(0x55b80de4a0d8)) called at /usr/lib/x86_64-linux-gnu/perl5/5.28/AnyEvent.pm line 2026
ERROR:  AnyEvent::CondVar::Base::recv(AnyEvent::CondVar=HASH(0x55b80de4a0d8)) called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1612
ERROR:  PVE::APIServer::AnyEvent::run(PVE::HTTPServer=HASH(0x55b807d57238)) called at /usr/share/perl5/PVE/Service/pvedaemon.pm line 52
ERROR:  PVE::Service::pvedaemon::run(PVE::Service::pvedaemon=HASH(0x55b80e649c50)) called at /usr/share/perl5/PVE/Daemon.pm line 171
ERROR:  eval {...} called at /usr/share/perl5/PVE/Daemon.pm line 171
ERROR:  PVE::Daemon::__ANON__(PVE::Service::pvedaemon=HASH(0x55b80e649c50)) called at /usr/share/perl5/PVE/Daemon.pm line 391
ERROR:  eval {...} called at /usr/share/perl5/PVE/Daemon.pm line 380
ERROR:  PVE::Daemon::__ANON__(PVE::Service::pvedaemon=HASH(0x55b80e649c50), undef) called at /usr/share/perl5/PVE/Daemon.pm line 552
ERROR:  eval {...} called at /usr/share/perl5/PVE/Daemon.pm line 550
ERROR:  PVE::Daemon::start(PVE::Service::pvedaemon=HASH(0x55b80e649c50), undef) called at /usr/share/perl5/PVE/Daemon.pm line 661
ERROR:  PVE::Daemon::__ANON__(HASH(0x55b807d4be60)) called at /usr/share/perl5/PVE/RESTHandler.pm line 446
ERROR:  PVE::RESTHandler::handle("PVE::Service::pvedaemon", HASH(0x55b80e649f98), HASH(0x55b807d4be60)) called at /usr/share/perl5/PVE/RESTHandler.pm line 855
ERROR:  eval {...} called at /usr/share/perl5/PVE/RESTHandler.pm line 838
ERROR:  PVE::RESTHandler::cli_handler("PVE::Service::pvedaemon", "pvedaemon start", "start", ARRAY(0x55b8080824d0), ARRAY(0x55b80e64a610), undef, undef, undef) called at /usr/share/perl5/PVE/CLIHandler.pm line 580
ERROR:  PVE::CLIHandler::__ANON__(ARRAY(0x55b807d4c088), CODE(0x55b8080c96e8), undef) called at /usr/share/perl5/PVE/CLIHandler.pm line 657
ERROR:  PVE::CLIHandler::run_cli_handler("PVE::Service::pvedaemon", "prepare", CODE(0x55b8080c96e8)) called at /usr/bin/pvedaemon line 27
INFO: Failed at 2019-08-14 18:48:15
INFO: Backup job finished with errors
TASK ERROR: job errors

Any chances to get that working?

-- 
Best regards,
Alex Kolesnik



More information about the drbd-user mailing list