[DRBD-user] [openstack] libvirt xml <source dev='None'/>
Volodymyr Litovka
doka.ua at gmx.com
Fri May 22 16:11:59 CEST 2020
Hi,
nobody uses Linstor with Openstack? :-)
On 21.05.2020 12:45, Volodymyr Litovka wrote:
> Hi colleagues,
>
> does anybody here use Linstor as backend for Openstack? I can not launch VM (synopsys below) while everything looks fine until the last step :-)
>
> In brief about Openstack configuration:
>
> - controllers: cinder-api, cinder-scheduler, cinder-volume (modified with latest linstor driver from git), linstor-client, python-linstor
> - compute nodes: linstor-controller, linstor-satellite, linstor-client, python-linstor; node types - Combined
> - cinder.conf[1]
> - volume-type registered with corresponding properties[2]
>
> I'm able to manipulate volumes - create/delete[3] and every existing volume has the corresponding linstor repr[4] and LVM LV[5] on the compute nodes
>
> The problem is when I try to create VM using
>
> openstack server create --flavor 2x2 --network [...] --volume 15c4fa98-76a5-44d6-9701-c89a8a848b82 fearst
>
> Nova fails because of libvirt XML definition (note source dev='None' below):
>
> <devices>
> <emulator>/usr/bin/qemu-system-x86_64</emulator>
> <disk type='block' device='disk'>
> <driver name='qemu' type='raw' cache='none'/>
> <source dev='None'/>
> <target dev='vda' bus='virtio'/>
> <serial>15c4fa98-76a5-44d6-9701-c89a8a848b82</serial>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
> </disk>
>
> I do not have another working DRBD/Linstor/Openstack installation and can't even imagine, where to look into the problem - whether it is in Nova, Cinder or Linstor configuration itself.
>
> I will appreciate if anybody can give me some guidance on where to seek for the solution.
>
> Thank you!
>
> ====================================
>
> [1] cinder.conf
> [DEFAULT]
> enabled_backends = linstor
> default_volume_type = linstor
> [linstor]
> storage_availability_zone = nova
> volume_backend_name = linstor
> volume_driver = cinder.volume.drivers.linstordrv.LinstorDrbdDriver
> linstor_autoplace_count = 2
> linstor_default_volume_group_name=DfltRscGrp
> linstor_default_uri=linstor://runner
> linstor_default_storage_pool_name=drbdpool
> linstor_default_resource_size=1
> linstor_volume_downsize_factor=4096
>
> where 'runner' is virtual ip of linstor-controller, protected by pacemaker.
>
> [2] openstack volume type show linstor
> +--------------------+--------------------------------------+
> | Field | Value |
> +--------------------+--------------------------------------+
> | access_project_ids | None |
> | description | None |
> | id | d2025962-503a-4f37-93bd-b766bb346a42 |
> | is_public | True |
> | name | linstor |
> | properties | volume_backend_name='linstor' |
> | qos_specs_id | None |
> +--------------------+--------------------------------------+
>
> [3] openstack volume show fearst
> +--------------------------------+-----------------------------------------------------+
> | Field | Value |
> +--------------------------------+-----------------------------------------------------+
> | attachments | [] |
> | availability_zone | nova |
> | bootable | true |
> | consistencygroup_id | None |
> | created_at | 2020-05-21T08:42:11.000000 |
> | description | None |
> | encrypted | False |
> | id | 15c4fa98-76a5-44d6-9701-c89a8a848b82 |
> | migration_status | None |
> | multiattach | False |
> | name | fearst |
> | os-vol-host-attr:host | ctrl1 at linstor#linstor |
> | os-vol-mig-status-attr:migstat | None |
> | os-vol-mig-status-attr:name_id | None |
> | os-vol-tenant-attr:tenant_id | 7acec404393344cbabde07a22bbe6b3f |
> | properties | |
> | replication_status | None |
> | size | 5 |
> | snapshot_id | None |
> | source_volid | None |
> | status | available |
> | type | linstor |
> | updated_at | 2020-05-21T08:42:18.000000 |
> | user_id | 1048a19e94234451a61c3d9d46907ceb |
> | volume_image_metadata | {'signature_verified': 'False', |
> | | 'image_id': '15e992e8-a601-44cd-a2f0-8f34588a4d18',|
> | | 'image_name': 'cirros', |
> | | 'checksum': '1d3062cd89af34e419f7100277f38b2b', |
> | | 'container_format': 'bare', |
> | | 'disk_format': 'qcow2', |
> | | 'min_disk': '0', |
> | | 'min_ram': '0', |
> | | 'size': '16338944'} |
> +--------------------------------+-----------------------------------------------------+
>
> [4] linstor r l
> ╭───────────────────────────────────────────────────────────────────────────────────╮
> ┊ ResourceName ┊ Node ┊ Port ┊ Usage ┊ Conns ┊ State ┊
> ╞═══════════════════════════════════════════════════════════════════════════════════╡
> ┊ CV_15c4fa98-76a5-44d6-9701-c89a8a848b82 ┊ cmp1 ┊ 7000 ┊ Unused ┊ Ok ┊ UpToDate ┊
> ┊ CV_15c4fa98-76a5-44d6-9701-c89a8a848b82 ┊ cmp2 ┊ 7000 ┊ Unused ┊ Ok ┊ UpToDate ┊
> ╰───────────────────────────────────────────────────────────────────────────────────╯
>
> Note, that cmp3 is arbiter and has no 'by-disk' representation:
>
> root at cmp1:~# ls -lR /dev/drbd*
> brw-rw---- 1 root disk 147, 1000 May 21 11:42 /dev/drbd1000
> /dev/drbd/by-disk/sds:
> lrwxrwxrwx 1 root root 17 May 21 11:42 CV_15c4fa98-76a5-44d6-9701-c89a8a848b82_00000 -> ../../../drbd1000
> /dev/drbd/by-res/CV_15c4fa98-76a5-44d6-9701-c89a8a848b82:
> lrwxrwxrwx 1 root root 17 May 21 11:42 0 -> ../../../drbd1000
>
> root at cmp2:~# ls -lR /dev/drbd*
> brw-rw---- 1 root disk 147, 1000 May 21 11:42 /dev/drbd1000
> /dev/drbd/by-disk/sds:
> lrwxrwxrwx 1 root root 17 May 21 11:42 CV_15c4fa98-76a5-44d6-9701-c89a8a848b82_00000 -> ../../../drbd1000
> /dev/drbd/by-res/CV_15c4fa98-76a5-44d6-9701-c89a8a848b82:
> lrwxrwxrwx 1 root root 17 May 21 11:42 0 -> ../../../drbd1000
>
> root at cmp3:~# ls -lR /dev/drbd*
> brw-rw---- 1 root disk 147, 1000 May 21 11:42 /dev/drbd1000
> /dev/drbd/by-res/CV_15c4fa98-76a5-44d6-9701-c89a8a848b82:
> lrwxrwxrwx 1 root root 17 May 21 11:42 0 -> ../../../drbd1000
>
> [5] root at cmp1:~# lvdisplay
> [ ... ]
> --- Logical volume ---
> LV Path /dev/sds/CV_15c4fa98-76a5-44d6-9701-c89a8a848b82_00000
> LV Name CV_15c4fa98-76a5-44d6-9701-c89a8a848b82_00000
> VG Name sds
> LV UUID jGzcIQ-yRpH-RKxP-ExsH-JSn6-kTFn-8kpKYO
> LV Write Access read/write
> LV Creation host, time cmp1, 2020-05-21 11:42:14 +0300
> LV Pool name thin
> LV Status available
> # open 2
> LV Size 5.00 GiB
> Mapped size 0.02%
> Current LE 1280
> Segments 1
> Allocation inherit
> Read ahead sectors auto
> - currently set to 256
> Block device 253:4
>
> root at cmp2:~# lvdisplay
> [ ... ]
> --- Logical volume ---
> LV Path /dev/sds/CV_15c4fa98-76a5-44d6-9701-c89a8a848b82_00000
> LV Name CV_15c4fa98-76a5-44d6-9701-c89a8a848b82_00000
> VG Name sds
> LV UUID 8pVwMo-e3ed-Sy0w-06IZ-M7Mh-YVIL-BtKZEG
> LV Write Access read/write
> LV Creation host, time cmp2, 2020-05-21 11:42:14 +0300
> LV Pool name thin
> LV Status available
> # open 2
> LV Size 5.00 GiB
> Mapped size 0.02%
> Current LE 1280
> Segments 1
> Allocation inherit
> Read ahead sectors auto
> - currently set to 256
> Block device 253:4
>
>
> --
> Volodymyr Litovka
> "Vision without Execution is Hallucination." -- Thomas Edison
--
Volodymyr Litovka
"Vision without Execution is Hallucination." -- Thomas Edison
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linbit.com/pipermail/drbd-user/attachments/20200522/bcfe319d/attachment.htm>
More information about the drbd-user
mailing list