[DRBD-user] Clarifying the Linstor Documentation
Eric Robinson
eric.robinson at psmnv.com
Tue May 24 18:10:39 CEST 2022
Quick clarification, please?
The Linstor documentation states,
<snip>
1.10.1. Confining Failure Domains to a Single Back-end Device
In clusters where you have only one kind of storage and the capability to hot swap storage devices, you may choose a model where you create one storage pool per physical backing device. The advantage of this model is to confine failure domains to a single storage device
</snip>
However, I'm wondering if this is default behavior anyway. We have approximately 400 resources of various sizes on our Linstor cluster. Each node has 6 x NVME drives, all in 1 volume group, and only 1 storage pool for the whole volume group. And yet, if I am reading the following correctly, it appears that Linstor has (thankfully) placed each resource entirely on a single device anyway.
Am I reading this correctly? Does Linstor keep each resource constrained to single backing devices, thereby automatically limiting failure domains, even if there is only 1 storage pool?
[root at ha51b system]# lvs -o+lv_layout,devices
LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert Layout Devices
root ha51b -wi-ao---- 190.00g linear /dev/sda3(6144)
swap ha51b -wi-ao---- 24.00g linear /dev/sda3(0)
site002_00000 vg0 -wi-ao---- 104.02g linear /dev/nvme3n1(371535)
site003_00000 vg0 -wi-ao---- <63.02g linear /dev/nvme0n1(498558)
site017_00000 vg0 -wi-ao---- <149.04g linear /dev/nvme3n1(724396)
site019_00000 vg0 -wi-ao---- <19.01g linear /dev/nvme4n1(0)
site021_00000 vg0 -wi-ao---- <23.01g linear /dev/nvme2n1(698275)
site030_00000 vg0 -wi-ao---- 39.01g linear /dev/nvme2n1(704165)
site034_00000 vg0 -wi-ao---- <23.01g linear /dev/nvme3n1(713896)
site035_00000 vg0 -wi-ao---- 39.01g linear /dev/nvme0n1(254527)
site036_00000 vg0 -wi-ao---- <88.02g linear /dev/nvme2n1(714152)
site037_00000 vg0 -wi-ao---- <28.01g linear /dev/nvme0n1(530822)
site039_00000 vg0 -wi-ao---- <59.02g linear /dev/nvme1n1(180777)
site041_00000 vg0 -wi-ao---- <21.01g linear /dev/nvme3n1(181290)
site043_00000 vg0 -wi-ao---- 50.01g linear /dev/nvme3n1(398165)
site045_00000 vg0 -wi-ao---- 52.01g linear /dev/nvme1n1(203567)
site047_00000 vg0 -wi-ao---- 54.01g linear /dev/nvme0n1(264514)
site049_00000 vg0 -wi-ao---- <81.02g linear /dev/nvme3n1(410968)
site058_00000 vg0 -wi-ao---- <30.01g linear /dev/nvme0n1(564622)
site062_00000 vg0 -wi-ao---- 17.00g linear /dev/nvme3n1(197679)
site065_00000 vg0 -wi-ao---- <23.01g linear /dev/nvme1n1(387935)
site068_00000 vg0 -wi-ao---- <32.01g linear /dev/nvme0n1(616090)
site074_00000 vg0 -wi-ao---- <77.02g linear /dev/nvme4n1(11524)
site081_00000 vg0 -wi-ao---- <30.01g linear /dev/nvme0n1(624284)
site091_00000 vg0 -wi-ao---- <19.01g linear /dev/nvme4n1(63761)
site095_00000 vg0 -wi-ao---- <30.01g linear /dev/nvme0n1(644769)
site096_00000 vg0 -wi-ao---- <23.01g linear /dev/nvme0n1(668071)
site101_00000 vg0 -wi-ao---- 10.00g linear /dev/nvme0n1(278341)
site104_00000 vg0 -wi-ao---- 41.01g linear /dev/nvme0n1(280902)
site106_00000 vg0 -wi-ao---- <214.05g linear /dev/nvme4n1(68627)
site110_00000 vg0 -wi-ao---- <23.01g linear /dev/nvme3n1(708006)
site112_00000 vg0 -wi-ao---- 10.00g linear /dev/nvme0n1(759744)
site116_00000 vg0 -wi-ao---- 41.01g linear /dev/nvme0n1(291401)
site118_00000 vg0 -wi-ao---- 8.00g linear /dev/nvme2n1(450408)
site125_00000 vg0 -wi-ao---- 39.01g linear /dev/nvme0n1(700079)
site126_00000 vg0 -wi-ao---- 43.01g linear /dev/nvme3n1(186668)
site130_00000 vg0 -wi-ao---- <63.02g linear /dev/nvme0n1(514690)
site147_00000 vg0 -wi-ao---- <66.02g linear /dev/nvme3n1(448866)
site157_00000 vg0 -wi-ao---- <79.02g linear /dev/nvme4n1(160552)
site161_00000 vg0 -wi-ao---- 41.01g linear /dev/nvme0n1(486010)
site163_00000 vg0 -wi-ao---- <30.01g linear /dev/nvme0n1(301900)
site164_00000 vg0 -wi-ao---- <35.01g linear /dev/nvme0n1(309582)
site169_00000 vg0 -wi-ao---- 48.01g linear /dev/nvme0n1(318544)
site172_00000 vg0 -wi-ao---- <30.01g linear /dev/nvme3n1(465766)
site176_00000 vg0 -wi-ao---- <81.02g linear /dev/nvme2n1(736685)
site179_00000 vg0 -wi-ao---- 52.01g linear /dev/nvme0n1(330835)
site180_00000 vg0 -wi-ao---- <35.01g linear /dev/nvme0n1(344150)
site181_00000 vg0 -wi-ao---- <63.02g linear /dev/nvme3n1(473448)
site185_00000 vg0 -wi-ao---- 8.00g linear /dev/nvme0n1(496509)
site186_00000 vg0 -wi-ao---- <30.01g linear /dev/nvme0n1(353112)
site189_00000 vg0 -wi-ao---- 43.01g linear /dev/nvme0n1(360794)
site196_00000 vg0 -wi-ao---- 12.00g linear /dev/nvme0n1(371805)
site197_00000 vg0 -wi-ao---- <68.02g linear /dev/nvme3n1(489580)
site203_00000 vg0 -wi-ao---- <264.06g linear /dev/nvme3n1(202794)
site204_00000 vg0 -wi-ao---- <26.01g linear /dev/nvme4n1(4866)
site206_00000 vg0 -wi-ao---- <75.02g linear /dev/nvme4n1(31241)
site211_00000 vg0 -wi-ao---- <171.04g linear /dev/nvme0n1(572304)
site217_00000 vg0 -wi-ao---- <28.01g linear /dev/nvme3n1(91668)
site222_00000 vg0 -wi-ao---- <75.02g linear /dev/nvme2n1(136480)
site227_00000 vg0 -wi-ao---- 45.01g linear /dev/nvme3n1(578177)
site233_00000 vg0 -wi-ao---- <28.01g linear /dev/nvme3n1(431709)
site235_00000 vg0 -wi-ao---- 39.01g linear /dev/nvme3n1(438879)
site236_00000 vg0 -wi-ao---- <153.04g linear /dev/nvme3n1(506992)
site244_00000 vg0 -wi-ao---- 52.01g linear /dev/nvme4n1(50446)
site245_00000 vg0 -wi-ao---- 45.01g linear /dev/nvme3n1(546169)
site246_00000 vg0 -wi-ao---- <35.01g linear /dev/nvme3n1(557692)
site247_00000 vg0 -wi-ao---- <88.02g linear /dev/nvme4n1(123423)
site250_00000 vg0 -wi-ao---- <77.02g linear /dev/nvme1n1(222772)
site251_00000 vg0 -wi-ao---- 45.01g linear /dev/nvme3n1(566654)
site252_00000 vg0 -wi-ao---- <32.01g linear /dev/nvme3n1(597894)
site254_00000 vg0 -wi-ao---- 459.10g linear /dev/nvme2n1(241976)
site257_00000 vg0 -wi-ao---- <28.01g linear /dev/nvme3n1(606088)
site258_00000 vg0 -wi-ao---- 39.01g linear /dev/nvme3n1(625806)
site259_00000 vg0 -wi-ao---- 41.01g linear /dev/nvme3n1(635793)
site260_00000 vg0 -wi-ao---- <120.03g linear /dev/nvme3n1(98838)
site263_00000 vg0 -wi-ao---- 50.01g linear /dev/nvme0n1(631966)
site264_00000 vg0 -wi-ao---- 39.01g linear /dev/nvme3n1(646292)
site265_00000 vg0 -wi-ao---- 378.08g linear /dev/nvme0n1(157738)
site267_00000 vg0 -wi-ao---- <363.08g linear /dev/nvme3n1(270393)
site268_00000 vg0 -wi-ao---- 41.01g linear /dev/nvme3n1(656279)
site271_00000 vg0 -wi-ao---- <57.02g linear /dev/nvme4n1(145956)
site273_00000 vg0 -wi-ao---- 93.02g linear /dev/nvme3n1(129565)
site275_00000 vg0 -wi-ao---- 37.01g linear /dev/nvme3n1(666778)
site277_00000 vg0 -wi-ao---- <61.02g linear /dev/nvme0n1(652451)
site279_00000 vg0 -wi-ao---- <28.01g linear /dev/nvme3n1(676253)
site280_00000 vg0 -wi-ao---- 102.02g linear /dev/nvme0n1(673961)
site281_00000 vg0 -wi-ao---- 10.00g linear /dev/nvme3n1(721835)
site283_00000 vg0 -wi-ao---- 39.01g linear /dev/nvme3n1(683423)
site284_00000 vg0 -wi-ao---- <111.03g linear /dev/nvme1n1(252476)
site285_00000 vg0 -wi-ao---- <57.02g linear /dev/nvme3n1(693410)
site300_00000 vg0 -wi-ao---- 43.01g linear /dev/nvme0n1(710066)
site301_00000 vg0 -wi-ao---- <19.01g linear /dev/nvme0n1(733368)
site310_00000 vg0 -wi-ao---- 14.00g linear /dev/nvme0n1(738234)
site312_00000 vg0 -wi-ao---- 48.01g linear /dev/nvme1n1(286277)
site314_00000 vg0 -wi-ao---- 43.01g linear /dev/nvme0n1(741819)
site315_00000 vg0 -wi-ao---- 45.01g linear /dev/nvme1n1(115481)
site316_00000 vg0 -wi-ao---- <30.01g linear /dev/nvme1n1(165413)
site317_00000 vg0 -wi-ao---- 10.00g linear /dev/nvme0n1(752830)
site325_00000 vg0 -wi-ao---- 50.01g linear /dev/nvme1n1(152610)
site327_00000 vg0 -wi-ao---- <88.02g linear /dev/nvme4n1(180781)
site328_00000 vg0 -wi-ao---- <30.01g linear /dev/nvme1n1(173095)
site342_00000 vg0 -wi-ao---- <30.01g linear /dev/nvme1n1(195885)
site345_00000 vg0 -wi-ao---- <23.01g linear /dev/nvme1n1(216882)
site347_00000 vg0 -wi-ao---- 39.01g linear /dev/nvme1n1(242489)
site348_00000 vg0 -wi-ao---- <21.01g linear /dev/nvme1n1(280899)
site351_00000 vg0 -wi-ao---- 48.01g linear /dev/nvme0n1(721077)
site354_00000 vg0 -wi-ao---- <35.01g linear /dev/nvme1n1(298568)
site355_00000 vg0 -wi-ao---- <30.01g linear /dev/nvme1n1(312908)
site357_00000 vg0 -wi-ao---- 39.01g linear /dev/nvme3n1(153379)
site365_00000 vg0 -wi-ao---- 381.08g linear /dev/nvme1n1(0)
site366_00000 vg0 -wi-ao---- 39.01g linear /dev/nvme1n1(339026)
site367_00000 vg0 -wi-ao---- 41.01g linear /dev/nvme1n1(366937)
site376_00000 vg0 -wi-ao---- 17.00g linear /dev/nvme0n1(374878)
site378_00000 vg0 -wi-ao---- <28.01g linear /dev/nvme0n1(379231)
site382_00000 vg0 -wi-ao---- 41.01g linear /dev/nvme0n1(386401)
site392_00000 vg0 -wi-ao---- 52.01g linear /dev/nvme0n1(396900)
site396_00000 vg0 -wi-ao---- <30.01g linear /dev/nvme0n1(410215)
site397_00000 vg0 -wi-ao---- 41.01g linear /dev/nvme0n1(417897)
site399_00000 vg0 -wi-ao---- 14.00g linear /dev/nvme0n1(428396)
site401_00000 vg0 -wi-ao---- <26.01g linear /dev/nvme0n1(431981)
site403_00000 vg0 -wi-ao---- <115.03g linear /dev/nvme0n1(438639)
site408_00000 vg0 -wi-ao---- <35.01g linear /dev/nvme0n1(468086)
site416_00000 vg0 -wi-ao---- <35.01g linear /dev/nvme0n1(477048)
site429_00000 vg0 -wi-ao---- <72.02g linear /dev/nvme0n1(16900)
site439_00000 vg0 -wi-ao---- <26.01g linear /dev/nvme0n1(35336)
site443_00000 vg0 -wi-ao---- 41.01g linear /dev/nvme0n1(41994)
site447_00000 vg0 -wi-ao---- <21.01g linear /dev/nvme4n1(203314)
site450_00000 vg0 -wi-ao---- <21.01g linear /dev/nvme0n1(52493)
site451_00000 vg0 -wi-ao---- 39.01g linear /dev/nvme0n1(57871)
site452_00000 vg0 -wi-ao---- 8.00g linear /dev/nvme2n1(757426)
site454_00000 vg0 -wi-ao---- 93.02g linear /dev/nvme0n1(67858)
site457_00000 vg0 -wi-ao---- <21.01g linear /dev/nvme0n1(91672)
site458_00000 vg0 -wi-ao---- <86.02g linear /dev/nvme0n1(97050)
site460_00000 vg0 -wi-ao---- 39.01g linear /dev/nvme0n1(119071)
site463_00000 vg0 -wi-ao---- <32.01g linear /dev/nvme0n1(129058)
site465_00000 vg0 -wi-ao---- 466.10g linear /dev/nvme4n1(402527)
site466_00000 vg0 -wi-ao---- 43.01g linear /dev/nvme0n1(137252)
site467_00000 vg0 -wi-ao---- 37.01g linear /dev/nvme0n1(148263)
site469_00000 vg0 -wi-ao---- <32.01g linear /dev/nvme3n1(589700)
site470_00000 vg0 -wi-ao---- 14.00g linear /dev/nvme1n1(393825)
site471_00000 vg0 -wi-ao---- <70.02g linear /dev/nvme1n1(97557)
site474_00000 vg0 -wi-ao---- 93.02g linear /dev/nvme1n1(407909)
site475_00000 vg0 -wi-ao---- <23.01g linear /dev/nvme1n1(490104)
site476_00000 vg0 -wi-ao---- <20.01g linear /dev/nvme1n1(501372)
site476_00000 vg0 -wi-ao---- <20.01g linear /dev/nvme1n1(762815)
site476_00000 vg0 -wi-ao---- <20.01g linear /dev/nvme2n1(759475)
site478_00000 vg0 -wi-ao---- 41.01g linear /dev/nvme1n1(516736)
site481_00000 vg0 -wi-ao---- 48.01g linear /dev/nvme1n1(582288)
site482_00000 vg0 -wi-ao---- <35.01g linear /dev/nvme1n1(599445)
site483_00000 vg0 -wi-ao---- 17.00g linear /dev/nvme1n1(654754)
site491_00000 vg0 -wi-ao---- <70.02g linear /dev/nvme3n1(163366)
site496_00000 vg0 -wi-ao---- 37.01g linear /dev/nvme1n1(672422)
site502_00000 vg0 -wi-ao---- 52.01g linear /dev/nvme1n1(689579)
site507_00000 vg0 -wi-ao---- <28.01g linear /dev/nvme1n1(705455)
site509_00000 vg0 -wi-ao---- <59.02g linear /dev/nvme1n1(712625)
site511_00000 vg0 -wi-ao---- <68.02g linear /dev/nvme1n1(127004)
site514_00000 vg0 -wi-ao---- 45.01g linear /dev/nvme1n1(727733)
site515_00000 vg0 -wi-ao---- 37.01g linear /dev/nvme1n1(739256)
site517_00000 vg0 -wi-ao---- 12.00g linear /dev/nvme1n1(748731)
site534_00000 vg0 -wi-ao---- 39.01g linear /dev/nvme2n1(452457)
site537_00000 vg0 -wi-ao---- 104.02g linear /dev/nvme0n1(537992)
site557_00000 vg0 -wi-ao---- <32.01g linear /dev/nvme1n1(144416)
site569_00000 vg0 -wi-ao---- <149.04g linear /dev/nvme2n1(0)
site571_00000 vg0 -wi-ao---- <86.02g linear /dev/nvme2n1(487282)
site602_00000 vg0 -wi-ao---- 97.02g linear /dev/nvme2n1(462444)
site615_00000 vg0 -wi-ao---- 8.00g linear /dev/nvme3n1(719786)
site629_00000 vg0 -wi-ao---- <66.02g linear /dev/nvme0n1(0)
site632_00000 vg0 -wi-ao---- <32.01g linear /dev/nvme4n1(208692)
site645_00000 vg0 -wi-ao---- 8.00g linear /dev/nvme2n1(509303)
site646_00000 vg0 -wi-ao---- <63.02g linear /dev/nvme2n1(511352)
site680_00000 vg0 -wi-ao---- <149.04g linear /dev/nvme4n1(364374)
site681_00000 vg0 -wi-ao---- <441.10g linear /dev/nvme2n1(527484)
site687_00000 vg0 -wi-ao---- 93.02g linear /dev/nvme2n1(359506)
site695_00000 vg0 -wi-ao---- 102.02g linear /dev/nvme4n1(521849)
site698_00000 vg0 -wi-ao---- 14.00g linear /dev/nvme4n1(547967)
site700_00000 vg0 -wi-ao---- 17.00g linear /dev/nvme0n1(755391)
site706_00000 vg0 -wi-ao---- 39.01g linear /dev/nvme3n1(613258)
site707_00000 vg0 -wi-ao---- <21.01g linear /dev/nvme4n1(551552)
site708_00000 vg0 -wi-ao---- <156.04g linear /dev/nvme4n1(556930)
site710_00000 vg0 -wi-ao---- 8.00g linear /dev/nvme2n1(383320)
site711_00000 vg0 -wi-ao---- 12.00g linear /dev/nvme2n1(385369)
site715_00000 vg0 -wi-ao---- 8.00g linear /dev/nvme2n1(640405)
site716_00000 vg0 -wi-ao---- <21.01g linear /dev/nvme1n1(307530)
site717_00000 vg0 -wi-ao---- 10.00g linear /dev/nvme3n1(623245)
site718_00000 vg0 -wi-ao---- <30.01g linear /dev/nvme4n1(596875)
site720_00000 vg0 -wi-ao---- <210.05g linear /dev/nvme2n1(642454)
site724_00000 vg0 -wi-ao---- 10.00g linear /dev/nvme2n1(388442)
site732_00000 vg0 -wi-ao---- 54.01g linear /dev/nvme4n1(614797)
site737_00000 vg0 -wi-ao---- 41.01g linear /dev/nvme4n1(650392)
site741_00000 vg0 -wi-ao---- 8.00g linear /dev/nvme2n1(696226)
site742_00000 vg0 -wi-ao---- <19.01g linear /dev/nvme4n1(628883)
site743_00000 vg0 -wi-ao---- <147.04g linear /dev/nvme1n1(527235)
site744_00000 vg0 -wi-ao---- 39.01g linear /dev/nvme4n1(633749)
site746_00000 vg0 -wi-ao---- <72.02g linear /dev/nvme1n1(320590)
site753_00000 vg0 -wi-ao---- <70.02g linear /dev/nvme1n1(349013)
site754_00000 vg0 -wi-ao---- 41.01g linear /dev/nvme1n1(377436)
site755_00000 vg0 -wi-ao---- 41.01g linear /dev/nvme1n1(397410)
site759_00000 vg0 -wi-ao---- <21.01g linear /dev/nvme1n1(495994)
site760_00000 vg0 -wi-ao---- <390.09g linear /dev/nvme3n1(0)
site760_00000 vg0 -wi-ao---- <390.09g linear /dev/nvme3n1(363341)
site761_00000 vg0 -wi-ao---- 48.01g linear /dev/nvme1n1(504445)
site762_00000 vg0 -wi-ao---- <68.02g linear /dev/nvme1n1(564876)
site763_00000 vg0 -wi-ao---- 228.05g linear /dev/nvme1n1(431723)
site764_00000 vg0 -wi-ao---- <29.01g linear /dev/nvme1n1(594579)
site764_00000 vg0 -wi-ao---- <29.01g linear /dev/nvme4n1(643736)
site765_00000 vg0 -wi-ao---- <35.01g linear /dev/nvme1n1(608407)
site766_00000 vg0 -wi-ao---- <26.01g linear /dev/nvme1n1(617369)
site768_00000 vg0 -wi-ao---- <120.03g linear /dev/nvme1n1(624027)
site769_00000 vg0 -wi-ao---- 52.01g linear /dev/nvme1n1(659107)
site770_00000 vg0 -wi-ao---- <30.01g linear /dev/nvme1n1(681897)
site773_00000 vg0 -wi-ao---- 10.00g linear /dev/nvme1n1(702894)
site774_00000 vg0 -wi-ao---- 277.06g linear /dev/nvme2n1(38153)
site775_00000 vg0 -wi-ao---- 576.12g linear /dev/nvme4n1(216886)
site779_00000 vg0 -wi-ao---- <70.02g linear /dev/nvme2n1(109081)
site781_00000 vg0 -wi-ao---- 232.05g linear /dev/nvme2n1(391003)
site783_00000 vg0 -wi-ao---- 37.01g linear /dev/nvme2n1(127005)
site786_00000 vg0 -wi-ao---- 43.01g linear /dev/nvme1n1(751804)
site787_00000 vg0 -wi-ao---- 10.00g linear /dev/nvme2n1(239415)
site788_00000 vg0 -wi-ao---- 327.07g linear /dev/nvme2n1(155685)
site791_00000 vg0 -wi-ao---- <3.91t linear /dev/nvme6n1(0)
site792_00000 vg0 -wi-ao---- <600.13g linear /dev/nvme5n1(0)
[cid:image001.png at 01D86F5D.6F1098F0]
Disclaimer : This email and any files transmitted with it are confidential and intended solely for intended recipients. If you are not the named addressee you should not disseminate, distribute, copy or alter this email. Any views or opinions presented in this email are solely those of the author and might not represent those of Physician Select Management. Warning: Although Physician Select Management has taken reasonable precautions to ensure no viruses are present in this email, the company cannot accept responsibility for any loss or damage arising from the use of this email or attachments.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linbit.com/pipermail/drbd-user/attachments/20220524/6423ad98/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 155554 bytes
Desc: image001.png
URL: <http://lists.linbit.com/pipermail/drbd-user/attachments/20220524/6423ad98/attachment-0001.png>
More information about the drbd-user
mailing list