<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body>
<div>Hi,</div>
<div>I see some problems using very large volumes. Initially I tried a 480TB volume and it failed at "drbdadm up ...".</div>
<div>Then I reduced the size till I got it working at 125TB. At 130TB it fails. Maybe there is a limit at 128 TB?</div>
<div><br>
</div>
<div>My system is running Opensuse Leap 15. I have tested both on DRBD 9.0.13 and 9.0.14.
</div>
<div><br>
</div>
<div>My configuration commands are shown below, as well as the errors listed in the message log. </div>
<div>The config file contains the same as the one shown in the top of page 22 in the Users Guide.
</div>
<div>(Basic two node active/passive setup)</div>
<div><br>
</div>
<div>Regards,</div>
<div>Svein Erik Aasen</div>
<div><br>
</div>
<div><br>
</div>
<div><b>fdisk -l</b></div>
<div>Disk /dev/sdb: 480.2 TiB, 527982477180928 bytes, 1031215775744 sectors</div>
<div>Units: sectors of 1 * 512 = 512 bytes</div>
<div>Sector size (logical/physical): 512 bytes / 4096 bytes</div>
<div>I/O size (minimum/optimal): 262144 bytes / 262144 bytes</div>
<div>Disklabel type: gpt</div>
<div>Disk identifier: B2F29E9D-F576-494F-9BA7-DA2D28A0A974</div>
<div><br>
</div>
<div>Device Start End Sectors Size Type</div>
<div>/dev/sdb1 2048 1031215775710 1031215773663 480.2T Linux filesystem</div>
<div><br>
</div>
<div></div>
<div><br>
</div>
<div><b>drbdadm -v create-md drbd1</b></div>
<div>drbdmeta 1 v09 /dev/sdb1 internal create-md 1 </div>
<div>You want me to create a v09 style flexible-size internal meta data block.</div>
<div>There appears to be a v09 flexible-size internal meta data block</div>
<div>already in place on /dev/sdb1 at byte offset 527982476107776</div>
<div><br>
</div>
<div>Do you really want to overwrite the existing meta-data?</div>
<div>[need to type 'yes' to confirm] yes</div>
<div><br>
</div>
<div>md_offset 527982476107776</div>
<div>al_offset 527982476075008</div>
<div>bm_offset 527966363328512</div>
<div><br>
</div>
<div>Found some data</div>
<div><br>
</div>
<div> ==> This might destroy existing data! <==</div>
<div><br>
</div>
<div>Do you want to proceed?</div>
<div>[need to type 'yes' to confirm] yes</div>
<div><br>
</div>
<div>initializing activity log</div>
<div>initializing bitmap (15735104 KB) to all zero</div>
<div>Writing meta data...</div>
<div>New drbd meta data block successfully created.</div>
<div>drbdmeta 1 v09 /dev/sdb1 internal write-dev-uuid C21427160033D05D </div>
<div></div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><b>drbdadm -v up drbd1</b></div>
<div>drbdsetup new-resource drbd1 1 --quorum=off </div>
<div>drbdsetup new-minor drbd1 1 0 </div>
<div>drbdsetup new-peer drbd1 2 --_name=wave --protocol=C </div>
<div>drbdsetup new-path drbd1 2 ipv4:10.0.20.1:7789 ipv4:10.0.20.2:7789 </div>
<div>drbdmeta 1 v09 /dev/sdb1 internal apply-al </div>
<div>drbdsetup attach 1 /dev/sdb1 /dev/sdb1 internal </div>
<div>1: Failure: (118) IO error(s) occurred during initial access to meta-data.</div>
<div><br>
</div>
<div>Command 'drbdsetup attach 1 /dev/sdb1 /dev/sdb1 internal' terminated with exit code 10</div>
<div></div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><b>dmesg -T</b></div>
<div>
<div>[ma. juni 18 14:43:54 2018] drbd drbd1: Starting worker thread (from drbdsetup [8116])</div>
<div>[ma. juni 18 14:43:54 2018] drbd drbd1 wave: Starting sender thread (from drbdsetup [8120])</div>
<div>[ma. juni 18 14:43:54 2018] drbd drbd1/0 drbd1: disk( Diskless -> Attaching )</div>
<div>[ma. juni 18 14:43:54 2018] drbd drbd1/0 drbd1: Maximum number of peer devices = 1</div>
<div>[ma. juni 18 14:43:54 2018] drbd drbd1: Method to ensure write ordering: flush</div>
<div>[ma. juni 18 14:43:54 2018] drbd drbd1/0 drbd1: drbd_bm_resize called with capacity == 1031184303376</div>
<div>[ma. juni 18 14:44:02 2018] drbd drbd1/0 drbd1: resync bitmap: bits=128898037922 words=2014031843 pages=3933656</div>
<div>[ma. juni 18 14:44:02 2018] drbd drbd1/0 drbd1: size = 480 TB (515592151688 KB)</div>
<div>[ma. juni 18 14:44:10 2018] drbd drbd1/0 drbd1: IO ERROR 10 on bitmap page idx 788057</div>
<div>[ma. juni 18 14:44:21 2018] drbd drbd1/0 drbd1: IO ERROR 10 on bitmap page idx 1836633</div>
<div>[ma. juni 18 14:44:32 2018] drbd drbd1/0 drbd1: IO ERROR 10 on bitmap page idx 2885209</div>
<div>[ma. juni 18 14:44:43 2018] drbd drbd1/0 drbd1: we had at least one MD IO ERROR during bitmap IO</div>
<div>[ma. juni 18 14:44:47 2018] drbd drbd1/0 drbd1: recounting of set bits took additional 3912ms</div>
<div>[ma. juni 18 14:44:47 2018] drbd drbd1/0 drbd1: disk( Attaching -> Diskless )</div>
<div></div>
</div>
<div></div>
</body>
</html>