<html dir="ltr"><head></head><body style="text-align:left; direction:ltr;"><div>We have several hundred projects under this storage, so theoretically we can do the split if required. However, could you please clarify, what are the limitations/drawbacks of a single volume use? As I've mentioned we were able to achieve stable 12Gbps replication sync, which is equal to SAS HBA throughput where the HDD enclosures connected to. Our original plan was to expand this volume to 8 enclosures (872TiB), which is our maximum for a single controller port on the hardware level, then introduce another volume.</div><div><br></div><div>As a side note, we were able to run DRBD9 for some time with 3 nodes, even before you adjusted drbdmeta size limitation. It looks like you do not perform the meta size check while extending DRBD volume online with drbdadm resize. Everything worked fine until we rebooted the node to apply some system updates, then we got drbdmeta size error and had to downgrade to DRBD 8, and 2 nodes setup. </div><div><br></div><div>I'll give another try with increased "ping-timeout" shortly and let you know if it resolved the problem. Anyway, thank you for all your assistance!</div><div></div><div><br></div><div>-----Original Message-----</div><div><b>From</b>: Robert Altnoeder <<a href="mailto:Robert%20Altnoeder%20%3crobert.altnoeder@linbit.com%3e">robert.altnoeder@linbit.com</a>></div><div><b>To</b>: <a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a></div><div><b>Subject</b>: Re: [DRBD-user] PingAck did not arrive in time.</div><div><b>Date</b>: Mon, 24 Jun 2019 16:58:34 +0200</div><div><br></div><pre>On 6/24/19 3:39 PM, Oleksiy Evin wrote:</pre><pre></pre><pre>At this moment we're able to achieve about 1.2GB while replication</pre><pre>which is little bit slower then a single enclosure speed, but enough</pre><pre>for all our needs. Potentially we may grow up above PB next year or two.</pre><pre></pre><pre><br></pre><pre>I don't think so, at least not with a single volume on the current</pre><pre>version of DRBD, because 1 PiB is currently the maximum gross size of a</pre><pre>single DRBD volume.</pre><pre><br></pre><pre></pre><pre>Do you advise any different setup?</pre><pre></pre><pre><br></pre><pre>I would certainly recommend splitting the data if it's possible. I know</pre><pre>that 4k/8k video material can be very large in size, but I guess those</pre><pre>~600 TiB of data is not the working set size for a single movie</pre><pre>editing/finish/effects/... project, or is it?</pre><pre>If it is rather something like an archive, or a single volume with mixed</pre><pre>content, then partitioning by either date or content type could be a</pre><pre>possible solution.</pre><pre><br></pre><pre>br,</pre><pre>Robert</pre><pre><br></pre><pre>_______________________________________________</pre><pre>drbd-user mailing list</pre><pre><a href="mailto:drbd-user@lists.linbit.com">drbd-user@lists.linbit.com</a></pre><pre><a href="http://lists.linbit.com/mailman/listinfo/drbd-user">http://lists.linbit.com/mailman/listinfo/drbd-user</a></pre><pre><br></pre></body></html>