<div dir="ltr"><div class="gmail_default" style="font-size:small">We plan to move from 8 to drbd-9.0.16. I will post it here how this will handle the resync problem.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">Thanks!</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Oct 17, 2019 at 10:21 AM Digimer <<a href="mailto:lists@alteeve.ca">lists@alteeve.ca</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">8.4.4 is old. Can you upgrade to the latest 8.4.11? I believe 8.4.4 was<br>
older than the other reporters with a similar issue, so this may be<br>
fixed. Upgrading to .11 should not cause any issues.<br>
<br>
PS - Please keep replies on the list. These discussions help others by<br>
being in the archives.<br>
<br>
digimer<br>
<br>
On 2019-10-17 9:54 a.m., Paras pradhan wrote:<br>
> drbd version is drbd-8.4.4-0.27.4.2 and yes are upgrading it to version<br>
> 9 in the near future.<br>
> <br>
> No it is not a live snapshot. Both drbd nodes were shutdown and used<br>
> clonezilla bootable image to take backup and also to restore.<br>
> <br>
> Thanks<br>
> Paras.<br>
> <br>
> On Wed, Oct 16, 2019 at 7:26 PM Digimer <<a href="mailto:lists@alteeve.ca" target="_blank">lists@alteeve.ca</a><br>
> <mailto:<a href="mailto:lists@alteeve.ca" target="_blank">lists@alteeve.ca</a>>> wrote:<br>
> <br>
> I don't see the version, but looking in the mailing list archives, the<br>
> common recommendation is to upgrade. What version of DRBD 8 are you<br>
> using, exactly?<br>
> <br>
> Does the resync happen only after recovery? Is the backups of the nodes<br>
> done via live-snapshot? If so, then if there is _any_ time between the<br>
> two nodes being snapped, the UUID will differ and could be causing this.<br>
> <br>
> digimer<br>
> <br>
> On 2019-10-16 10:04 a.m., Paras pradhan wrote:<br>
> > Hi<br>
> ><br>
> > Here is the log for one of the drbd resource (which is 300GB).<br>
> ><br>
> > --<br>
> > [ 194.780377] block drbd1: disk( Diskless -> Attaching )<br>
> > [ 194.780536] block drbd1: max BIO size = 1048576<br>
> > [ 194.780548] block drbd1: drbd_bm_resize called with capacity ==<br>
> 629126328<br>
> > [ 194.783069] block drbd1: resync bitmap: bits=78640791 words=1228763<br>
> > pages=2400<br>
> > [ 194.783077] block drbd1: size = 300 GB (314563164 KB)<br>
> > [ 194.793958] block drbd1: bitmap READ of 2400 pages took 3 jiffies<br>
> > [ 194.796342] block drbd1: recounting of set bits took additional<br>
> 1 jiffies<br>
> > [ 194.796348] block drbd1: 0 KB (0 bits) marked out-of-sync by on<br>
> disk<br>
> > bit-map.<br>
> > [ 194.796359] block drbd1: disk( Attaching -> Outdated )<br>
> > [ 194.796366] block drbd1: attached to UUIDs<br>
> > 56E4CF14A115440C:0000000000000000:02DCAB23D758DA48:02DBAB23D758DA49<br>
> > [ 475.740272] block drbd1: drbd_sync_handshake:<br>
> > [ 475.740280] block drbd1: self<br>
> > 56E4CF14A115440C:0000000000000000:02DCAB23D758DA48:02DBAB23D758DA49<br>
> > bits:0 flags:0<br>
> > [ 475.740288] block drbd1: peer<br>
> > F5A226CE3F2DA2F2:0000000000000000:56E5CF14A115440D:56E4CF14A115440D<br>
> > bits:0 flags:0<br>
> > [ 475.740295] block drbd1: uuid_compare()=-2 by rule 60<br>
> > [ 475.740299] block drbd1: Writing the whole bitmap, full sync<br>
> required<br>
> > after drbd_sync_handshake.<br>
> > [ 475.757877] block drbd1: bitmap WRITE of 2400 pages took 4 jiffies<br>
> > [ 475.757888] block drbd1: 300 GB (78640791 bits) marked<br>
> out-of-sync by<br>
> > on disk bit-map.<br>
> > [ 475.758018] block drbd1: peer( Unknown -> Secondary ) conn(<br>
> > WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate )<br>
> > [ 475.800134] block drbd1: receive bitmap stats [Bytes(packets)]:<br>
> plain<br>
> > 0(0), RLE 23(1), total 23; compression: 100.0%<br>
> > [ 475.802697] block drbd1: send bitmap stats [Bytes(packets)]: plain<br>
> > 0(0), RLE 23(1), total 23; compression: 100.0%<br>
> > [ 475.802717] block drbd1: conn( WFBitMapT -> WFSyncUUID )<br>
> > [ 475.815155] block drbd1: updated sync uuid<br>
> > CEF5B26573C154CC:0000000000000000:02DCAB23D758DA48:02DBAB23D758DA49<br>
> > [ 475.815377] block drbd1: helper command: /sbin/drbdadm<br>
> > before-resync-target minor-1<br>
> > [ 475.820270] block drbd1: helper command: /sbin/drbdadm<br>
> > before-resync-target minor-1 exit code 0 (0x0)<br>
> > [ 475.820293] block drbd1: conn( WFSyncUUID -> SyncTarget ) disk(<br>
> > Outdated -> Inconsistent )<br>
> > [ 475.820306] block drbd1: Began resync as SyncTarget (will sync<br>
> > 314563164 KB [78640791 bits set]).<br>
> > [ 538.518371] block drbd1: peer( Secondary -> Primary )<br>
> > [ 538.548954] block drbd1: role( Secondary -> Primary )<br>
> > [ 2201.521232] block drbd1: conn( SyncTarget -> PausedSyncT )<br>
> user_isp(<br>
> > 0 -> 1 )<br>
> > [ 2201.521237] block drbd1: Resync suspended<br>
> > [ 2301.930484] block drbd1: conn( PausedSyncT -> SyncTarget )<br>
> user_isp(<br>
> > 1 -> 0 )<br>
> > [ 2301.930490] block drbd1: Syncer continues.<br>
> > [ 5216.750314] block drbd1: Resync done (total 4740 sec; paused<br>
> 100 sec;<br>
> > 67792 K/sec)<br>
> > [ 5216.750323] block drbd1: 98 % had equal checksums, eliminated:<br>
> > 311395164K; transferred 3168000K total 314563164K<br>
> > [ 5216.750333] block drbd1: updated UUIDs<br>
> > F5A226CE3F2DA2F3:0000000000000000:CEF5B26573C154CD:56E5CF14A115440D<br>
> > [ 5216.750343] block drbd1: conn( SyncTarget -> Connected ) disk(<br>
> > Inconsistent -> UpToDate )<br>
> > [ 5216.750518] block drbd1: helper command: /sbin/drbdadm<br>
> > after-resync-target minor-1<br>
> > [ 5216.845211] block drbd1: helper command: /sbin/drbdadm<br>
> > after-resync-target minor-1 exit code 0 (0x0)<br>
> > ---<br>
> ><br>
> ><br>
> > Thanks!<br>
> ><br>
> > On Wed, Oct 16, 2019 at 12:46 AM Digimer <<a href="mailto:lists@alteeve.ca" target="_blank">lists@alteeve.ca</a><br>
> <mailto:<a href="mailto:lists@alteeve.ca" target="_blank">lists@alteeve.ca</a>><br>
> > <mailto:<a href="mailto:lists@alteeve.ca" target="_blank">lists@alteeve.ca</a> <mailto:<a href="mailto:lists@alteeve.ca" target="_blank">lists@alteeve.ca</a>>>> wrote:<br>
> ><br>
> > On 2019-10-15 4:58 p.m., Paras pradhan wrote:<br>
> > > Hi<br>
> > ><br>
> > > I have a two node drbd 8 cluster. We are doing some test and<br>
> while<br>
> > drbd<br>
> > > resources are consistent/synced on both nodes, I powered off<br>
> both<br>
> > nodes<br>
> > > and took a bare metal backup using clonezilla. <br>
> > ><br>
> > > Then I restored the both nodes using the backup and started drbd<br>
> > on both<br>
> > > nodes. On one of the nodes it starts to sync all over again. <br>
> > ><br>
> > > My question is: when I took the backup drbd resources are synced<br>
> > and why<br>
> > > it is starting all over again? I hope I explained clearly.<br>
> > ><br>
> > > Thanks in advance !<br>
> > > Paras.<br>
> ><br>
> > Do you have the system logs from when you started DRBD on the<br>
> nodes<br>
> > post-recovery? There should be DRBD log entries on both nodes<br>
> as DRBD<br>
> > started. The reason/trigger of the resync will likely be<br>
> explained in<br>
> > there. If not, please share the logs.<br>
> ><br>
> > --<br>
> > Digimer<br>
> > Papers and Projects: <a href="https://alteeve.com/w/" rel="noreferrer" target="_blank">https://alteeve.com/w/</a><br>
> > "I am, somehow, less interested in the weight and convolutions of<br>
> > Einstein’s brain than in the near certainty that people of<br>
> equal talent<br>
> > have lived and died in cotton fields and sweatshops." -<br>
> Stephen Jay<br>
> > Gould<br>
> ><br>
> <br>
> <br>
> -- <br>
> Digimer<br>
> Papers and Projects: <a href="https://alteeve.com/w/" rel="noreferrer" target="_blank">https://alteeve.com/w/</a><br>
> "I am, somehow, less interested in the weight and convolutions of<br>
> Einstein’s brain than in the near certainty that people of equal talent<br>
> have lived and died in cotton fields and sweatshops." - Stephen Jay<br>
> Gould<br>
> <br>
<br>
<br>
-- <br>
Digimer<br>
Papers and Projects: <a href="https://alteeve.com/w/" rel="noreferrer" target="_blank">https://alteeve.com/w/</a><br>
"I am, somehow, less interested in the weight and convolutions of<br>
Einstein’s brain than in the near certainty that people of equal talent<br>
have lived and died in cotton fields and sweatshops." - Stephen Jay Gould<br>
</blockquote></div>