<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns="http://www.w3.org/TR/REC-html40">

<head>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii">
<meta name=ProgId content=Word.Document>
<meta name=Generator content="Microsoft Word 11">
<meta name=Originator content="Microsoft Word 11">
<link rel=File-List href="cid:filelist.xml@01C77B94.A28B8FA0">
<!--[if gte mso 9]><xml>
 <o:OfficeDocumentSettings>
  <o:DoNotRelyOnCSS/>
 </o:OfficeDocumentSettings>
</xml><![endif]--><!--[if gte mso 9]><xml>
 <w:WordDocument>
  <w:SpellingState>Clean</w:SpellingState>
  <w:GrammarState>Clean</w:GrammarState>
  <w:DocumentKind>DocumentEmail</w:DocumentKind>
  <w:EnvelopeVis/>
  <w:ValidateAgainstSchemas/>
  <w:SaveIfXMLInvalid>false</w:SaveIfXMLInvalid>
  <w:IgnoreMixedContent>false</w:IgnoreMixedContent>
  <w:AlwaysShowPlaceholderText>false</w:AlwaysShowPlaceholderText>
  <w:Compatibility>
   <w:BreakWrappedTables/>
   <w:SnapToGridInCell/>
   <w:WrapTextWithPunct/>
   <w:UseAsianBreakRules/>
   <w:UseWord2002TableStyleRules/>
  </w:Compatibility>
  <w:BrowserLevel>MicrosoftInternetExplorer4</w:BrowserLevel>
 </w:WordDocument>
</xml><![endif]--><!--[if gte mso 9]><xml>
 <w:LatentStyles DefLockedState="false" LatentStyleCount="156">
 </w:LatentStyles>
</xml><![endif]-->
<style>
<!--
 /* Font Definitions */
 @font-face
        {font-family:Tahoma;
        panose-1:2 11 6 4 3 5 4 4 2 4;
        mso-font-alt:"?l?r ?????????????????????????";
        mso-font-charset:0;
        mso-generic-font-family:swiss;
        mso-font-pitch:variable;
        mso-font-signature:1627421319 -2147483648 8 0 66047 0;}
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
        {mso-style-parent:"";
        margin:0in;
        margin-bottom:.0001pt;
        mso-pagination:widow-orphan;
        font-size:12.0pt;
        font-family:"Times New Roman";
        mso-fareast-font-family:"Times New Roman";}
a:link, span.MsoHyperlink
        {color:blue;
        text-decoration:underline;
        text-underline:single;}
a:visited, span.MsoHyperlinkFollowed
        {color:purple;
        text-decoration:underline;
        text-underline:single;}
span.EmailStyle17
        {mso-style-type:personal-compose;
        mso-style-noshow:yes;
        mso-ansi-font-size:10.0pt;
        mso-bidi-font-size:10.0pt;
        font-family:Arial;
        mso-ascii-font-family:Arial;
        mso-hansi-font-family:Arial;
        mso-bidi-font-family:Arial;
        color:windowtext;}
span.SpellE
        {mso-style-name:"";
        mso-spl-e:yes;}
span.GramE
        {mso-style-name:"";
        mso-gram-e:yes;}
@page Section1
        {size:8.5in 11.0in;
        margin:1.0in 1.25in 1.0in 1.25in;
        mso-header-margin:.5in;
        mso-footer-margin:.5in;
        mso-paper-source:0;}
div.Section1
        {page:Section1;}
-->
</style>
<!--[if gte mso 10]>
<style>
 /* Style Definitions */ 
 table.MsoNormalTable
        {mso-style-name:"Table Normal";
        mso-tstyle-rowband-size:0;
        mso-tstyle-colband-size:0;
        mso-style-noshow:yes;
        mso-style-parent:"";
        mso-padding-alt:0in 5.4pt 0in 5.4pt;
        mso-para-margin:0in;
        mso-para-margin-bottom:.0001pt;
        mso-pagination:widow-orphan;
        font-size:10.0pt;
        font-family:"Times New Roman";
        mso-ansi-language:#0400;
        mso-fareast-language:#0400;
        mso-bidi-language:#0400;}
</style>
<![endif]-->
</head>

<body lang=EN-US link=blue vlink=purple style='tab-interval:.5in'>

<div class=Section1>

<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'>Hi all,<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'>I have been chasing this issue that we have been seeing a
lot with not much success and unfortunately I have a few other <span
class=SpellE>drbd</span> issues needing investigation. <span
style='mso-spacerun:yes'>&nbsp;</span>Essentially, <span class=SpellE>resyncing</span>
seems to have problem completing because the activity log and <span
class=SpellE>resync</span> cache cannot be cleared successfully for a long time
at the end of <span class=SpellE>resync</span> session. <span
style='mso-spacerun:yes'>&nbsp;</span>Here are some logs:<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'>On one node ======:<br>
Apr<span class=GramE>&nbsp; 4</span> 02:24:29 <span class=SpellE>ellwood</span>
kernel: drbd1: Began <span class=SpellE>resync</span> as <span class=SpellE>PausedSyncT</span>
(will sync 13336132 KB [3334033 bits set]).<br>
Apr<span class=GramE>&nbsp; 4</span> 02:24:29 <span class=SpellE>ellwood</span>
kernel: drbd1: Writing meta data super block now.<br>
Apr<span class=GramE>&nbsp; 4</span> 02:32:52 <span class=SpellE>ellwood</span>
kernel: drbd1: <span class=SpellE>aftr_isp</span>( 1 -&gt; 0 )<br>
Apr<span class=GramE>&nbsp; 4</span> 02:32:52 <span class=SpellE>ellwood</span>
kernel: drbd1: <span class=SpellE>conn</span>( <span class=SpellE>PausedSyncT</span>
-&gt; <span class=SpellE>SyncTarget</span> ) <span class=SpellE>peer_isp</span>(
1 -&gt; 0 )<br>
Apr<span class=GramE>&nbsp; 4</span> 02:32:52 <span class=SpellE>ellwood</span>
kernel: drbd1: <span class=SpellE>Syncer</span> continues.<br>
Apr<span class=GramE>&nbsp; 4</span> 02:34:04 <span class=SpellE>ellwood</span>
kernel: drbd1: <span class=SpellE>al_complete_io</span>() called on inactive
extent 1532713819<br>
Apr<span class=GramE>&nbsp; 4</span> 02:39:06 <span class=SpellE>ellwood</span>
kernel: drbd1: <span class=SpellE>drbd_rs_complete_io</span>() called, but
extent not found<br>
Apr<span class=GramE>&nbsp; 4</span> 02:39:06 <span class=SpellE>ellwood</span>
kernel: drbd1: <span class=SpellE>al_complete_io</span>() called on inactive
extent 1532713819<br>
Apr<span class=GramE>&nbsp; 4</span> 02:40:37 <span class=SpellE>ellwood</span>
kernel: drbd1: Retrying <span class=SpellE>drbd_rs_del_all</span>() later. <span
class=SpellE><span class=GramE>refcnt</span></span><span class=GramE>=</span>1<br>
Apr<span class=GramE>&nbsp; 4</span> 02:41:07 <span class=SpellE>ellwood</span>
kernel: drbd1: Retrying <span class=SpellE>drbd_rs_del_all</span>() later. <span
class=SpellE><span class=GramE>refcnt</span></span><span class=GramE>=</span>1<br>
Apr<span class=GramE>&nbsp; 4</span> 02:41:07 <span class=SpellE>ellwood</span>
kernel: drbd1: Retrying <span class=SpellE>drbd_rs_del_all</span>() later. <span
class=SpellE><span class=GramE>refcnt</span></span><span class=GramE>=</span>1<br>
Apr<span class=GramE>&nbsp; 4</span> 02:41:07 <span class=SpellE>ellwood</span>
kernel: drbd1: Retrying <span class=SpellE>drbd_rs_del_all</span>() later. <span
class=SpellE><span class=GramE>refcnt</span></span><span class=GramE>=</span>1<br>
Apr<span class=GramE>&nbsp; 4</span> 02:41:08 <span class=SpellE>ellwood</span>
kernel: drbd1: Retrying <span class=SpellE>drbd_rs_del_all</span>() later. <span
class=SpellE><span class=GramE>refcnt</span></span><span class=GramE>=</span>1<br>
Apr<span class=GramE>&nbsp; 4</span> 02:41:08 <span class=SpellE>ellwood</span>
kernel: drbd1: Retrying <span class=SpellE>drbd_rs_del_all</span>() later. <span
class=SpellE><span class=GramE>refcnt</span></span><span class=GramE>=</span>1<br>
Apr<span class=GramE>&nbsp; 4</span> 02:41:08 <span class=SpellE>ellwood</span>
kernel: drbd1: Retrying <span class=SpellE>drbd_rs_del_all</span>() later. <span
class=SpellE><span class=GramE>refcnt</span></span><span class=GramE>=</span>1<br>
Apr<span class=GramE>&nbsp; 4</span> 02:41:09 <span class=SpellE>ellwood</span>
kernel: drbd1: Retrying <span class=SpellE>drbd_rs_del_all</span>() later. <span
class=SpellE><span class=GramE>refcnt</span></span><span class=GramE>=</span>1<br>
Apr<span class=GramE>&nbsp; 4</span> 02:41:09 <span class=SpellE>ellwood</span>
kernel: drbd1: Retrying <span class=SpellE>drbd_rs_del_all</span>() later. <span
class=SpellE><span class=GramE>refcnt</span></span><span class=GramE>=</span>1<br>
Apr<span class=GramE>&nbsp; 4</span> 02:41:31 <span class=SpellE>ellwood</span>
kernel: drbd1: Retrying <span class=SpellE>drbd_rs_del_all</span>() later. <span
class=SpellE><span class=GramE>refcnt</span></span><span class=GramE>=</span>1<br>
Apr<span class=GramE>&nbsp; 4</span> 02:41:31 <span class=SpellE>ellwood</span>
kernel: drbd1: Retrying <span class=SpellE>drbd_rs_del_all</span>() later. <span
class=SpellE><span class=GramE>refcnt</span></span><span class=GramE>=</span>1<br>
Apr<span class=GramE>&nbsp; 4</span> 02:41:31 <span class=SpellE>ellwood</span>
kernel: drbd1: Retrying <span class=SpellE>drbd_rs_del_all</span>() later. <span
class=SpellE><span class=GramE>refcnt</span></span><span class=GramE>=</span>1<br>
<br>
On the other node====<br>
Apr<span class=GramE>&nbsp; 4</span> 02:24:47 <span class=SpellE>jake</span>
kernel: drbd1: Began <span class=SpellE>resync</span> as <span class=SpellE>PausedSyncS</span>
(will sync 13336132 KB [3334033 bits set]).<br>
Apr<span class=GramE>&nbsp; 4</span> 02:24:47 <span class=SpellE>jake</span>
kernel: drbd1: Writing meta data super block now.<br>
Apr<span class=GramE>&nbsp; 4</span> 02:32:52 <span class=SpellE>jake</span>
kernel: drbd1: <span class=SpellE>peer_isp</span>( 1 -&gt; 0 )<br>
Apr<span class=GramE>&nbsp; 4</span> 02:32:52 <span class=SpellE>jake</span>
kernel: drbd1: <span class=SpellE>conn</span>( <span class=SpellE>PausedSyncS</span>
-&gt; <span class=SpellE>SyncSource</span> ) <span class=SpellE>aftr_isp</span>(
1 -&gt; 0 )<br>
Apr<span class=GramE>&nbsp; 4</span> 02:32:52 <span class=SpellE>jake</span>
kernel: drbd1: <span class=SpellE>Syncer</span> continues.<br>
Apr<span class=GramE>&nbsp; 4</span> 02:40:37 <span class=SpellE>jake</span>
kernel: drbd1: <span class=SpellE>Resync</span> done (total 971 sec; paused 506
sec; 28676 K/sec)<br>
Apr<span class=GramE>&nbsp; 4</span> 02:40:37 <span class=SpellE>jake</span>
kernel: drbd1:&nbsp; <span class=SpellE>uuid</span>[<span class=SpellE>History_start</span>]
now 356284033FC4539B<br>
Apr<span class=GramE>&nbsp; 4</span> 02:40:37 <span class=SpellE>jake</span>
kernel: drbd1:&nbsp; <span class=SpellE>uuid</span>[Bitmap] now
0000000000000000<br>
Apr<span class=GramE>&nbsp; 4</span> 02:40:37 <span class=SpellE>jake</span>
kernel: drbd1: <span class=SpellE>conn</span>( <span class=SpellE>SyncSource</span>
-&gt; Connected ) <span class=SpellE>pdsk</span>( Inconsistent -&gt; <span
class=SpellE>UpToDate</span> )<br>
Apr<span class=GramE>&nbsp; 4</span> 02:40:37 <span class=SpellE>jake</span>
kernel: drbd1: Writing meta data super block now.<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'><o:p>&nbsp;</o:p></span></font></p>

<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'>EM--</span></font><font size=2
face=Arial><span style='font-size:10.0pt;font-family:Arial'><o:p></o:p></span></font></p>

</div>

</body>

</html>