<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=Content-Type content="text/html; charset=us-ascii">
<meta name=ProgId content=Word.Document>
<meta name=Generator content="Microsoft Word 11">
<meta name=Originator content="Microsoft Word 11">
<link rel=File-List href="cid:filelist.xml@01C71D48.254E0770">
<!--[if gte mso 9]><xml>
<o:OfficeDocumentSettings>
<o:DoNotRelyOnCSS/>
</o:OfficeDocumentSettings>
</xml><![endif]--><!--[if gte mso 9]><xml>
<w:WordDocument>
<w:SpellingState>Clean</w:SpellingState>
<w:GrammarState>Clean</w:GrammarState>
<w:DocumentKind>DocumentEmail</w:DocumentKind>
<w:EnvelopeVis/>
<w:ValidateAgainstSchemas/>
<w:SaveIfXMLInvalid>false</w:SaveIfXMLInvalid>
<w:IgnoreMixedContent>false</w:IgnoreMixedContent>
<w:AlwaysShowPlaceholderText>false</w:AlwaysShowPlaceholderText>
<w:Compatibility>
<w:BreakWrappedTables/>
<w:SnapToGridInCell/>
<w:WrapTextWithPunct/>
<w:UseAsianBreakRules/>
<w:UseWord2002TableStyleRules/>
</w:Compatibility>
<w:BrowserLevel>MicrosoftInternetExplorer4</w:BrowserLevel>
</w:WordDocument>
</xml><![endif]--><!--[if gte mso 9]><xml>
<w:LatentStyles DefLockedState="false" LatentStyleCount="156">
</w:LatentStyles>
</xml><![endif]-->
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;
mso-font-alt:"?l?r ?????????????????????????";
mso-font-charset:0;
mso-generic-font-family:swiss;
mso-font-pitch:variable;
mso-font-signature:1627421319 -2147483648 8 0 66047 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;
text-underline:single;}
a:visited, span.MsoHyperlinkFollowed
{color:purple;
text-decoration:underline;
text-underline:single;}
span.EmailStyle17
{mso-style-type:personal-compose;
mso-style-noshow:yes;
mso-ansi-font-size:10.0pt;
mso-bidi-font-size:10.0pt;
font-family:Arial;
mso-ascii-font-family:Arial;
mso-hansi-font-family:Arial;
mso-bidi-font-family:Arial;
color:windowtext;}
span.SpellE
{mso-style-name:"";
mso-spl-e:yes;}
span.GramE
{mso-style-name:"";
mso-gram-e:yes;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.Section1
{page:Section1;}
-->
</style>
<!--[if gte mso 10]>
<style>
/* Style Definitions */
table.MsoNormalTable
{mso-style-name:"Table Normal";
mso-tstyle-rowband-size:0;
mso-tstyle-colband-size:0;
mso-style-noshow:yes;
mso-style-parent:"";
mso-padding-alt:0in 5.4pt 0in 5.4pt;
mso-para-margin:0in;
mso-para-margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:10.0pt;
font-family:"Times New Roman";
mso-ansi-language:#0400;
mso-fareast-language:#0400;
mso-bidi-language:#0400;}
</style>
<![endif]-->
</head>
<body lang=EN-US link=blue vlink=purple style='tab-interval:.5in'>
<div class=Section1>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'>Hi all,<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'>Were are seeing a case where a </span></font><font size=1
color=black face=Tahoma><span style='font-size:9.0pt;font-family:Tahoma;
color:black'>Sync happened, data is marked consistent on both sides, target
went to Connected<br>
<span class=GramE>state</span>, source DID NOT CHANGE FROM <span
class=SpellE>WFBitMapS</span> state. The <span class=GramE>clock on the two
systems seem</span> to be not quite synchronized, but it seems that:<br>
<br>
1. The two nodes connected, <span class=SpellE>realised</span> they needed to <span
class=SpellE>resync</span> and worked out that one node had the<br>
<span class=GramE>good</span> data.<br>
2. Because other syncing was going on, the sync process was paused<br>
3. Later on, sync resumed, good side connection went to <span class=SpellE>WFBitmapS</span>,
bad side <span class=SpellE>WFBitmapT</span><br>
4. Sync happened, data was marked consistent on both sides, <span class=GramE>target</span>
went to Connected<br>
<span class=GramE>state</span>, source DID NOT CHANGE FROM <span
class=SpellE>WFBitMapS</span>.<br>
<br>
Now, the only oddity I see is on the target side where we see:<br>
<br>
Dec 10 04:52:52 <span class=SpellE><span class=GramE>george</span></span>
kernel: drbd1: unexpected <span class=SpellE>cstate</span> (<span class=SpellE>PausedSyncT</span>)
in <span class=SpellE>receive_bitmap</span><br>
<br>
This did NOT stop the <span class=SpellE>resync</span>, but I would suspect it
meant that a critical message was never sent which left the source side in <span
class=SpellE>WFBitmapS</span>. <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'>Presumably there is a window where one
side is out of the paused state before the other.<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'>Simon <span class=SpellE>Grham</span>
actually did a bit of analysis of this and think that the problem might be a
race condition in <span class=SpellE>drbd_receive.c:receive_<span class=GramE>bitmap</span></span><span
class=GramE>(</span>).<o:p></o:p></span></font></p>
<p class=MsoNormal><span class=GramE><font size=1 color=black face=Tahoma><span
style='font-size:9.0pt;font-family:Tahoma;color:black'>Any ideas, because I
cannot reproduce this at reliably at this time.</span></font></span><font
size=1 color=black face=Tahoma><span style='font-size:9.0pt;font-family:Tahoma;
color:black'><o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'>EM--<o:p></o:p></span></font></p>
</div>
</body>
</html>