<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=Content-Type content="text/html; charset=us-ascii">
<meta name=ProgId content=Word.Document>
<meta name=Generator content="Microsoft Word 11">
<meta name=Originator content="Microsoft Word 11">
<link rel=File-List href="cid:filelist.xml@01C77165.2CB985E0">
<!--[if gte mso 9]><xml>
<o:OfficeDocumentSettings>
<o:DoNotRelyOnCSS/>
</o:OfficeDocumentSettings>
</xml><![endif]--><!--[if gte mso 9]><xml>
<w:WordDocument>
<w:SpellingState>Clean</w:SpellingState>
<w:GrammarState>Clean</w:GrammarState>
<w:DocumentKind>DocumentEmail</w:DocumentKind>
<w:EnvelopeVis/>
<w:ValidateAgainstSchemas/>
<w:SaveIfXMLInvalid>false</w:SaveIfXMLInvalid>
<w:IgnoreMixedContent>false</w:IgnoreMixedContent>
<w:AlwaysShowPlaceholderText>false</w:AlwaysShowPlaceholderText>
<w:Compatibility>
<w:BreakWrappedTables/>
<w:SnapToGridInCell/>
<w:WrapTextWithPunct/>
<w:UseAsianBreakRules/>
<w:UseWord2002TableStyleRules/>
</w:Compatibility>
<w:BrowserLevel>MicrosoftInternetExplorer4</w:BrowserLevel>
</w:WordDocument>
</xml><![endif]--><!--[if gte mso 9]><xml>
<w:LatentStyles DefLockedState="false" LatentStyleCount="156">
</w:LatentStyles>
</xml><![endif]-->
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;
mso-font-charset:0;
mso-generic-font-family:swiss;
mso-font-pitch:variable;
mso-font-signature:1627421319 -2147483648 8 0 66047 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;
text-underline:single;}
a:visited, span.MsoHyperlinkFollowed
{color:purple;
text-decoration:underline;
text-underline:single;}
span.EmailStyle17
{mso-style-type:personal-compose;
mso-style-noshow:yes;
mso-ansi-font-size:10.0pt;
mso-bidi-font-size:10.0pt;
font-family:Arial;
mso-ascii-font-family:Arial;
mso-hansi-font-family:Arial;
mso-bidi-font-family:Arial;
color:windowtext;}
span.SpellE
{mso-style-name:"";
mso-spl-e:yes;}
span.GramE
{mso-style-name:"";
mso-gram-e:yes;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.Section1
{page:Section1;}
-->
</style>
<!--[if gte mso 10]>
<style>
/* Style Definitions */
table.MsoNormalTable
{mso-style-name:"Table Normal";
mso-tstyle-rowband-size:0;
mso-tstyle-colband-size:0;
mso-style-noshow:yes;
mso-style-parent:"";
mso-padding-alt:0in 5.4pt 0in 5.4pt;
mso-para-margin:0in;
mso-para-margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:10.0pt;
font-family:"Times New Roman";
mso-ansi-language:#0400;
mso-fareast-language:#0400;
mso-bidi-language:#0400;}
</style>
<![endif]-->
</head>
<body lang=EN-US link=blue vlink=purple style='tab-interval:.5in'>
<div class=Section1>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'>Hi all,<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'>We are seeing a problem where during syncing the <span
class=SpellE>peer_isp</span> bit ends up getting set when it should not.<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'>I cannot duplicate it but the log clearly shows why the
problem occurred. <span style='mso-spacerun:yes'> </span>Essentially, we
never <span class=SpellE>transitionsed</span><o:p></o:p></span></font></p>
<p class=MsoNormal><span class=GramE><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>from</span></font></span><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'> </span></font><span
class=SpellE><font size=1 color=black face=Tahoma><span style='font-size:9.0pt;
font-family:Tahoma;color:black'>PausedSyncS</span></font></span><font size=1
color=black face=Tahoma><span style='font-size:9.0pt;font-family:Tahoma;
color:black'> -> <span class=SpellE>SyncSource</span> as the volume resumed
from a suspended state. <span style='mso-spacerun:yes'> </span>But yet on
the sync source we show<o:p></o:p></span></font></p>
<p class=MsoNormal><span class=GramE><font size=1 color=black face=Tahoma><span
style='font-size:9.0pt;font-family:Tahoma;color:black'>a</span></font></span><font
size=1 color=black face=Tahoma><span style='font-size:9.0pt;font-family:Tahoma;
color:black'> completion of the sync. <span
style='mso-spacerun:yes'> </span>The failure message then occurred on the
sync target. <span style='mso-spacerun:yes'> </span>Below is an *<b><span
style='font-weight:bold'>illustrated</span></b>* version of the<o:p></o:p></span></font></p>
<p class=MsoNormal><span class=GramE><font size=1 color=black face=Tahoma><span
style='font-size:9.0pt;font-family:Tahoma;color:black'>log</span></font></span><font
size=1 color=black face=Tahoma><span style='font-size:9.0pt;font-family:Tahoma;
color:black'>.<span style='mso-spacerun:yes'> </span>I hope I don’t
confuse things more:<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'>-------------------------<span
class=SpellE>SyncSource</span>
side---------------------------------------------------------------------------<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'>Mar 16 08:33:16 <span class=SpellE>chobs</span>
kernel: drbd1: <span class=SpellE>aftr_<span class=GramE>isp</span></span><span
class=GramE>(</span> 1 -> 0 )<br>
Mar 16 08:33:16 <span class=SpellE>chobs</span> kernel: drbd1: <span
class=SpellE><span class=GramE>conn</span></span><span class=GramE>(</span> <span
class=SpellE>PausedSyncS</span> -> <span class=SpellE>SyncSource</span> ) <span
class=SpellE>peer_isp</span>( 1 -> 0 )<br>
Mar 16 08:33:16 <span class=SpellE>chobs</span> kernel: drbd1: <span
class=SpellE>Syncer</span> continues.<br>
Mar 16 08:33:16 <span class=SpellE>chobs</span> kernel: drbd1: <span
class=SpellE><span class=GramE>conn</span></span><span class=GramE>(</span> <span
class=SpellE>SyncSource</span> -> <span class=SpellE>PausedSyncS</span> ) <span
class=SpellE>aftr_isp</span>( 0 -> 1 )<br>
Mar 16 08:33:16 <span class=SpellE>chobs</span> kernel: drbd1: <span
class=SpellE>Resync</span> suspended<br>
Mar 16 08:33:16 <span class=SpellE>chobs</span> kernel: drbd1: <span
class=SpellE>peer_<span class=GramE>isp</span></span><span class=GramE>(</span>
0 -> 1 )<br>
Mar 16 08:33:16 <span class=SpellE>chobs</span> kernel: drbd1: <span
class=SpellE>aftr_<span class=GramE>isp</span></span><span class=GramE>(</span>
1 -> 0 ) <<<<#####Should have been <span class=SpellE>peer_isp</span>
I think ######<br>
##############Under normal operation the two lines would be seen But they are
NOT################<span class=GramE># <br>
#</span>drbd1: <span class=SpellE>conn</span>( <span class=SpellE>PausedSyncS</span>
-> <span class=SpellE>SyncSource</span> ) <span class=SpellE>aftr_isp</span>(
1 -> 0 )<br>
#drbd1: <span class=SpellE>Syncer</span> continues.<br>
############################### <span class=GramE>instead</span> continue below
############<br>
Mar 16 08:33:16 <span class=SpellE>chobs</span> kernel: drbd1: <span
class=SpellE>Resync</span> done (total 1 sec; paused 0 sec; 356 K/sec) #### Are
we really done here???<br>
Mar 16 08:33:16 <span class=SpellE>chobs</span> kernel: drbd1: <span
class=SpellE><span class=GramE>uuid</span></span><span class=GramE>[</span><span
class=SpellE>History_start</span>] now FC98CEA3D33591C1<br>
Mar 16 08:33:16 <span class=SpellE>chobs</span> kernel: drbd1: <span
class=SpellE><span class=GramE>uuid</span></span><span class=GramE>[</span>Bitmap]
now 0000000000000000<br>
Mar 16 08:33:16 <span class=SpellE>chobs</span> kernel: drbd1: <span
class=SpellE><span class=GramE>conn</span></span><span class=GramE>(</span> <span
class=SpellE>PausedSyncS</span> -> Connected ) <span class=SpellE>pdsk</span>(
Inconsistent -> <span class=SpellE>UpToDate</span> ) ####!WE ARE GOING TO <span
class=SpellE>Conneceted</span> from <span class=SpellE>PausedSyncS..So</span>
Same state!!!<br>
#######!!!!!!! ABOVE state should have been <span class=SpellE><span
class=GramE>conn</span></span><span class=GramE>(</span> <span class=SpellE>SyncSource</span>
-> Connected ) <span class=SpellE>pdsk</span>( Inconsistent -> <span
class=SpellE>UpToDate</span> )!!!!!<br>
Mar 16 08:33:16 <span class=SpellE>chobs</span> kernel: drbd1: Writing <span
class=GramE>meta</span> data super block now.<br>
Mar 16 08:33:16 <span class=SpellE>chobs</span> kernel: drbd1: <span
class=SpellE>drbd_sync_handshake</span>:<br>
Mar 16 08:33:16 <span class=SpellE>chobs</span> kernel: drbd1: self
269C54A410CF9CAB:0000000000000000:FC98CEA3D33591C1:2EFBE8CDF29C591F<br>
Mar 16 08:33:16 <span class=SpellE>chobs</span> kernel: drbd1: peer
FC98CEA3D33591C0:0000000000000000:2EFBE8CDF29C591E:40519581F499C446<br>
Mar 16 08:33:16 <span class=SpellE>chobs</span> kernel: drbd1: <span
class=SpellE>uuid_<span class=GramE>compare</span></span><span class=GramE>(</span>)=2
by rule 8<br>
<br>
------------------------------Sync Target side--------------------------------------------------<br>
Mar 16 08:33:17 <span class=SpellE>chobp</span> kernel: drbd1: <span
class=SpellE>peer_<span class=GramE>isp</span></span><span class=GramE>(</span>
1 -> 0 )<br>
Mar 16 08:33:17 <span class=SpellE>chobp</span> kernel: drbd1: <span
class=SpellE><span class=GramE>conn</span></span><span class=GramE>(</span> <span
class=SpellE>PausedSyncT</span> -> <span class=SpellE>SyncTarget</span> ) <span
class=SpellE>aftr_isp</span>( 1 -> 0 )<br>
Mar 16 08:33:17 <span class=SpellE>chobp</span> kernel: drbd1: <span
class=SpellE>Syncer</span> continues.<br>
Mar 16 08:33:17 <span class=SpellE>chobp</span> kernel: drbd1: <span
class=SpellE><span class=GramE>conn</span></span><span class=GramE>(</span> <span
class=SpellE>SyncTarget</span> -> <span class=SpellE>PausedSyncT</span> ) <span
class=SpellE>aftr_isp</span>( 0 -> 1 ) ### should have been <span
class=SpellE>peer_isp</span> I think!!!<br>
Mar 16 08:33:17 <span class=SpellE>chobp</span> kernel: drbd1: <span
class=SpellE>Resync</span> suspended<br>
Mar 16 08:33:17 <span class=SpellE>chobp</span> kernel: drbd1: <span
class=SpellE>peer_<span class=GramE>isp</span></span><span class=GramE>(</span>
0 -> 1 ) <<<#### should have been <span class=SpellE>aftr_isp</span>
########<br>
Mar 16 08:33:17 <span class=SpellE>chobp</span> kernel: drbd1: <span
class=SpellE>peer_<span class=GramE>isp</span></span><span class=GramE>(</span>
1 -> 0 ) <<<#### should have been <span class=SpellE>aftr_isp</span>
########<br>
#######The 3 lines below would be printed BUT DID NOT##############<br>
#drbd1: <span class=SpellE><span class=GramE>conn</span></span><span
class=GramE>(</span> <span class=SpellE>PausedSyncT</span> -> <span
class=SpellE>SyncTarget</span> ) <span class=SpellE>peer_isp</span>( 1 -> 0
)<br>
#drbd1: <span class=SpellE>Syncer</span> continues.<br>
#drbd1: <span class=SpellE>Resync</span> done (total 1 sec; paused 0 sec; 356
K/sec)<br>
#################Instead got##############<br>
Mar 16 08:33:17 <span class=SpellE>chobp</span> kernel: drbd1: unexpected <span
class=SpellE>cstate</span> (<span class=SpellE>PausedSyncT</span>) in <span
class=SpellE>receive_bitmap</span><o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'><o:p> </o:p></span></font></p>
</div>
</body>
</html>