<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=Content-Type content="text/html; charset=us-ascii">
<meta name=ProgId content=Word.Document>
<meta name=Generator content="Microsoft Word 11">
<meta name=Originator content="Microsoft Word 11">
<link rel=File-List href="cid:filelist.xml@01C772F5.6091A460">
<!--[if gte mso 9]><xml>
<o:OfficeDocumentSettings>
<o:DoNotRelyOnCSS/>
</o:OfficeDocumentSettings>
</xml><![endif]--><!--[if gte mso 9]><xml>
<w:WordDocument>
<w:SpellingState>Clean</w:SpellingState>
<w:GrammarState>Clean</w:GrammarState>
<w:DocumentKind>DocumentEmail</w:DocumentKind>
<w:EnvelopeVis/>
<w:ValidateAgainstSchemas/>
<w:SaveIfXMLInvalid>false</w:SaveIfXMLInvalid>
<w:IgnoreMixedContent>false</w:IgnoreMixedContent>
<w:AlwaysShowPlaceholderText>false</w:AlwaysShowPlaceholderText>
<w:Compatibility>
<w:BreakWrappedTables/>
<w:SnapToGridInCell/>
<w:WrapTextWithPunct/>
<w:UseAsianBreakRules/>
<w:UseWord2002TableStyleRules/>
</w:Compatibility>
<w:BrowserLevel>MicrosoftInternetExplorer4</w:BrowserLevel>
</w:WordDocument>
</xml><![endif]--><!--[if gte mso 9]><xml>
<w:LatentStyles DefLockedState="false" LatentStyleCount="156">
</w:LatentStyles>
</xml><![endif]-->
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;
mso-font-charset:0;
mso-generic-font-family:swiss;
mso-font-pitch:variable;
mso-font-signature:1627421319 -2147483648 8 0 66047 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;
text-underline:single;}
a:visited, span.MsoHyperlinkFollowed
{color:purple;
text-decoration:underline;
text-underline:single;}
span.EmailStyle17
{mso-style-type:personal-compose;
mso-style-noshow:yes;
mso-ansi-font-size:10.0pt;
mso-bidi-font-size:10.0pt;
font-family:Arial;
mso-ascii-font-family:Arial;
mso-hansi-font-family:Arial;
mso-bidi-font-family:Arial;
color:windowtext;}
span.SpellE
{mso-style-name:"";
mso-spl-e:yes;}
span.GramE
{mso-style-name:"";
mso-gram-e:yes;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.Section1
{page:Section1;}
-->
</style>
<!--[if gte mso 10]>
<style>
/* Style Definitions */
table.MsoNormalTable
{mso-style-name:"Table Normal";
mso-tstyle-rowband-size:0;
mso-tstyle-colband-size:0;
mso-style-noshow:yes;
mso-style-parent:"";
mso-padding-alt:0in 5.4pt 0in 5.4pt;
mso-para-margin:0in;
mso-para-margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:10.0pt;
font-family:"Times New Roman";
mso-ansi-language:#0400;
mso-fareast-language:#0400;
mso-bidi-language:#0400;}
</style>
<![endif]-->
</head>
<body lang=EN-US link=blue vlink=purple style='tab-interval:.5in'>
<div class=Section1>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'>Hi all,<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'>This is another hard to reproduce one but the proofs are in
the logs that the problem is alive and well.<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'>I am hoping for at least some clues that may help reproduce
this…Essentially after one node in <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'>Primary state is powered <span class=GramE>down(</span>Not a
graceful shutdown) <span style='mso-spacerun:yes'> </span>both nodes ends
up <span style='mso-spacerun:yes'> </span>In </span></font><span
class=SpellE><font size=1 color=black face=Tahoma><span style='font-size:9.0pt;
font-family:Tahoma;color:black'>WFBitMapT</span></font></span><font size=1
color=black face=Tahoma><span style='font-size:9.0pt;font-family:Tahoma;
color:black'> for a <span class=SpellE>drbd</span> volume.</span></font><font
size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'><o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'>Here are some logs:<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'>On one node========================<br
style='mso-special-character:line-break'>
<![if !supportLineBreakNewLine]><br style='mso-special-character:line-break'>
<![endif]><o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'>Drbd2: Writing metadata to <span
class=SpellE>superblock</span> now.<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'>…...<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'>……. This <span class=GramE>nodes</span>
is powered of and came back with:<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 color=black face=Tahoma><span style='font-size:
9.0pt;font-family:Tahoma;color:black'><br>
Mar 23 13:16:53 jerry kernel: drbd2: <span class=SpellE>rct</span> = 0 in
/test_logs/builds/SuperNova/trunk/070323/platform/drbd/src/drbd/drbd_receiver.c:1878<br>
Mar 23 13:16:55 <span class=GramE>[ OK</span> ]<br>
Mar 23 13:16:54 jerry kernel: drbd2: <span class=SpellE>drbd_sync_handshake</span>:<br>
Mar 23 13:16:54 jerry kernel: drbd2: self
F71E503A8179BC5D:0000000000000000:3F430D4E1D59C3EA:6B0B1DA5CB20689C<br>
Mar 23 13:16:54 jerry kernel: drbd2: peer
F71E503A8179BC5C:0000000000000000:3F430D4E1D59C3EA:6B0B1DA5CB20689C<br>
Mar 23 13:16:55 jerry kernel: drbd2: <span class=SpellE>uuid_<span class=GramE>compare</span></span><span
class=GramE>(</span>)=0 by rule 4<br>
Mar 23 13:16:55 jerry kernel: drbd2: No <span class=SpellE>resync</span>, but
bits in bitmap!<br>
<br>
......<br>
<br>
Mar 23 13:17:00 jerry kernel: drbd2: <span class=SpellE>drbd_sync_handshake</span>:<br>
Mar 23 13:17:00 jerry kernel: drbd2: self F71E503A8179BC5D:0000000000000000:3F430D4E1D59C3EA:6B0B1DA5CB20689C<br>
Mar 23 13:17:00 jerry kernel: drbd2: peer
0000000000000000:0000000000000000:F71E503A8179BC5C:3F430D4E1D59C3EA<br>
Mar 23 13:17:00 jerry kernel: drbd2: <span class=SpellE>uuid_<span class=GramE>compare</span></span><span
class=GramE>(</span>)=-2 by rule 6<br>
Mar 23 13:17:00 jerry kernel: drbd2: Writing <span class=GramE>meta</span> data
super block now.<br>
Mar 23 13:17:01 jerry kernel: drbd2: writing of bitmap took 11 jiffies<br>
Mar 23 13:17:01 jerry kernel: drbd2: 12 GB marked out-of-sync by on disk
bit-map.<br>
Mar 23 13:17:02 jerry kernel: drbd2: 13336132 KB now marked out-of-sync by on
disk bit-map.<br>
Mar 23 13:17:02 jerry kernel: drbd2: Writing <span class=GramE>meta</span> data
super block now.<br>
Mar 23 13:17:02 jerry kernel: drbd2: <span class=SpellE><span
class=GramE>uuid</span></span><span class=GramE>[</span><span class=SpellE>History_start</span>]
now F71E503A8179BC5D<br>
Mar 23 13:17:02 jerry kernel: drbd2: <span class=SpellE><span
class=GramE>uuid</span></span><span class=GramE>[</span>Current] now 0000000000000000<br>
Mar 23 13:17:03 jerry kernel: drbd2: <span class=SpellE><span class=GramE>conn</span></span><span
class=GramE>(</span> Connected -> <span class=SpellE>WFBitMapT</span> )<br>
Mar 23 13:17:03 jerry kernel: drbd2: Writing <span class=GramE>meta</span> data
super block now.<br>
<br>
On <span class=SpellE>theh</span> other node=============================<br>
<br>
Mar 23 13:16:48 <span class=SpellE>ben</span> kernel: drbd2: <span
class=SpellE>aftr_<span class=GramE>isp</span></span><span class=GramE>(</span>
0 -> 1 )<br>
Mar 23 13:16:48 <span class=SpellE>ben</span> kernel: drbd2: Handshake
successful: DRBD Network Protocol version 86<br>
Mar 23 13:16:48 <span class=SpellE>ben</span> kernel: drbd2: peer( Unknown
-> Secondary ) <span class=SpellE>conn</span>( <span class=SpellE>WFReportParams</span>
-> Connected ) <span class=SpellE>pdsk</span>( <span class=SpellE>DUnknown</span>
-> <span class=SpellE>UpToDate</span> ) <span class=SpellE>peer_isp</span>(
0 -> 1 )<br>
Mar 23 13:16:48 <span class=SpellE>ben</span> kernel: drbd2: Writing <span
class=GramE>meta</span> data super block now.<br>
<br>
....<br>
<br>
Mar 23 13:16:49 <span class=SpellE>ben</span> kernel: drbd2: <span
class=SpellE>rct</span> = 2 in
/test_logs/builds/SuperNova/trunk/070323/platform/drbd/src/drbd/drbd_receiver.c:1878<br>
Mar 23 13:16:49 <span class=SpellE>ben</span> kernel: drbd2: <span
class=SpellE>drbd_sync_handshake</span>:<br>
Mar 23 13:16:49 <span class=SpellE>ben</span> kernel: drbd2: self
F71E503A8179BC5C:0000000000000000:3F430D4E1D59C3EA:6B0B1DA5CB20689C<br>
Mar 23 13:16:49 <span class=SpellE>ben</span> kernel: drbd2: peer
F71E503A8179BC5D:0000000000000000:3F430D4E1D59C3EA:6B0B1DA5CB20689C<br>
Mar 23 13:16:49 <span class=SpellE>ben</span> kernel: drbd2: <span
class=SpellE>uuid_<span class=GramE>compare</span></span><span class=GramE>(</span>)=-1
by rule 4<br>
Mar 23 13:16:49 <span class=SpellE>ben</span> kernel: drbd2: <span
class=SpellE><span class=GramE>uuid</span></span><span class=GramE>[</span><span
class=SpellE>History_start</span>] now F71E503A8179BC5C<br>
Mar 23 13:16:49 <span class=SpellE>ben</span> kernel: drbd2: <span
class=SpellE><span class=GramE>uuid</span></span><span class=GramE>[</span>Current]
now 0000000000000000<br>
Mar 23 13:16:49 <span class=SpellE>ben</span> kernel: drbd2: <span
class=SpellE><span class=GramE>conn</span></span><span class=GramE>(</span>
Connected -> <span class=SpellE>WFBitMapT</span> )<br>
Mar 23 13:16:49 <span class=SpellE>ben</span> kernel: drbd2: Writing <span
class=GramE>meta</span> data super block now.</span></font><font size=2
face=Arial><span style='font-size:10.0pt;font-family:Arial'><o:p></o:p></span></font></p>
</div>
</body>
</html>