Hi<div><br></div><div>I am a newcomer to HA/DRBD and had to setup a simplified 2 node VM cluster test envionment with OpenSuse 10.3/2.6.22 (i586) </div><div>over the last few weeks to at least try to reproduce couple of serious problems which happened in a production environment,</div>
<div><br></div><div>Unfortunately I was unable to solve the problems, partly because I don't understand why the ResourceManager seemingly invokes the</div><div>members of the resource group twice. </div><div><br></div>
<div>
I have noticed that a normal failover/takeover cleanly stops or starts the resource group once only on the respective node, but when the primary node crashes, the resource group is acquired twice by the secondary node. </div>
<div><br></div><div>
Now here is the problem. The drbd device is encrypted with cryptsetup which opened the mapped device without an error the first time around, then when the ResourceManager started the member a second time, cryptsetup returned an error code 239 (~'device already opened').</div>
<div><br></div><div>A similar test with a corrupted key on the secondary node showed a similar pattern but the ResourceManager received error code 255 both times. </div><div><br></div><div>I could never reproduce the specific problem on my test machines. As cryptsetup is started from a service, Crypto (one of the resource members), I thought of it returning a 0 value to the ResourceManager whenever cryptsetup tries to open the encrypted device a second time.</div>
<div><br></div><div>Even it this could quickfix the problem, I still haven't got a clue as to why the ResourceManger behaves this way. Can anyone explain, please ?</div><div><br></div><div>Best regards,</div><div>Richard</div>
<div><br></div><div>PS. Here is a short extract of the original and test message logs. The ha-logs are similar. The original environment uses servers with RAID1.</div><div><br></div><div><div class="Section0"><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<span style="font-weight:bold;text-decoration:underline;font-size:12.0000pt;font-family:'Times New Roman'">Original Log</span></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><span style="font-weight:bold;text-decoration:underline;font-size:12.0000pt;font-family:'Times New Roman'"><br>
</span></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><span style="font-size:12.0000pt;font-family:'Times New Roman'"></span></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:24 sms2 kernel: drbd0: peer( Primary -> Secondary ) </font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:24 sms2 kernel: klogd 1.4.1, ---------- state change ---------- </font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:24 sms2 heartbeat: [3855]: info: Received shutdown notice from 'sms1'.</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:24 sms2 heartbeat: [3855]: info: Resources being acquired from sms1.</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:24 sms2 heartbeat: [3855]: debug: StartNextRemoteRscReq(): child count 1</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:24 sms2 heartbeat: [27727]: info: acquire all HA resources (standby).</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:24 sms2 heartbeat: [27728]: info: No local resources [/usr/lib/heartbeat/ResourceManager listkeys sms2] to acquire.</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:24 sms2 heartbeat: [3855]: debug: StartNextRemoteRscReq(): child count 1</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3"><b>Jun 25 11:43:24 sms2 ResourceManager[27747]: info: Acquiring resource group: sms1 IPaddr::10.134.86.55 drbddisk::drbd0 Crypto::cr_drbd0::/dev/drbd0::/etc/key.cr_drbd0::noauto Filesystem::/dev/mapper/cr_drbd0::/var/data::ext3::acl,user_xattr sms_ha</b></font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:24 sms2 IPaddr[27771]: INFO: Resource is stopped</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:24 sms2 ResourceManager[27747]: info: Running /etc/ha.d/resource.d/IPaddr 10.134.86.55 start</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:24 sms2 ResourceManager[27747]: debug: Starting /etc/ha.d/resource.d/IPaddr 10.134.86.55 start</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:25 sms2 IPaddr[27823]: INFO: Using calculated nic for <a href="http://10.134.86.55">10.134.86.55</a>: eth0</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:25 sms2 IPaddr[27823]: INFO: Using calculated netmask for <a href="http://10.134.86.55">10.134.86.55</a>: 255.255.255.0</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:25 sms2 IPaddr[27823]: INFO: Using calculated broadcast for <a href="http://10.134.86.55">10.134.86.55</a>: 10.134.86.255</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:25 sms2 avahi-daemon[3555]: Registering new address record for 10.134.86.55 on eth0.IPv4.</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:25 sms2 avahi-daemon[3555]: Withdrawing address record for 10.134.86.55 on eth0.</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:25 sms2 avahi-daemon[3555]: Registering new address record for 10.134.86.55 on eth0.IPv4.</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:25 sms2 IPaddr[27823]: DEBUG: Sending Gratuitous Arp for 10.134.86.55 on eth0:0 [eth0]</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:25 sms2 IPaddr[27814]: INFO: Success</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:25 sms2 ResourceManager[27747]: debug: /etc/ha.d/resource.d/IPaddr 10.134.86.55 start done. RC=0</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:25 sms2 ResourceManager[27747]: info: Running /etc/ha.d/resource.d/drbddisk drbd0 start</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:25 sms2 ResourceManager[27747]: debug: Starting /etc/ha.d/resource.d/drbddisk drbd0 start</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:25 sms2 kernel: drbd0: role( Secondary -> Primary ) </font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:25 sms2 kernel: drbd0: Writing meta data super block now.</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:25 sms2 ResourceManager[27747]: debug: /etc/ha.d/resource.d/drbddisk drbd0 start done. RC=0</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3"><b>J<font color="#006600">un 25 11:43:25 sms2 ResourceManager[27747]: info: Running /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto start</font></b></font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3" color="#006600"><b>Jun 25 11:43:25 sms2 ResourceManager[27747]: debug: Starting /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto start</b></font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3" color="#006600"><b>Jun 25 11:43:26 sms2 ResourceManager[27747]: debug: /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto start done. RC=0</b></font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 Filesystem[28000]: INFO: Resource is stopped</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 ResourceManager[27747]: info: Running /etc/ha.d/resource.d/Filesystem /dev/mapper/cr_drbd0 /var/data ext3 acl,user_xattr start</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 ResourceManager[27747]: debug: Starting /etc/ha.d/resource.d/Filesystem /dev/mapper/cr_drbd0 /var/data ext3 acl,user_xattr start</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 Filesystem[28041]: INFO: Running start for /dev/mapper/cr_drbd0 on /var/data</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 kernel: kjournald starting. Commit interval 5 seconds</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 kernel: EXT3-fs warning: checktime reached, running e2fsck is recommended</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 kernel: EXT3 FS on dm-0, internal journal</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 kernel: EXT3-fs: mounted filesystem with ordered data mode.</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 Filesystem[28038]: INFO: Success</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 ResourceManager[27747]: debug: /etc/ha.d/resource.d/Filesystem /dev/mapper/cr_drbd0 /var/data ext3 acl,user_xattr start done. RC=0</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 logger: /etc/ha.d/resource.d/sms_ha status was called</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 ResourceManager[27747]: info: Running /etc/ha.d/resource.d/sms_ha start</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 ResourceManager[27747]: debug: Starting /etc/ha.d/resource.d/sms_ha start</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 logger: /etc/ha.d/resource.d/sms_ha start was called</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 su: (to lsvadb_3.0-2) root on none</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:26 sms2 su: (to lsvadb_3.0-2) root on none</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:27 sms2 kernel: drbd0: peer( Secondary -> Unknown ) conn( Connected -> TearDown ) pdsk( UpToDate -> DUnknown ) </font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:27 sms2 kernel: drbd0: Creating new current UUID</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:27 sms2 kernel: drbd0: Writing meta data super block now.</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:27 sms2 kernel: drbd0: meta connection shut down by peer.</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:27 sms2 kernel: drbd0: asender terminated</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:27 sms2 kernel: drbd0: tl_clear()</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:27 sms2 kernel: drbd0: Connection closed</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:27 sms2 kernel: drbd0: conn( TearDown -> Unconnected ) </font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:27 sms2 kernel: drbd0: receiver terminated</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:27 sms2 kernel: drbd0: receiver (re)started</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:27 sms2 kernel: drbd0: conn( Unconnected -> WFConnection ) </font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:27 sms2 kernel: JBD: barrier-based sync failed on dm-0 - disabling barriers</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:29 sms2 su: (to lsva) root on none</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">...</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:30 sms2 ResourceManager[27747]: debug: /etc/ha.d/resource.d/sms_ha start done. RC=0</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:30 sms2 heartbeat: [27727]: info: all HA resource acquisition completed (standby).</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:30 sms2 heartbeat: [3855]: info: Standby resource acquisition done [all].</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:30 sms2 heartbeat: [28288]: debug: notify_world: setting SIGCHLD Handler to SIG_DFL</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:30 sms2 harc[28288]: info: Running /etc/ha.d/rc.d/status status</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3"><b>Jun 25 11:43:30 sms2 mach_down[28307]: info: Taking over resource group IPaddr::10.134.86.55</b></font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3"><b>Jun 25 11:43:30 sms2 ResourceManager[28330]: info: Acquiring resource group: sms1 IPaddr::10.134.86.55 drbddisk::drbd0 Crypto::cr_drbd0::/dev/drbd0::/etc/key.cr_drbd0::noauto Filesystem::/dev/mapper/cr_drbd0::/var/data::ext3::acl,user_xattr sms_ha</b></font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:30 sms2 etnetclient[28225]: ALARMIERUNG: Ausfuehrung echo "SM Server gestartet." | mailx -s "SM SERVER NOTIFICATION" <a href="mailto:christoph.reichenbach@dtc-ag.ch">christoph.reichenbach@dtc-ag.ch</a> erfolgreich </font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:30 sms2 IPaddr[28354]: INFO: Running OK</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3" color="#990000"><b>Jun 25 11:43:30 sms2 ResourceManager[28330]: info: Running /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto start</b></font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3" color="#990000"><b>Jun 25 11:43:30 sms2 ResourceManager[28330]: debug: Starting /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto start</b></font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3" color="#990000"><b>Jun 25 11:43:30 sms2 ResourceManager[28330]: debug: /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto start done. RC=239</b></font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3" color="#990000"><b>Jun 25 11:43:30 sms2 ResourceManager[28330]: ERROR: Return code 239 from /etc/ha.d/resource.d/Crypto</b></font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3" color="#990000"><b>Jun 25 11:43:30 sms2 ResourceManager[28330]: CRIT: Giving up resources due to failure of Crypto::cr_drbd0::/dev/drbd0::/etc/key.cr_drbd0::noauto</b></font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:30 sms2 ResourceManager[28330]: info: Releasing resource group: sms1 IPaddr::10.134.86.55 drbddisk::drbd0 Crypto::cr_drbd0::/dev/drbd0::/etc/key.cr_drbd0::noauto Filesystem::/dev/mapper/cr_drbd0::/var/data::ext3::acl,user_xattr sms_ha</font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:30 sms2 ResourceManager[28330]: info: Running /etc/ha.d/resource.d/sms_ha stop</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3">Jun 25 11:43:30 sms2 ResourceManager[28330]: debug: Starting /etc/ha.d/resource.d/sms_ha stop</font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3">Jun 25 11:43:31 sms2 logger: /etc/ha.d/resource.d/sms_ha stop was called</font></p>
<p></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><span style="font-size:12.0000pt;font-family:'Times New Roman'"><br></span></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><span style="font-size:12.0000pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><span style="font-weight:bold;text-decoration:underline;font-size:12.0000pt;font-family:'Times New Roman'"></span></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt">
<font face="Times New Roman" size="3"><b><u>Test Log</u></b></font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt"><font face="Times New Roman" size="3"><b><u><br></u></b></font></p><p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other">
<span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:45 sms1 IPaddr[5186]: DEBUG: Sending Gratuitous Arp for 192.168.1.200 on eth1:0 [eth1]</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:45 sms1 IPaddr[5171]: INFO: Success</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:45 sms1 ResourceManager[5088]: debug: /etc/ha.d/resource.d/IPaddr 192.168.1.200 start done. RC=0</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:45 sms1 ResourceManager[5088]: info: Running /etc/ha.d/resource.d/drbddisk drbd0 start</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:45 sms1 kernel: NET: Registered protocol family 17</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:45 sms1 ResourceManager[5088]: debug: Starting /etc/ha.d/resource.d/drbddisk drbd0 start</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:45 sms1 kernel: drbd0: role( Secondary -> Primary ) </span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:45 sms1 kernel: drbd0: Writing meta data super block now.</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:45 sms1 ResourceManager[5088]: debug: /etc/ha.d/resource.d/drbddisk drbd0 start done. RC=0</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:45 sms1 ResourceManager[5088]: info: Running /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto start</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:45 sms1 ResourceManager[5088]: debug: Starting /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto start</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:45 sms1 avahi-daemon[3513]: Invalid query packet.</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:46 sms1 syslog-ng[2562]: last message repeated 2 times</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><font color="#990000"><span style="font-weight:bold;font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:46 sms1 ResourceManager[5088]: debug: /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto start done. RC=255</span><span style="font-weight:bold;font-size:10.5pt;font-family:'Times New Roman'"></span></font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><font color="#990000"><span style="font-weight:bold;font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:46 sms1 ResourceManager[5088]: ERROR: Return code 255 from /etc/ha.d/resource.d/Crypto</span><span style="font-weight:bold;font-size:10.5pt;font-family:'Times New Roman'"></span></font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-weight:bold;font-size:10.5pt;font-family:'Times New Roman'"><font color="#990000">Jul 14 06:08:46 sms1 ResourceManager[5088]: CRIT: Giving up resources due to failure of Crypto::cr_drbd0::/dev/drbd0::/etc/key.cr_drbd0::noauto</font></span><span style="font-weight:bold;font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:46 sms1 ResourceManager[5088]: info: Releasing resource group: sms1 IPaddr::192.168.1.200 drbddisk::drbd0 Crypto::cr_drbd0::/dev/drbd0::/etc/key.cr_drbd0::noauto Filesystem::/dev/mapper/cr_drbd0::/var/data::ext3::acl,user_xattr sms_ha</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:46 sms1 ResourceManager[5088]: info: Running /etc/ha.d/resource.d/sms_ha stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:46 sms1 ResourceManager[5088]: debug: Starting /etc/ha.d/resource.d/sms_ha stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:46 sms1 logger: /etc/ha.d/resource.d/sms_ha stop was called</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 ResourceManager[5088]: debug: /etc/ha.d/resource.d/sms_ha stop done. RC=0</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 avahi-daemon[3513]: Invalid query packet.</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 kernel: drbd0: peer( Secondary -> Unknown ) conn( Connected -> TearDown ) pdsk( UpToDate -> DUnknown ) </span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 kernel: drbd0: Creating new current UUID</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 kernel: drbd0: Writing meta data super block now.</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 kernel: drbd0: meta connection shut down by peer.</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 kernel: drbd0: asender terminated</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 kernel: drbd0: tl_clear()</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 kernel: drbd0: Connection closed</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 kernel: drbd0: conn( TearDown -> Unconnected ) </span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 kernel: drbd0: receiver terminated</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 kernel: drbd0: receiver (re)started</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 kernel: drbd0: conn( Unconnected -> WFConnection ) </span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 ResourceManager[5088]: info: Running /etc/ha.d/resource.d/Filesystem /dev/mapper/cr_drbd0 /var/data ext3 acl,user_xattr stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 ResourceManager[5088]: debug: Starting /etc/ha.d/resource.d/Filesystem /dev/mapper/cr_drbd0 /var/data ext3 acl,user_xattr stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 Filesystem[5481]: WARNING: Couldn't find device [/dev/mapper/cr_drbd0]. Expected /dev/??? to exist</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 Filesystem[5481]: INFO: Running stop for /dev/mapper/cr_drbd0 on /var/data</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 Filesystem[5478]: INFO: Success</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 ResourceManager[5088]: debug: /etc/ha.d/resource.d/Filesystem /dev/mapper/cr_drbd0 /var/data ext3 acl,user_xattr stop done. RC=0</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 ResourceManager[5088]: info: Running /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 ResourceManager[5088]: debug: Starting /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 ResourceManager[5088]: debug: /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto stop done. RC=0</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 ResourceManager[5088]: info: Running /etc/ha.d/resource.d/drbddisk drbd0 stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 ResourceManager[5088]: debug: Starting /etc/ha.d/resource.d/drbddisk drbd0 stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 kernel: drbd0: role( Primary -> Secondary ) </span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 kernel: drbd0: Writing meta data super block now.</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 ResourceManager[5088]: debug: /etc/ha.d/resource.d/drbddisk drbd0 stop done. RC=0</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 ResourceManager[5088]: info: Running /etc/ha.d/resource.d/IPaddr 192.168.1.200 stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 ResourceManager[5088]: debug: Starting /etc/ha.d/resource.d/IPaddr 192.168.1.200 stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 avahi-daemon[3513]: Withdrawing address record for 192.168.1.200 on eth1.</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 IPaddr[5582]: INFO: Success</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 avahi-daemon[3513]: Invalid query packet.</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 ResourceManager[5088]: debug: /etc/ha.d/resource.d/IPaddr 192.168.1.200 stop done. RC=0</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 heartbeat: [5073]: info: all HA resource acquisition completed (standby).</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 heartbeat: [4374]: info: Standby resource acquisition done [all].</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 heartbeat: [5616]: debug: notify_world: setting SIGCHLD Handler to SIG_DFL</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:48 sms1 harc[5616]: info: Running /etc/ha.d/rc.d/status status</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 mach_down[5626]: info: /usr/lib/heartbeat/mach_down: nice_failback: foreign resources acquired</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 mach_down[5626]: info: mach_down takeover complete for node sms2.</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 heartbeat: [4374]: info: mach_down takeover complete.</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 heartbeat: [5654]: debug: notify_world: setting SIGCHLD Handler to SIG_DFL</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 harc[5654]: info: Running /etc/ha.d/rc.d/ip-request-resp ip-request-resp</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 ip-request-resp[5654]: received ip-request-resp IPaddr::192.168.1.200 OK yes</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 ResourceManager[5669]: info: Acquiring resource group: sms1 IPaddr::192.168.1.200 drbddisk::drbd0 Crypto::cr_drbd0::/dev/drbd0::/etc/key.cr_drbd0::noauto Filesystem::/dev/mapper/cr_drbd0::/var/data::ext3::acl,user_xattr sms_ha</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 IPaddr[5693]: INFO: Resource is stopped</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 ResourceManager[5669]: info: Running /etc/ha.d/resource.d/IPaddr 192.168.1.200 start</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 ResourceManager[5669]: debug: Starting /etc/ha.d/resource.d/IPaddr 192.168.1.200 start</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 IPaddr[5745]: INFO: Using calculated nic for <a href="http://192.168.1.200">192.168.1.200</a>: eth1</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 IPaddr[5745]: INFO: Using calculated netmask for <a href="http://192.168.1.200">192.168.1.200</a>: 255.255.255.0</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 IPaddr[5745]: INFO: Using calculated broadcast for <a href="http://192.168.1.200">192.168.1.200</a>: 192.168.1.255</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 avahi-daemon[3513]: Registering new address record for 192.168.1.200 on eth1.IPv4.</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 IPaddr[5745]: DEBUG: Sending Gratuitous Arp for 192.168.1.200 on eth1:0 [eth1]</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 IPaddr[5736]: INFO: Success</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 ResourceManager[5669]: debug: /etc/ha.d/resource.d/IPaddr 192.168.1.200 start done. RC=0</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 ResourceManager[5669]: info: Running /etc/ha.d/resource.d/drbddisk drbd0 start</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 ResourceManager[5669]: debug: Starting /etc/ha.d/resource.d/drbddisk drbd0 start</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 kernel: drbd0: role( Secondary -> Primary ) </span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 kernel: drbd0: Writing meta data super block now.</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 ResourceManager[5669]: debug: /etc/ha.d/resource.d/drbddisk drbd0 start done. RC=0</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 ResourceManager[5669]: info: Running /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto start</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 ResourceManager[5669]: debug: Starting /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto start</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 avahi-daemon[3513]: Invalid query packet.</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><font color="#990000"><span style="font-weight:bold;font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 ResourceManager[5669]: debug: /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto start done. RC=255</span><span style="font-weight:bold;font-size:10.5pt;font-family:'Times New Roman'"></span></font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><font color="#990000"><span style="font-weight:bold;font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 ResourceManager[5669]: ERROR: Return code 255 from /etc/ha.d/resource.d/Crypto</span><span style="font-weight:bold;font-size:10.5pt;font-family:'Times New Roman'"></span></font></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-weight:bold;font-size:10.5pt;font-family:'Times New Roman'"><font color="#990000">Jul 14 06:08:49 sms1 ResourceManager[5669]: CRIT: Giving up resources due to failure of Crypto::cr_drbd0::/dev/drbd0::/etc/key.cr_drbd0::noauto</font></span><span style="font-weight:bold;font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 ResourceManager[5669]: info: Releasing resource group: sms1 IPaddr::192.168.1.200 drbddisk::drbd0 Crypto::cr_drbd0::/dev/drbd0::/etc/key.cr_drbd0::noauto Filesystem::/dev/mapper/cr_drbd0::/var/data::ext3::acl,user_xattr sms_ha</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 ResourceManager[5669]: info: Running /etc/ha.d/resource.d/sms_ha stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 ResourceManager[5669]: debug: Starting /etc/ha.d/resource.d/sms_ha stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:49 sms1 logger: /etc/ha.d/resource.d/sms_ha stop was called</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:51 sms1 ResourceManager[5669]: debug: /etc/ha.d/resource.d/sms_ha stop done. RC=0</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:51 sms1 ResourceManager[5669]: info: Running /etc/ha.d/resource.d/Filesystem /dev/mapper/cr_drbd0 /var/data ext3 acl,user_xattr stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:51 sms1 ResourceManager[5669]: debug: Starting /etc/ha.d/resource.d/Filesystem /dev/mapper/cr_drbd0 /var/data ext3 acl,user_xattr stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:51 sms1 Filesystem[5992]: WARNING: Couldn't find device [/dev/mapper/cr_drbd0]. Expected /dev/??? to exist</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:51 sms1 Filesystem[5992]: INFO: Running stop for /dev/mapper/cr_drbd0 on /var/data</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:51 sms1 Filesystem[5989]: INFO: Success</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:51 sms1 ResourceManager[5669]: debug: /etc/ha.d/resource.d/Filesystem /dev/mapper/cr_drbd0 /var/data ext3 acl,user_xattr stop done. RC=0</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:51 sms1 ResourceManager[5669]: info: Running /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:51 sms1 ResourceManager[5669]: debug: Starting /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:51 sms1 ResourceManager[5669]: debug: /etc/ha.d/resource.d/Crypto cr_drbd0 /dev/drbd0 /etc/key.cr_drbd0 noauto stop done. RC=0</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:51 sms1 ResourceManager[5669]: info: Running /etc/ha.d/resource.d/drbddisk drbd0 stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:51 sms1 ResourceManager[5669]: debug: Starting /etc/ha.d/resource.d/drbddisk drbd0 stop</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other"><span style="font-size:10.5pt;font-family:'Times New Roman'">Jul 14 06:08:51 sms1 kernel: drbd0: role( Primary -> Secondary )</span><span style="font-size:10.5pt;font-family:'Times New Roman'"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt;text-autospace:ideograph-other;background:rgb(255,255,255)"><span style="font-size:12pt;font-family:'Times New Roman';background-repeat:initial initial"></span></p>
<p class="p0" style="margin-bottom:0pt;margin-top:0pt"><span style="font-size:12.0000pt;font-family:'Times New Roman'"></span></p></div></div><div><br></div>