Jul 23 15:50:31 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:50:31 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:50:31 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:50:33 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:50:33 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:50:33 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:50:35 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:50:35 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:50:35 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:50:37 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:50:37 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:50:37 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:50:39 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:50:39 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:50:39 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:50:41 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:50:41 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:50:41 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:50:43 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:50:43 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:50:43 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:50:45 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:50:45 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:50:45 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:50:47 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:50:47 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:50:47 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:50:48 mail1 heartbeat: [3485]: info: Link mail2.example.com:eth0 dead. Jul 23 15:50:48 mail1 ipfail: [3517]: info: Link Status update: Link mail2.example.com/eth0 now has status dead Jul 23 15:50:49 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:50:49 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:50:49 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:50:49 mail1 ipfail: [3517]: info: Asking other side for ping node count. Jul 23 15:50:49 mail1 ipfail: [3517]: info: Checking remote count of ping nodes. Jul 23 15:50:50 mail1 ipfail: [3517]: info: Status update: Node 10.9.9.14 now has status dead Jul 23 15:50:50 mail1 heartbeat: [3485]: WARN: node 10.9.9.14: is dead Jul 23 15:50:50 mail1 heartbeat: [3485]: info: Link 10.9.9.14:10.9.9.14 dead. Jul 23 15:50:50 mail1 ipfail: [3517]: info: NS: We are dead. :< Jul 23 15:50:50 mail1 ipfail: [3517]: info: Link Status update: Link 10.9.9.14/10.9.9.14 now has status dead Jul 23 15:50:50 mail1 ipfail: [3517]: info: We are dead. :< Jul 23 15:50:50 mail1 ipfail: [3517]: info: Asking other side for ping node count. Jul 23 15:50:50 mail1 harc[3872]: [3878]: info: Running /etc/ha.d/rc.d/status status Jul 23 15:50:50 mail1 heartbeat: [3485]: info: Managed status process 3872 exited with return code 0. Jul 23 15:50:51 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:50:51 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:50:51 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:50:52 mail1 ntpd[3531]: sendto(131.130.251.107) (fd=22): Network is unreachable Jul 23 15:50:53 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:50:53 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:50:53 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:50:53 mail1 ntpd[3531]: sendto(213.235.200.208) (fd=22): Network is unreachable Jul 23 15:50:55 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:50:55 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:50:55 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:50:57 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:50:57 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:50:57 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:50:58 mail1 heartbeat: [3485]: WARN: node mail2.example.com: is dead Jul 23 15:50:58 mail1 ipfail: [3517]: info: Status update: Node mail2.example.com now has status dead Jul 23 15:50:58 mail1 ipfail: [3517]: info: NS: We are dead. :< Jul 23 15:50:58 mail1 heartbeat: [3485]: WARN: No STONITH device configured. Jul 23 15:50:58 mail1 heartbeat: [3485]: WARN: Shared disks are not protected. Jul 23 15:50:58 mail1 heartbeat: [3485]: info: Resources being acquired from mail2.example.com. Jul 23 15:50:58 mail1 harc[3893]: [3903]: info: Running /etc/ha.d/rc.d/status status Jul 23 15:50:58 mail1 mach_down[3918]: [3955]: info: /usr/share/heartbeat/mach_down: nice_failback: foreign resources acquired Jul 23 15:50:58 mail1 mach_down[3918]: [3964]: info: mach_down takeover complete for node mail2.example.com. Jul 23 15:50:58 mail1 heartbeat: [3485]: info: AnnounceTakeover(local 1, foreign 1, reason 'T_RESOURCES(us)' (1)) Jul 23 15:50:58 mail1 heartbeat: [3485]: info: mach_down takeover complete. Jul 23 15:50:58 mail1 heartbeat: [3485]: info: AnnounceTakeover(local 1, foreign 1, reason 'mach_down' (1)) Jul 23 15:50:58 mail1 heartbeat: [3485]: info: Managed status process 3893 exited with return code 0. Jul 23 15:50:58 mail1 IPaddr2[3969]: [4026]: INFO: Running OK Jul 23 15:50:58 mail1 heartbeat: [3894]: info: 1 local resources from [/usr/share/heartbeat/ResourceManager listkeys mail1.example.com] Jul 23 15:50:58 mail1 heartbeat: [3894]: info: Local Resource acquisition completed. Jul 23 15:50:58 mail1 heartbeat: [3894]: info: Writing type [resource] message to FIFO Jul 23 15:50:58 mail1 heartbeat: [3894]: info: FIFO message [type resource] written rc=79 Jul 23 15:50:58 mail1 heartbeat: [3485]: info: AnnounceTakeover(local 1, foreign 1, reason 'T_RESOURCES(us)' (1)) Jul 23 15:50:58 mail1 heartbeat: [3485]: info: Managed req_our_resources process 3894 exited with return code 0. Jul 23 15:50:58 mail1 heartbeat: [3485]: info: AnnounceTakeover(local 1, foreign 1, reason 'req_our_resources' (1)) Jul 23 15:50:59 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:50:59 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:50:59 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:51:01 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:51:01 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:51:01 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:51:03 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:51:03 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:51:03 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:51:05 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:51:05 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:51:05 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:51:07 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:51:07 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:51:07 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:51:09 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:51:09 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:51:09 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:51:11 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:51:11 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:51:11 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:51:13 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:51:13 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:51:13 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:51:15 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:51:15 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:51:15 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:51:17 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:51:17 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:51:17 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:51:19 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:51:19 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:51:19 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:51:21 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:51:21 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:51:21 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:51:23 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:51:23 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:51:23 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:51:25 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:51:25 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:51:25 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:51:27 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable Jul 23 15:51:27 mail1 heartbeat: [3499]: info: glib: euid=0 egid=0 Jul 23 15:51:27 mail1 heartbeat: [3499]: ERROR: write_child: write failure on ping 10.9.9.14.: Network is unreachable Jul 23 15:51:29 mail1 heartbeat: [3499]: ERROR: glib: Error sending packet: Network is unreachable