pengine[28112]: 2009/09/09_09:03:37 notice: StartRsc:  lnodbbt	Start resource_ORADB
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: -       </group>
pengine[28112]: 2009/09/09_09:03:37 notice: RecurringOp: lnodbbt	   resource_ORADB_monitor_120000
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: -     </resources>
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: -   </configuration>
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: - </cib>
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + <cib epoch="85" num_updates="1">
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: +   <configuration>
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: +     <resources>
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: +       <group id="RG_A">
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: +         <primitive id="resource_ORADB">
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: +           <meta_attributes id="resource_ORADB_meta_attrs">
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: +             <attributes>
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: +               <nvpair value="started" id="resource_ORADB_metaattr_target_role"/>
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: +             </attributes>
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: +           </meta_attributes>
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: +         </primitive>
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: +       </group>
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: +     </resources>
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: +   </configuration>
cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + </cib>
crmd[28096]: 2009/09/09_09:03:37 info: do_lrm_rsc_op: Performing op=resource_ORADB_start_0 key=11:3:182e4cd8-d5a8-4474-bd50-6186bdfb15d8)
lrmd[28093]: 2009/09/09_09:03:37 info: rsc:resource_ORADB: start
cib[28686]: 2009/09/09_09:03:37 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
pengine[28112]: 2009/09/09_09:03:37 info: process_pe_message: Transition 3: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-112.bz2
cib[28686]: 2009/09/09_09:03:37 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
cib[28686]: 2009/09/09_09:03:37 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last)
cib[28686]: 2009/09/09_09:03:37 info: write_cib_contents: Wrote version 0.85.1 of the CIB to disk (digest: bffe9d21b2d7280aeb6c287f0d79ca88)
cib[28686]: 2009/09/09_09:03:37 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
cib[28686]: 2009/09/09_09:03:37 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last)
oracle[28687][28819]: 2009/09/09_09:03:58 ERROR: Oracle dssd can not mount.
crmd[28096]: 2009/09/09_09:03:58 info: process_lrm_event: LRM operation resource_ORADB_start_0 (call=9, rc=1) complete 
tengine[28111]: 2009/09/09_09:03:58 info: status_from_rc: Re-mapping op status to LRM_OP_ERROR for rc=1
tengine[28111]: 2009/09/09_09:03:58 WARN: status_from_rc: Action start on lnodbbt failed (target: <null> vs. rc: 1): Error
tengine[28111]: 2009/09/09_09:03:58 WARN: update_failcount: Updating failcount for resource_ORADB on ea71aa52-137e-49b4-a9ab-30487b39157d after failed start: rc=1
tengine[28111]: 2009/09/09_09:03:58 info: update_abort_priority: Abort priority upgraded to 1
tengine[28111]: 2009/09/09_09:03:58 info: update_abort_priority: Abort action 0 superceeded by 2
tengine[28111]: 2009/09/09_09:03:58 info: match_graph_event: Action resource_ORADB_start_0 (11) confirmed on lnodbbt (rc=4)
tengine[28111]: 2009/09/09_09:03:58 info: run_graph: ====================================================
tengine[28111]: 2009/09/09_09:03:58 notice: run_graph: Transition 3: (Complete=1, Pending=0, Fired=0, Skipped=2, Incomplete=0)
tengine[28111]: 2009/09/09_09:03:58 WARN: notify_crmd: Delaying completion until all CIB updates complete
crmd[28096]: 2009/09/09_09:03:58 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ]
tengine[28111]: 2009/09/09_09:03:58 info: extract_event: Aborting on transient_attributes changes for ea71aa52-137e-49b4-a9ab-30487b39157d
crmd[28096]: 2009/09/09_09:03:58 info: do_state_transition: All 2 cluster nodes are eligible to run resources.
tengine[28111]: 2009/09/09_09:03:58 info: update_abort_priority: Abort priority upgraded to 1000000
tengine[28111]: 2009/09/09_09:03:58 info: update_abort_priority: 'Event failed' abort superceeded
tengine[28111]: 2009/09/09_09:03:58 WARN: notify_crmd: Delaying completion until all CIB updates complete
pengine[28112]: 2009/09/09_09:03:58 info: determine_online_status: Node lnodbbt is online
pengine[28112]: 2009/09/09_09:03:58 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR
pengine[28112]: 2009/09/09_09:03:58 WARN: unpack_rsc_op: Processing failed op resource_ORADB_start_0 on lnodbbt: Error
pengine[28112]: 2009/09/09_09:03:58 WARN: unpack_rsc_op: Compatability handling for failed op resource_ORADB_start_0 on lnodbbt
pengine[28112]: 2009/09/09_09:03:58 info: determine_online_status: Node lnodbct is online
pengine[28112]: 2009/09/09_09:03:58 notice: group_print: Resource Group: RG_A
pengine[28112]: 2009/09/09_09:03:58 notice: native_print:     resource_IP_A	(ocf::heartbeat:IPaddr):	Started lnodbbt
pengine[28112]: 2009/09/09_09:03:58 notice: native_print:     resource_DRBD_A	(heartbeat:drbddisk):	Started lnodbbt
pengine[28112]: 2009/09/09_09:03:58 notice: native_print:     resource_FS_A	(ocf::heartbeat:Filesystem):	Started lnodbbt
pengine[28112]: 2009/09/09_09:03:58 notice: native_print:     resource_ORADB	(ocf::heartbeat:oracle):	Started lnodbbt FAILED
pengine[28112]: 2009/09/09_09:03:58 notice: NoRoleChange: Move  resource resource_IP_A	(lnodbbt -> lnodbct)
pengine[28112]: 2009/09/09_09:03:58 notice: StopRsc:   lnodbbt	Stop resource_IP_A
pengine[28112]: 2009/09/09_09:03:58 notice: StartRsc:  lnodbct	Start resource_IP_A
pengine[28112]: 2009/09/09_09:03:58 notice: NoRoleChange: Move  resource resource_DRBD_A	(lnodbbt -> lnodbct)
pengine[28112]: 2009/09/09_09:03:58 notice: StopRsc:   lnodbbt	Stop resource_DRBD_A
pengine[28112]: 2009/09/09_09:03:58 notice: StartRsc:  lnodbct	Start resource_DRBD_A
pengine[28112]: 2009/09/09_09:03:58 notice: NoRoleChange: Move  resource resource_FS_A	(lnodbbt -> lnodbct)
pengine[28112]: 2009/09/09_09:03:58 notice: StopRsc:   lnodbbt	Stop resource_FS_A
pengine[28112]: 2009/09/09_09:03:58 notice: StartRsc:  lnodbct	Start resource_FS_A
pengine[28112]: 2009/09/09_09:03:58 notice: NoRoleChange: Recover resource resource_ORADB	(lnodbct)
pengine[28112]: 2009/09/09_09:03:58 notice: StopRsc:   lnodbbt	Stop resource_ORADB
pengine[28112]: 2009/09/09_09:03:58 notice: StartRsc:  lnodbct	Start resource_ORADB
pengine[28112]: 2009/09/09_09:03:58 notice: RecurringOp: lnodbct	   resource_ORADB_monitor_120000
crmd[28096]: 2009/09/09_09:03:58 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
tengine[28111]: 2009/09/09_09:03:58 info: unpack_graph: Unpacked transition 4: 14 actions in 14 synapses
tengine[28111]: 2009/09/09_09:03:58 info: te_pseudo_action: Pseudo action 16 fired and confirmed
tengine[28111]: 2009/09/09_09:03:58 info: send_rsc_command: Initiating action 1: resource_ORADB_stop_0 on lnodbbt
crmd[28096]: 2009/09/09_09:03:58 info: do_lrm_rsc_op: Performing op=resource_ORADB_stop_0 key=1:4:182e4cd8-d5a8-4474-bd50-6186bdfb15d8)
lrmd[28093]: 2009/09/09_09:03:58 info: rsc:resource_ORADB: stop
pengine[28112]: 2009/09/09_09:03:58 info: process_pe_message: Transition 4: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-113.bz2
mgmtd[28097]: 2009/09/09_09:03:58 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR
oracle[28827][28942]: 2009/09/09_09:03:58 INFO: Oracle instance dssd stopped: ENV MSG: Server Express environment enabled
alter system checkpoint
*
ERROR at line 1:
ORA-01109: database not open


ORACLE instance shut down.
crmd[28096]: 2009/09/09_09:03:59 info: process_lrm_event: LRM operation resource_ORADB_stop_0 (call=10, rc=0) complete 
oracle[28827][28944]: 2009/09/09_09:03:59 INFO: Cleaning up for dssd
tengine[28111]: 2009/09/09_09:03:59 info: match_graph_event: Action resource_ORADB_stop_0 (1) confirmed on lnodbbt (rc=0)
tengine[28111]: 2009/09/09_09:03:59 info: send_rsc_command: Initiating action 10: resource_FS_A_stop_0 on lnodbbt
crmd[28096]: 2009/09/09_09:03:59 info: do_lrm_rsc_op: Performing op=resource_FS_A_stop_0 key=10:4:182e4cd8-d5a8-4474-bd50-6186bdfb15d8)
lrmd[28093]: 2009/09/09_09:03:59 info: rsc:resource_FS_A: stop
Filesystem[28949][28979]: 2009/09/09_09:03:59 INFO: Running stop for /dev/drbd0 on /dbms01
Filesystem[28949][28989]: 2009/09/09_09:03:59 INFO: Trying to unmount /dbms01
Filesystem[28949][28992]: 2009/09/09_09:03:59 INFO: unmounted /dbms01 successfully
lrmd[28093]: 2009/09/09_09:03:59 info: rsc:resource_DRBD_A: stop
crmd[28096]: 2009/09/09_09:03:59 info: process_lrm_event: LRM operation resource_FS_A_stop_0 (call=11, rc=0) complete 
tengine[28111]: 2009/09/09_09:03:59 info: match_graph_event: Action resource_FS_A_stop_0 (10) confirmed on lnodbbt (rc=0)
crmd[28096]: 2009/09/09_09:03:59 info: do_lrm_rsc_op: Performing op=resource_DRBD_A_stop_0 key=8:4:182e4cd8-d5a8-4474-bd50-6186bdfb15d8)
tengine[28111]: 2009/09/09_09:03:59 info: send_rsc_command: Initiating action 8: resource_DRBD_A_stop_0 on lnodbbt
crmd[28096]: 2009/09/09_09:04:00 info: process_lrm_event: LRM operation resource_DRBD_A_stop_0 (call=12, rc=0) complete 
tengine[28111]: 2009/09/09_09:04:00 info: match_graph_event: Action resource_DRBD_A_stop_0 (8) confirmed on lnodbbt (rc=0)
tengine[28111]: 2009/09/09_09:04:00 info: send_rsc_command: Initiating action 6: resource_IP_A_stop_0 on lnodbbt
lrmd[28093]: 2009/09/09_09:04:00 info: rsc:resource_IP_A: stop
crmd[28096]: 2009/09/09_09:04:00 info: do_lrm_rsc_op: Performing op=resource_IP_A_stop_0 key=6:4:182e4cd8-d5a8-4474-bd50-6186bdfb15d8)
lrmd[28093]: 2009/09/09_09:04:00 info: RA output: (resource_IP_A:stop:stdout) In IP Stop

lrmd[28093]: 2009/09/09_09:04:00 info: RA output: (resource_IP_A:stop:stderr) SIOCDELRT: No such process

IPaddr[29000][29015]: 2009/09/09_09:04:00 INFO: ifconfig eth0:0 down
crmd[28096]: 2009/09/09_09:04:00 info: process_lrm_event: LRM operation resource_IP_A_stop_0 (call=13, rc=0) complete 
tengine[28111]: 2009/09/09_09:04:00 info: match_graph_event: Action resource_IP_A_stop_0 (6) confirmed on lnodbbt (rc=0)
tengine[28111]: 2009/09/09_09:04:00 info: te_pseudo_action: Pseudo action 17 fired and confirmed
tengine[28111]: 2009/09/09_09:04:00 info: te_pseudo_action: Pseudo action 2 fired and confirmed
tengine[28111]: 2009/09/09_09:04:00 info: te_pseudo_action: Pseudo action 14 fired and confirmed
tengine[28111]: 2009/09/09_09:04:00 info: send_rsc_command: Initiating action 7: resource_IP_A_start_0 on lnodbct
mgmtd[28097]: 2009/09/09_09:04:00 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR
tengine[28111]: 2009/09/09_09:04:01 info: match_graph_event: Action resource_IP_A_start_0 (7) confirmed on lnodbct (rc=0)
tengine[28111]: 2009/09/09_09:04:01 info: send_rsc_command: Initiating action 9: resource_DRBD_A_start_0 on lnodbct
mgmtd[28097]: 2009/09/09_09:04:02 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR
tengine[28111]: 2009/09/09_09:04:03 info: match_graph_event: Action resource_DRBD_A_start_0 (9) confirmed on lnodbct (rc=0)
tengine[28111]: 2009/09/09_09:04:03 info: send_rsc_command: Initiating action 11: resource_FS_A_start_0 on lnodbct
mgmtd[28097]: 2009/09/09_09:04:04 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR
tengine[28111]: 2009/09/09_09:04:05 info: match_graph_event: Action resource_FS_A_start_0 (11) confirmed on lnodbct (rc=0)
tengine[28111]: 2009/09/09_09:04:05 info: send_rsc_command: Initiating action 12: resource_ORADB_start_0 on lnodbct
mgmtd[28097]: 2009/09/09_09:04:06 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR
tengine[28111]: 2009/09/09_09:04:33 info: status_from_rc: Re-mapping op status to LRM_OP_ERROR for rc=1
tengine[28111]: 2009/09/09_09:04:33 WARN: status_from_rc: Action start on lnodbct failed (target: <null> vs. rc: 1): Error
tengine[28111]: 2009/09/09_09:04:33 WARN: update_failcount: Updating failcount for resource_ORADB on 050d8990-ec19-4da5-9fd5-8dfb7490e2d1 after failed start: rc=1
crmd[28096]: 2009/09/09_09:04:33 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ]
tengine[28111]: 2009/09/09_09:04:33 info: update_abort_priority: Abort priority upgraded to 1
crmd[28096]: 2009/09/09_09:04:33 info: do_state_transition: All 2 cluster nodes are eligible to run resources.
tengine[28111]: 2009/09/09_09:04:33 info: update_abort_priority: Abort action 0 superceeded by 2
tengine[28111]: 2009/09/09_09:04:33 info: match_graph_event: Action resource_ORADB_start_0 (12) confirmed on lnodbct (rc=4)
tengine[28111]: 2009/09/09_09:04:33 info: run_graph: ====================================================
tengine[28111]: 2009/09/09_09:04:33 notice: run_graph: Transition 4: (Complete=12, Pending=0, Fired=0, Skipped=2, Incomplete=0)
tengine[28111]: 2009/09/09_09:04:33 WARN: notify_crmd: Delaying completion until all CIB updates complete
tengine[28111]: 2009/09/09_09:04:33 info: extract_event: Aborting on transient_attributes changes for 050d8990-ec19-4da5-9fd5-8dfb7490e2d1
tengine[28111]: 2009/09/09_09:04:33 info: update_abort_priority: Abort priority upgraded to 1000000
tengine[28111]: 2009/09/09_09:04:33 info: update_abort_priority: 'Event failed' abort superceeded
tengine[28111]: 2009/09/09_09:04:33 WARN: notify_crmd: Delaying completion until all CIB updates complete
crmd[28096]: 2009/09/09_09:04:33 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
pengine[28112]: 2009/09/09_09:04:33 info: determine_online_status: Node lnodbbt is online
pengine[28112]: 2009/09/09_09:04:33 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR
pengine[28112]: 2009/09/09_09:04:33 WARN: unpack_rsc_op: Processing failed op resource_ORADB_start_0 on lnodbbt: Error
pengine[28112]: 2009/09/09_09:04:33 WARN: unpack_rsc_op: Compatability handling for failed op resource_ORADB_start_0 on lnodbbt
pengine[28112]: 2009/09/09_09:04:33 info: determine_online_status: Node lnodbct is online
pengine[28112]: 2009/09/09_09:04:33 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbct to an ERROR
pengine[28112]: 2009/09/09_09:04:33 WARN: unpack_rsc_op: Processing failed op resource_ORADB_start_0 on lnodbct: Error
pengine[28112]: 2009/09/09_09:04:33 WARN: unpack_rsc_op: Compatability handling for failed op resource_ORADB_start_0 on lnodbct
pengine[28112]: 2009/09/09_09:04:33 notice: group_print: Resource Group: RG_A
pengine[28112]: 2009/09/09_09:04:33 notice: native_print:     resource_IP_A	(ocf::heartbeat:IPaddr):	Started lnodbct
pengine[28112]: 2009/09/09_09:04:33 notice: native_print:     resource_DRBD_A	(heartbeat:drbddisk):	Started lnodbct
pengine[28112]: 2009/09/09_09:04:33 notice: native_print:     resource_FS_A	(ocf::heartbeat:Filesystem):	Started lnodbct
pengine[28112]: 2009/09/09_09:04:33 notice: native_print:     resource_ORADB	(ocf::heartbeat:oracle):	Started lnodbct FAILED
pengine[28112]: 2009/09/09_09:04:33 WARN: native_color: Resource resource_ORADB cannot run anywhere
pengine[28112]: 2009/09/09_09:04:33 notice: NoRoleChange: Move  resource resource_IP_A	(lnodbct -> lnodbbt)
pengine[28112]: 2009/09/09_09:04:33 notice: StopRsc:   lnodbct	Stop resource_IP_A
tengine[28111]: 2009/09/09_09:04:33 info: unpack_graph: Unpacked transition 5: 11 actions in 11 synapses
pengine[28112]: 2009/09/09_09:04:33 notice: StartRsc:  lnodbbt	Start resource_IP_A
tengine[28111]: 2009/09/09_09:04:33 info: te_pseudo_action: Pseudo action 14 fired and confirmed
pengine[28112]: 2009/09/09_09:04:33 notice: NoRoleChange: Move  resource resource_DRBD_A	(lnodbct -> lnodbbt)
tengine[28111]: 2009/09/09_09:04:33 info: send_rsc_command: Initiating action 1: resource_ORADB_stop_0 on lnodbct
pengine[28112]: 2009/09/09_09:04:33 notice: StopRsc:   lnodbct	Stop resource_DRBD_A
pengine[28112]: 2009/09/09_09:04:33 notice: StartRsc:  lnodbbt	Start resource_DRBD_A
pengine[28112]: 2009/09/09_09:04:33 notice: NoRoleChange: Move  resource resource_FS_A	(lnodbct -> lnodbbt)
pengine[28112]: 2009/09/09_09:04:33 notice: StopRsc:   lnodbct	Stop resource_FS_A
pengine[28112]: 2009/09/09_09:04:33 notice: StartRsc:  lnodbbt	Start resource_FS_A
pengine[28112]: 2009/09/09_09:04:33 notice: StopRsc:   lnodbct	Stop resource_ORADB
pengine[28112]: 2009/09/09_09:04:33 WARN: process_pe_message: Transition 5: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-31.bz2
pengine[28112]: 2009/09/09_09:04:33 info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
mgmtd[28097]: 2009/09/09_09:04:33 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR
mgmtd[28097]: 2009/09/09_09:04:33 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbct to an ERROR
tengine[28111]: 2009/09/09_09:04:36 info: match_graph_event: Action resource_ORADB_stop_0 (1) confirmed on lnodbct (rc=0)
tengine[28111]: 2009/09/09_09:04:36 info: send_rsc_command: Initiating action 10: resource_FS_A_stop_0 on lnodbct
mgmtd[28097]: 2009/09/09_09:04:36 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR
mgmtd[28097]: 2009/09/09_09:04:36 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbct to an ERROR
tengine[28111]: 2009/09/09_09:04:37 info: match_graph_event: Action resource_FS_A_stop_0 (10) confirmed on lnodbct (rc=0)
tengine[28111]: 2009/09/09_09:04:37 info: send_rsc_command: Initiating action 8: resource_DRBD_A_stop_0 on lnodbct
mgmtd[28097]: 2009/09/09_09:04:37 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR
mgmtd[28097]: 2009/09/09_09:04:37 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbct to an ERROR
tengine[28111]: 2009/09/09_09:04:38 info: match_graph_event: Action resource_DRBD_A_stop_0 (8) confirmed on lnodbct (rc=0)
tengine[28111]: 2009/09/09_09:04:38 info: send_rsc_command: Initiating action 6: resource_IP_A_stop_0 on lnodbct
mgmtd[28097]: 2009/09/09_09:04:38 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR
mgmtd[28097]: 2009/09/09_09:04:38 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbct to an ERROR
tengine[28111]: 2009/09/09_09:04:39 info: match_graph_event: Action resource_IP_A_stop_0 (6) confirmed on lnodbct (rc=0)
tengine[28111]: 2009/09/09_09:04:39 info: te_pseudo_action: Pseudo action 15 fired and confirmed
tengine[28111]: 2009/09/09_09:04:39 info: te_pseudo_action: Pseudo action 2 fired and confirmed
tengine[28111]: 2009/09/09_09:04:39 info: te_pseudo_action: Pseudo action 12 fired and confirmed
tengine[28111]: 2009/09/09_09:04:39 info: send_rsc_command: Initiating action 7: resource_IP_A_start_0 on lnodbbt
crmd[28096]: 2009/09/09_09:04:39 info: do_lrm_rsc_op: Performing op=resource_IP_A_start_0 key=7:5:182e4cd8-d5a8-4474-bd50-6186bdfb15d8)
lrmd[28093]: 2009/09/09_09:04:39 info: rsc:resource_IP_A: start
lrmd[28093]: 2009/09/09_09:04:39 info: RA output: (resource_IP_A:start:stderr) Converted dotted-quad netmask to CIDR as: 24

IPaddr[29018][29073]: 2009/09/09_09:04:39 INFO: eval ifconfig eth0:0 172.31.100.60 netmask 255.255.255.0 broadcast 172.31.100.255
crmd[28096]: 2009/09/09_09:04:39 info: process_lrm_event: LRM operation resource_IP_A_start_0 (call=14, rc=0) complete 
tengine[28111]: 2009/09/09_09:04:39 info: match_graph_event: Action resource_IP_A_start_0 (7) confirmed on lnodbbt (rc=0)
tengine[28111]: 2009/09/09_09:04:39 info: send_rsc_command: Initiating action 9: resource_DRBD_A_start_0 on lnodbbt
crmd[28096]: 2009/09/09_09:04:39 info: do_lrm_rsc_op: Performing op=resource_DRBD_A_start_0 key=9:5:182e4cd8-d5a8-4474-bd50-6186bdfb15d8)
lrmd[28093]: 2009/09/09_09:04:39 info: rsc:resource_DRBD_A: start
crmd[28096]: 2009/09/09_09:04:39 info: process_lrm_event: LRM operation resource_DRBD_A_start_0 (call=15, rc=0) complete 
tengine[28111]: 2009/09/09_09:04:39 info: match_graph_event: Action resource_DRBD_A_start_0 (9) confirmed on lnodbbt (rc=0)
tengine[28111]: 2009/09/09_09:04:39 info: send_rsc_command: Initiating action 11: resource_FS_A_start_0 on lnodbbt
crmd[28096]: 2009/09/09_09:04:39 info: do_lrm_rsc_op: Performing op=resource_FS_A_start_0 key=11:5:182e4cd8-d5a8-4474-bd50-6186bdfb15d8)
lrmd[28093]: 2009/09/09_09:04:39 info: rsc:resource_FS_A: start
Filesystem[29095][29125]: 2009/09/09_09:04:39 INFO: Running start for /dev/drbd0 on /dbms01
crmd[28096]: 2009/09/09_09:04:39 info: process_lrm_event: LRM operation resource_FS_A_start_0 (call=16, rc=0) complete 
crmd[28096]: 2009/09/09_09:04:39 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
tengine[28111]: 2009/09/09_09:04:39 info: match_graph_event: Action resource_FS_A_start_0 (11) confirmed on lnodbbt (rc=0)
tengine[28111]: 2009/09/09_09:04:39 info: run_graph: Transition 5: (Complete=11, Pending=0, Fired=0, Skipped=0, Incomplete=0)
tengine[28111]: 2009/09/09_09:04:39 info: notify_crmd: Transition 5 status: te_complete - <null>
mgmtd[28097]: 2009/09/09_09:04:39 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR
mgmtd[28097]: 2009/09/09_09:04:39 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbct to an ERROR
cib[28092]: 2009/09/09_09:12:14 info: cib_stats: Processed 36 operations (3611.00us average, 0% utilization) in the last 10min
heartbeat[28079]: 2009/09/09_09:30:02 WARN: Gmain_timeout_dispatch: Dispatch function for send local status was delayed 720 ms (> 510 ms) before being called (GSource: 0x80131598)
heartbeat[28079]: 2009/09/09_09:30:02 info: Gmain_timeout_dispatch: started at 4338635256 should have started at 4338635184
heartbeat[28079]: 2009/09/09_09:30:02 WARN: Gmain_timeout_dispatch: Dispatch function for check for signals was delayed 720 ms (> 510 ms) before being called (GSource: 0x80131cb8)
heartbeat[28079]: 2009/09/09_09:30:02 info: Gmain_timeout_dispatch: started at 4338635256 should have started at 4338635184
mgmtd[28097]: 2009/09/09_09:47:04 info: (delete)xml:<nvpair id="resource_ORADB_instattr_target_role">
mgmtd[28097]: 2009/09/09_09:47:04 info: on_set_target_role:<group id="RG_A"><primitive id="resource_ORADB"><meta_attributes id="resource_ORADB_meta_attrs"><attributes><nvpair id="resource_ORADB_metaattr_target_role" name="target_role" value="stopped"/></attributes></meta_attributes></primitive></group>
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - <cib epoch="85" num_updates="20">
crmd[28096]: 2009/09/09_09:47:04 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ]
tengine[28111]: 2009/09/09_09:47:04 info: update_abort_priority: Abort priority upgraded to 1000000
pengine[28112]: 2009/09/09_09:47:04 info: determine_online_status: Node lnodbbt is online
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: -   <configuration>
crmd[28096]: 2009/09/09_09:47:04 info: do_state_transition: All 2 cluster nodes are eligible to run resources.
pengine[28112]: 2009/09/09_09:47:04 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: -     <resources>
pengine[28112]: 2009/09/09_09:47:04 WARN: unpack_rsc_op: Processing failed op resource_ORADB_start_0 on lnodbbt: Error
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: -       <group id="RG_A">
pengine[28112]: 2009/09/09_09:47:04 WARN: unpack_rsc_op: Compatability handling for failed op resource_ORADB_start_0 on lnodbbt
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: -         <primitive id="resource_ORADB">
pengine[28112]: 2009/09/09_09:47:04 info: determine_online_status: Node lnodbct is online
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: -           <meta_attributes id="resource_ORADB_meta_attrs">
pengine[28112]: 2009/09/09_09:47:04 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbct to an ERROR
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: -             <attributes>
pengine[28112]: 2009/09/09_09:47:04 WARN: unpack_rsc_op: Processing failed op resource_ORADB_start_0 on lnodbct: Error
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: -               <nvpair value="started" id="resource_ORADB_metaattr_target_role"/>
pengine[28112]: 2009/09/09_09:47:04 WARN: unpack_rsc_op: Compatability handling for failed op resource_ORADB_start_0 on lnodbct
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: -             </attributes>
pengine[28112]: 2009/09/09_09:47:04 notice: group_print: Resource Group: RG_A
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: -           </meta_attributes>
pengine[28112]: 2009/09/09_09:47:04 notice: native_print:     resource_IP_A	(ocf::heartbeat:IPaddr):	Started lnodbbt
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: -         </primitive>
pengine[28112]: 2009/09/09_09:47:04 notice: native_print:     resource_DRBD_A	(heartbeat:drbddisk):	Started lnodbbt
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: -       </group>
pengine[28112]: 2009/09/09_09:47:04 notice: native_print:     resource_FS_A	(ocf::heartbeat:Filesystem):	Started lnodbbt
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: -     </resources>
pengine[28112]: 2009/09/09_09:47:04 notice: native_print:     resource_ORADB	(ocf::heartbeat:oracle):	Stopped 
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: -   </configuration>
pengine[28112]: 2009/09/09_09:47:04 WARN: native_color: Resource resource_ORADB cannot run anywhere
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - </cib>
pengine[28112]: 2009/09/09_09:47:04 notice: NoRoleChange: Leave resource resource_IP_A	(lnodbbt)
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + <cib epoch="86" num_updates="1">
pengine[28112]: 2009/09/09_09:47:04 notice: NoRoleChange: Leave resource resource_DRBD_A	(lnodbbt)
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: +   <configuration>
pengine[28112]: 2009/09/09_09:47:04 notice: NoRoleChange: Leave resource resource_FS_A	(lnodbbt)
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: +     <resources>
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: +       <group id="RG_A">
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: +         <primitive id="resource_ORADB">
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: +           <meta_attributes id="resource_ORADB_meta_attrs">
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: +             <attributes>
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: +               <nvpair value="stopped" id="resource_ORADB_metaattr_target_role"/>
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: +             </attributes>
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: +           </meta_attributes>
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: +         </primitive>
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: +       </group>
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: +     </resources>
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: +   </configuration>
cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + </cib>
crmd[28096]: 2009/09/09_09:47:04 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
tengine[28111]: 2009/09/09_09:47:04 info: unpack_graph: Unpacked transition 6: 0 actions in 0 synapses
tengine[28111]: 2009/09/09_09:47:04 info: run_graph: Transition 6: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0)
tengine[28111]: 2009/09/09_09:47:04 info: notify_crmd: Transition 6 status: te_complete - <null>
crmd[28096]: 2009/09/09_09:47:04 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
cib[29265]: 2009/09/09_09:47:04 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)