[DRBD-user] drbd + mysql issues

Joe Warren-Meeks joe at encoretickets.co.uk
Tue May 4 12:09:00 CEST 2010

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


Hey guys,

 

I've got a relatively simple drbd + mysql with heartbeat setup working.
In testing this worked well and I tested failover and failback many
times successfully.

 

However, now it is in production I'm seeing one particular issue. It
seems that drbd decides to fail over to the secondary, but heartbeat
doesn't seem to restart mysql. I'm seeing the following in my syslog at
around the time:

 

May  4 09:42:56 d1 -- MARK --

May  4 09:54:28 d1 mysqld[1603]: 100504  9:54:28 [ERROR]
/usr/sbin/mysqld: Can't open file: './mydb/T_LOG.frm' (errno: 24)

May  4 09:54:28 d1 mysqld[1603]: 100504  9:54:28 [ERROR]
/usr/sbin/mysqld: Can't open file: './mydb/T_LOG.frm' (errno: 24)

May  4 09:54:28 d1 mysqld[1603]: 100504  9:54:28 [ERROR]
/usr/sbin/mysqld: Can't open file: './mydb/E_SHOW.frm' (errno: 24)

 

Etc..

 

At the same time in dmesg I get:

 

[1044838.725584] drbd1: role( Primary -> Secondary ) 

[1044838.725657] drbd1: Writing meta data super block now.

[1044838.901794] drbd1: peer( Secondary -> Primary ) 

[1044838.901802] drbd1: Writing meta data super block now.

[1044860.119442] drbd1: peer( Primary -> Secondary ) 

[1044860.119449] drbd1: Writing meta data super block now.

[1044860.712560] drbd1: role( Secondary -> Primary ) 

[1044860.712595] drbd1: Writing meta data super block now.

[1044860.883506] kjournald starting.  Commit interval 5 seconds

[1044860.893665] EXT3 FS on drbd1, internal journal

[1044860.893672] EXT3-fs: mounted filesystem with ordered data mode.

 

Now, all I need to do is restart mysql and all is well.. 

 

Firstly, is there any way of debugging why drbd is switching over to the
secondary  and secondly is there any way to determine why heartbeat
isn't restarting mysql?

 

Kind regards

 

 -- joe.

 

Joe Warren-Meeks

Director Of Systems Development

ENCORE TICKETS LTD

Encore House, 50-51 Bedford Row, London WC1R 4LR

Direct line:          +44 (0)20 7492 1506

Reservations:    +44 (0)20 7492 1500

Fax:                        +44 (0)20 7831 4410

Email:                    joe at encoretickets.co.uk
<mailto:joe at encoretickets.co.uk> 

web:                      www.encoretickets.co.uk
<http://www.encoretickets.co.uk/> 

 

 

Copyright in this message and any attachments remains with us. It is
confidential and may be legally privileged. If this message is not
intended for you it must not be read, copied or used by you or disclosed
to anyone else. Please advise the sender immediately if you have
received this message in error. Although this message and any
attachments are believed to be free of any virus or other defect that
might affect any computer system into which it is received and opened it
is the responsibility of the recipient to ensure that it is virus free
and no responsibility is accepted by Encore Tickets Limited for any loss
or damage in any way arising from its use.

 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linbit.com/pipermail/drbd-user/attachments/20100504/243562a8/attachment.htm>


More information about the drbd-user mailing list