[DRBD-user] Synchronization delayed

Antonio Fernández Pérez antoniofernandez at fabergroup.es
Tue Jul 15 18:43:59 CEST 2014

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


​Hi list,

I have decided to post here because I have some doubts with my DRBD status.

I have detected that there are some IO problems on my dedicated server that
works with MySQL over DRBD cluster with Corosync+Pacemaker. Checking system
status, I have seen that iostat shows overload with drbd device. Then, I
have checked drbd status reading logs. In ​the corosync.log file appears
the following line:

Jul 15 17:50:15 llwh747-y lrmd: [1390]: WARN: G_SIG_dispatch: Dispatch
function for SIGCHLD was delayed 560 ms (> 100 ms) before being called
(GSource: 0xa69e10)

I'm not sure if this warning is related with IO hard disk problems or if
this warning can derivate in a bigger problem.

Let me put iostat output.

==========================
root at llwh747-y:/usr/lib/nagios/plugins# iostat -dx 5 5
Linux 2.6.32-5-amd64 (llwh747-y)     07/15/2014     _x86_64_    (4 CPU)

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz
avgqu-sz   await  svctm  %util
sda               0.12    21.22    1.45    1.26   175.27   177.73
130.17     0.16   59.48   1.99   0.54
dm-0              0.00     0.00    0.05    0.12     1.29     0.94
13.07     0.00   13.49   2.31   0.04
dm-1              0.00     0.00    0.13    0.13     1.07     1.05
8.00     0.01   55.02   0.93   0.02
dm-2              0.00     0.00    0.07    1.13     7.20     9.02
13.54     0.02   19.09   2.34   0.28
dm-3              0.00     0.00    1.31   20.84   165.70   166.72
15.00     0.39   17.62   0.11   0.24
sdb               0.80    33.38    2.97   11.57    30.15   355.90
26.55     0.28   19.60   7.28  10.59
dm-4              0.00     0.00    3.77   44.94    30.15   355.90
7.93     0.20    4.02   2.17  10.59
drbd0             0.00     0.00    3.77   44.42    30.15   355.34
8.00     0.19    7.99   9.57  46.12

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz
avgqu-sz   await  svctm  %util
sda               0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-0              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-1              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-2              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-3              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
sdb               1.60    12.60    0.80   13.60    19.20   206.80
15.69     0.04    2.89   1.28   1.84
dm-4              0.00     0.00    2.40   26.20    19.20   206.80
7.90     0.09    3.22   0.67   1.92
drbd0             0.00     0.00    2.40   25.80    19.20   206.40
8.00     8.81    3.83  35.46 100.00

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz
avgqu-sz   await  svctm  %util
sda               0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-0              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-1              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-2              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-3              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
sdb               0.40    33.40    0.40   22.60     6.40   443.80
19.57     0.10    4.28   0.70   1.60
dm-4              0.00     0.00    0.80   56.00     6.40   443.80
7.93     0.29    5.03   0.28   1.60
drbd0             0.00     0.00    0.80   55.40     6.40   443.20
8.00     9.80    5.55  17.74  99.68

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz
avgqu-sz   await  svctm  %util
sda               0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-0              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-1              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-2              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-3              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
sdb               0.00    14.00    0.00   22.60     0.00   285.80
12.65     0.11    4.78   1.17   2.64
dm-4              0.00     0.00    0.00   36.60     0.00   285.80
7.81     0.18    5.01   0.72   2.64
drbd0             0.00     0.00    0.00   35.60     0.00   284.80
8.00     9.30    6.22  28.02  99.76

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz
avgqu-sz   await  svctm  %util
sda               0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-0              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-1              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-2              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
dm-3              0.00     0.00    0.00    0.00     0.00     0.00
0.00     0.00    0.00   0.00   0.00
sdb               3.40    71.80    1.40   22.20    38.40   745.00
33.19     0.11    4.54   1.29   3.04
dm-4              0.00     0.00    4.80   94.00    38.40   745.00
7.93     0.83    8.40   0.31   3.04
drbd0             0.00     0.00    4.80   93.00    38.40   744.00
8.00    11.44    9.10  10.22  99.92

==========================

Please, let me know if you need any details (Configuraion or the output of
any command).

I hope your help.

Thanks in advance.

Regards,

Antonio.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linbit.com/pipermail/drbd-user/attachments/20140715/eab8dbba/attachment.htm>


More information about the drbd-user mailing list