Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.
I'm not sure if this can be caused by drbd but I don't know why this happened. The primary node failed and watching the logs I see in /var/log/kern.log: Feb 13 10:33:47 localhost kernel: drbd0: Resync done (total 1 sec; paused 0 sec; 640 K/sec) Feb 13 10:33:47 localhost kernel: drbd0: drbd0_worker [28363]: cstate SyncSource --> Connected Feb 14 15:48:02 localhost kernel: dst cache overflow Feb 14 15:48:05 localhost last message repeated 9 times Feb 14 15:48:07 localhost kernel: printk: 28 messages suppressed. Feb 14 15:48:07 localhost kernel: dst cache overflow Feb 14 15:48:12 localhost kernel: printk: 35 messages suppressed. Feb 14 15:48:12 localhost kernel: dst cache overflow Feb 14 15:48:12 localhost kernel: drbd0: PingAck did not arrive in time. Feb 14 15:48:12 localhost kernel: drbd0: drbd0_asender [30329]: cstate Connected --> NetworkFailure Feb 14 15:48:12 localhost kernel: drbd0: asender terminated Feb 14 15:48:12 localhost kernel: drbd0: drbd0_receiver [3192]: cstate NetworkFailure --> BrokenPipe Feb 14 15:48:12 localhost kernel: drbd0: short read expecting header on sock: r=-512 Feb 14 15:48:12 localhost kernel: drbd0: worker terminated Feb 14 15:48:12 localhost kernel: drbd0: drbd0_receiver [3192]: cstate BrokenPipe --> Unconnected Feb 14 15:48:17 localhost kernel: printk: 56 messages suppressed. Feb 14 15:48:17 localhost kernel: dst cache overflow Feb 14 15:48:23 localhost kernel: printk: 34 messages suppressed. Feb 14 15:48:23 localhost kernel: dst cache overflow Feb 14 15:48:27 localhost kernel: printk: 22 messages suppressed. Feb 14 15:48:27 localhost kernel: dst cache overflow Feb 14 15:48:32 localhost kernel: printk: 26 messages suppressed. Feb 14 15:48:32 localhost kernel: dst cache overflow Feb 14 15:48:37 localhost kernel: printk: 29 messages suppressed. Feb 14 15:48:37 localhost kernel: dst cache overflow Feb 14 15:48:43 localhost kernel: printk: 27 messages suppressed. Feb 14 15:48:43 localhost kernel: dst cache overflow Feb 14 15:48:47 localhost kernel: printk: 11 messages suppressed. Feb 14 15:48:47 localhost kernel: dst cache overflow Feb 14 15:48:52 localhost kernel: printk: 20 messages suppressed. Feb 14 15:48:52 localhost kernel: dst cache overflow Feb 14 15:48:57 localhost kernel: printk: 19 messages suppressed. Feb 14 15:48:57 localhost kernel: dst cache overflow Feb 14 15:49:02 localhost kernel: printk: 27 messages suppressed. Feb 14 15:49:02 localhost kernel: dst cache overflow Feb 14 15:49:07 localhost kernel: printk: 30 messages suppressed. Feb 14 15:49:07 localhost kernel: dst cache overflow Feb 14 15:49:12 localhost kernel: printk: 32 messages suppressed. Feb 14 15:49:12 localhost kernel: dst cache overflow Feb 14 15:49:17 localhost kernel: printk: 31 messages suppressed. Feb 14 15:49:17 localhost kernel: dst cache overflow Feb 14 15:49:22 localhost kernel: printk: 31 messages suppressed. Feb 14 15:49:22 localhost kernel: dst cache overflow Feb 14 15:49:27 localhost kernel: printk: 26 messages suppressed. Feb 14 15:49:27 localhost kernel: dst cache overflow Feb 14 15:49:32 localhost kernel: printk: 32 messages suppressed. Feb 14 15:49:32 localhost kernel: dst cache overflow Feb 14 15:49:37 localhost kernel: printk: 16 messages suppressed. Feb 14 15:49:37 localhost kernel: dst cache overflow Feb 14 15:49:42 localhost kernel: printk: 30 messages suppressed. Feb 14 15:49:42 localhost kernel: dst cache overflow Feb 14 15:49:47 localhost kernel: printk: 28 messages suppressed. Feb 14 15:49:47 localhost kernel: dst cache overflow Feb 14 15:49:52 localhost kernel: printk: 34 messages suppressed. Feb 14 15:49:52 localhost kernel: dst cache overflow Feb 14 15:49:57 localhost kernel: printk: 25 messages suppressed. Feb 14 15:49:57 localhost kernel: dst cache overflow Feb 14 15:50:02 localhost kernel: printk: 33 messages suppressed. Feb 14 15:50:02 localhost kernel: dst cache overflow Feb 14 15:50:07 localhost kernel: printk: 26 messages suppressed. Feb 14 15:50:07 localhost kernel: dst cache overflow Feb 14 15:50:12 localhost kernel: printk: 36 messages suppressed. Feb 14 15:50:12 localhost kernel: dst cache overflow Feb 14 15:50:17 localhost kernel: printk: 30 messages suppressed. Feb 14 15:50:17 localhost kernel: dst cache overflow Feb 14 15:50:22 localhost kernel: printk: 37 messages suppressed. Feb 14 15:50:22 localhost kernel: dst cache overflow Feb 14 15:50:27 localhost kernel: printk: 30 messages suppressed. Feb 14 15:50:27 localhost kernel: dst cache overflow Feb 14 15:50:32 localhost kernel: printk: 37 messages suppressed. Feb 14 15:50:32 localhost kernel: dst cache overflow Feb 14 15:50:37 localhost kernel: printk: 32 messages suppressed. Feb 14 15:50:37 localhost kernel: dst cache overflow Feb 14 15:50:42 localhost kernel: printk: 38 messages suppressed. Feb 14 15:50:42 localhost kernel: dst cache overflow Feb 14 15:50:47 localhost kernel: printk: 40 messages suppressed. Feb 14 15:50:47 localhost kernel: dst cache overflow Feb 14 15:50:52 localhost kernel: printk: 43 messages suppressed. Feb 14 15:50:52 localhost kernel: dst cache overflow Feb 14 15:50:57 localhost kernel: printk: 38 messages suppressed. Feb 14 15:50:57 localhost kernel: dst cache overflow Feb 14 15:51:02 localhost kernel: printk: 54 messages suppressed. Feb 14 15:51:02 localhost kernel: dst cache overflow Feb 14 15:51:07 localhost kernel: printk: 32 messages suppressed. Feb 14 15:51:07 localhost kernel: dst cache overflow Feb 14 15:51:12 localhost kernel: printk: 46 messages suppressed. Feb 14 15:51:12 localhost kernel: dst cache overflow Feb 14 15:51:17 localhost kernel: printk: 43 messages suppressed. Feb 14 15:51:17 localhost kernel: dst cache overflow Feb 14 15:51:22 localhost kernel: printk: 46 messages suppressed. Feb 14 15:51:22 localhost kernel: dst cache overflow Feb 14 15:51:27 localhost kernel: printk: 45 messages suppressed. Feb 14 15:51:27 localhost kernel: dst cache overflow Feb 14 15:51:32 localhost kernel: printk: 41 messages suppressed. Feb 14 15:51:32 localhost kernel: dst cache overflow Feb 14 15:51:37 localhost kernel: printk: 41 messages suppressed. . . . . Feb 14 16:07:47 localhost kernel: printk: 127 messages suppressed. Feb 14 16:07:47 localhost kernel: dst cache overflow Feb 14 16:07:52 localhost kernel: printk: 120 messages suppressed. Feb 14 16:07:52 localhost kernel: dst cache overflow I've read some posts and seems like 2.6 probably still has bugs deep under the surface that only pop up in certain real world situations. (¿?) Doing some googling showed some indications that NAT has some bugs (¿?) Please any help would be very apreciated. Best regards, Andrés. **NOTA DE CONFIDENCIALIDAD** Este correo electrónico, y en su caso los ficheros adjuntos, pueden contener información protegida para el uso exclusivo de su destinatario. Se prohíbe la distribución, reproducción o cualquier otro tipo de transmisión por parte de otra persona que no sea el destinatario. Si usted recibe por error este correo, se ruega comunicarlo al remitente y borrar el mensaje recibido. **CONFIDENTIALITY NOTICE** This email communication and any attachments may contain confidential and privileged information for the sole use of the designated recipient named above. Distribution, reproduction or any other use of this transmission by any party other than the intended recipient is prohibited. If you are not the intended recipient please contact the sender and delete all copies.