[DRBD-user] State switches, flaky connection?

Jarno Elonen jarno.elonen at housemarque.fi
Fri Aug 17 13:55:58 CEST 2012

Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.


Hi,

Thanks for the answer.

 > I suspect you do not really use the drbd kernel module version
 > version you think you do. Double check that it is in fact 8.3.13,
 > actually for that debian kernel, it should be some commits further even.

Yes, you're right, /proc/drbd says...

version: 8.3.11 (api:88/proto:86-96)
srcversion: 2D876214BAAD53B31ADC1D6

...while drbdadm says: version: 8.3.13 (api:88)

Do they have to match exactly? If so, any suggestions on what to do when 
the OS distribution provides mismatching versions?

 > This would indicate either data corruption in memory or on the wire,
 > or more likely a certain stacking of devices on top of DRBD

Our device stack is:

SATA -> MDRAID6 -> LVM2 -> DRBD (-> EXT4 -> XEN)


 >> kernel: [ 9832.457733] block drbd6: data-integrity-alg: <not-used>
 >
 > Or you could enable data-integrity checking...

Is it just for better debug output, or should we expect corrupted data 
with the kernel/userspace version discrepancy? I need to get this 
working so should I get new sources from linbit and compile the modules 
and tools myself? If so, is 8.4 or 8.3 recommended?


 > cat /proc/drbd please.

version: 8.3.11 (api:88/proto:86-96)
srcversion: 2D876214BAAD53B31ADC1D6

  1: cs:Connected ro:Secondary/Primary ds:UpToDate/UpToDate C r-----
     ns:0 nr:628 dw:21488 dr:13529604 al:0 bm:759 lo:0 pe:0 ua:0 ap:0 
ep:1 wo:f oos:0
  2: cs:Connected ro:Secondary/Primary ds:UpToDate/UpToDate C r-----
     ns:0 nr:400 dw:12828 dr:138016 al:0 bm:114 lo:0 pe:0 ua:0 ap:0 ep:1 
wo:f oos:0
  3: cs:SyncTarget ro:Secondary/Primary ds:Inconsistent/UpToDate C r-----
     ns:0 nr:2752 dw:127228 dr:250824416 al:0 bm:13011 lo:294 pe:14584 
ua:0 ap:0 ep:1 wo:f oos:1343759896
         [>....................] sync'ed:  0.3% 
(1312264/1315400)Mfinish: 17:42:08 speed: 21,076 (9,884) want: 102,400 K/sec
  4: cs:Connected ro:Secondary/Primary ds:UpToDate/UpToDate C r-----
     ns:0 nr:480 dw:11580 dr:158456 al:0 bm:92 lo:0 pe:0 ua:0 ap:0 ep:1 
wo:f oos:0
  5: cs:SyncTarget ro:Secondary/Primary ds:Inconsistent/UpToDate C r-----
     ns:0 nr:8900 dw:8900 dr:6636656 al:0 bm:273 lo:0 pe:13999 ua:0 ap:0 
ep:1 wo:f oos:1464230684
         [>....................] sync'ed:  0.1% 
(1429912/1430868)Mfinish: 16:39:22 speed: 24,416 (24,484) want: 102,400 
K/sec
  6: cs:WFConnection ro:Secondary/Unknown ds:Inconsistent/DUnknown C r-----
     ns:0 nr:2604 dw:304216 dr:68801560 al:0 bm:3907 lo:0 pe:0 ua:0 ap:0 
ep:1 wo:f oos:8614504
  7: cs:StandAlone ro:Secondary/Unknown ds:Inconsistent/DUnknown   r-----
     ns:0 nr:26056 dw:26056 dr:583804 al:0 bm:80 lo:0 pe:0 ua:0 ap:0 
ep:1 wo:f oos:887728
  8: cs:StandAlone ro:Secondary/Unknown ds:Outdated/DUnknown   r-----
     ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:164
  9: cs:SyncTarget ro:Secondary/Primary ds:Inconsistent/UpToDate C r-----
     ns:0 nr:168040 dw:292308 dr:28117060 al:0 bm:1296 lo:306 pe:171 
ua:0 ap:0 ep:1 wo:f oos:28803884
         [===>................] sync'ed: 22.9% (28128/36468)Mfinish: 
0:26:52 speed: 17,864 (26,040) want: 102,400 K/sec
10: cs:Connected ro:Secondary/Primary ds:UpToDate/UpToDate C r-----
     ns:0 nr:724 dw:21828 dr:259372 al:0 bm:440 lo:0 pe:0 ua:0 ap:0 ep:1 
wo:f oos:0
11: cs:StandAlone ro:Secondary/Unknown ds:Inconsistent/DUnknown   r-----
     ns:0 nr:7580 dw:7580 dr:424132 al:0 bm:13 lo:0 pe:0 ua:0 ap:0 ep:1 
wo:f oos:341960
12: cs:Connected ro:Secondary/Primary ds:UpToDate/UpToDate A r-----
     ns:0 nr:0 dw:0 dr:393244 al:0 bm:62 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0
13: cs:SyncTarget ro:Secondary/Primary ds:Inconsistent/UpToDate C r-----
     ns:0 nr:880 dw:3640 dr:22507172 al:0 bm:1142 lo:1 pe:299 ua:0 ap:0 
ep:1 wo:f oos:11174680
         [=======>............] sync'ed: 43.8% (10912/19384)Mfinish: 
0:05:09 speed: 36,140 (26,528) want: 102,400 K/sec
14: cs:Connected ro:Secondary/Primary ds:UpToDate/UpToDate C r-----
     ns:0 nr:8780 dw:8780 dr:78056 al:0 bm:15 lo:0 pe:0 ua:0 ap:0 ep:1 
wo:f oos:0

- Jarno




More information about the drbd-user mailing list