Ok, <br>it seemed to me that the simpler, more advisable and more useful thing for testing drbd too was to update drbd to 8.3.3rc2, keeping the same the drbd conf and the 2.6.30 kernel (just recently updated to 2.6.30 stream in f11 as I wrote before...)<br>
And that WAS the right approach (at least at this time).<br><br>After starting the Primary/UpToDate node, it was in this state<br>...<br>Starting DRBD resources: [ d(r0) s(r0) n(r0) ]...<br>[root@virtfed x86_64]# service drbd status<br>
drbd driver loaded OK; device status:<br>version: 8.3.3rc2 (api:88/proto:86-91)<br>GIT-hash: 04b2f175d7076ef2e0dd7d5ba6f6843357a041ed build by root@virtfedbis, 2009-09-11 10:06:20<br>m:res cs ro ds p mounted fstype<br>
0:r0 WFConnection Primary/Unknown UpToDate/Outdated C<br><br>Doing a "service drbd start" on the peer, I get this on the other one<br>Sep 11 10:44:03 virtfed kernel: block drbd0: Handshake successful: Agreed network protocol version 91<br>
Sep 11 10:44:03 virtfed kernel: block drbd0: Peer authenticated using 20 bytes of 'sha1' HMAC<br>Sep 11 10:44:03 virtfed kernel: block drbd0: conn( WFConnection -> WFReportParams ) <br>Sep 11 10:44:03 virtfed kernel: block drbd0: Starting asender thread (from drbd0_receiver [11115])<br>
Sep 11 10:44:03 virtfed kernel: block drbd0: data-integrity-alg: <not-used><br>Sep 11 10:44:03 virtfed kernel: block drbd0: drbd_sync_handshake:<br>Sep 11 10:44:03 virtfed kernel: block drbd0: self A0332E51B243BEE1:7C12A37C6FB9B1CB:DB97F5F6C5FBB26C:FAFACA8496A4ED9D bits:79098 flags:0<br>
Sep 11 10:44:03 virtfed kernel: block drbd0: peer 7C12A37C6FB9B1CA:0000000000000000:0DB564243F5AA9A3:377245292BBD1112 bits:235520 flags:2<br>Sep 11 10:44:03 virtfed kernel: block drbd0: uuid_compare()=1 by rule 70<br>Sep 11 10:44:03 virtfed kernel: block drbd0: Becoming sync source due to disk states.<br>
Sep 11 10:44:03 virtfed kernel: block drbd0: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( Outdated -> Inconsistent ) <br>Sep 11 10:44:03 virtfed kernel: block drbd0: peer( Secondary -> Primary ) <br>
Sep 11 10:44:03 virtfed kernel: block drbd0: conn( WFBitMapS -> SyncSource ) <br>Sep 11 10:44:03 virtfed kernel: block drbd0: Began resync as SyncSource (will sync 1258472 KB [314618 bits set]).<br>Sep 11 10:44:23 virtfed kernel: block drbd0: Resync done (total 19 sec; paused 0 sec; 66232 K/sec)<br>
Sep 11 10:44:23 virtfed kernel: block drbd0: conn( SyncSource -> Connected ) pdsk( Inconsistent -> UpToDate ) <br><br>No messages on peer node because I started it in single user mode and manually started the network and sshd daemon... and then drbd, so the messages file was not populated, but dmesg gives same information I think:<br>
<br>drbd: initialized. Version: 8.3.3rc2 (api:88/proto:86-91)<br>drbd: GIT-hash: 04b2f175d7076ef2e0dd7d5ba6f6843357a041ed build by root@virtfedbis, 2009-09-11 10:06:20<br>drbd: registered as block device major 147<br>drbd: minor_table @ 0xffff880826f09b00<br>
block drbd0: Starting worker thread (from cqueue [1833])<br>block drbd0: disk( Diskless -> Attaching ) <br>block drbd0: Found 6 transactions (244 active extents) in activity log.<br>block drbd0: Method to ensure write ordering: barrier<br>
block drbd0: max_segment_size ( = BIO size ) = 32768<br>block drbd0: drbd_bm_resize called with capacity == 109317376<br>block drbd0: resync bitmap: bits=13664672 words=213511<br>block drbd0: size = 52 GB (54658688 KB)<br>
block drbd0: recounting of set bits took additional 1 jiffies<br>block drbd0: 920 MB (235520 bits) marked out-of-sync by on disk bit-map.<br>block drbd0: Marked additional 0 KB as out-of-sync based on AL.<br>end_request: I/O error, dev cciss/c0d0, sector 0<br>
block drbd0: meta data flush failed with status -95, disabling md-flushes<br>block drbd0: disk( Attaching -> Inconsistent ) <br>block drbd0: conn( StandAlone -> Unconnected ) <br>block drbd0: Starting receiver thread (from drbd0_worker [1835])<br>
block drbd0: receiver (re)started<br>block drbd0: conn( Unconnected -> WFConnection ) <br>block drbd0: Handshake successful: Agreed network protocol version 91<br>block drbd0: Peer authenticated using 20 bytes of 'sha1' HMAC<br>
block drbd0: conn( WFConnection -> WFReportParams ) <br>block drbd0: Starting asender thread (from drbd0_receiver [1861])<br>block drbd0: data-integrity-alg: <not-used><br>block drbd0: drbd_sync_handshake:<br>block drbd0: self 7C12A37C6FB9B1CA:0000000000000000:0DB564243F5AA9A3:377245292BBD1112 bits:235520 flags:0<br>
block drbd0: peer A0332E51B243BEE1:7C12A37C6FB9B1CB:DB97F5F6C5FBB26C:FAFACA8496A4ED9D bits:79098 flags:0<br>block drbd0: uuid_compare()=-1 by rule 50<br>block drbd0: Becoming sync target due to disk states.<br>block drbd0: peer( Unknown -> Primary ) conn( WFReportParams -> WFBitMapT ) pdsk( DUnknown -> UpToDate ) <br>
block drbd0: role( Secondary -> Primary ) <br>block drbd0: conn( WFBitMapT -> WFSyncUUID ) <br>block drbd0: helper command: /sbin/drbdadm before-resync-target minor-0<br>block drbd0: helper command: /sbin/drbdadm before-resync-target minor-0 exit code 0 (0x0)<br>
block drbd0: conn( WFSyncUUID -> SyncTarget ) <br>block drbd0: Began resync as SyncTarget (will sync 1258472 KB [314618 bits set]).<br>block drbd0: Resync done (total 19 sec; paused 0 sec; 66232 K/sec)<br>block drbd0: conn( SyncTarget -> Connected ) disk( Inconsistent -> UpToDate ) <br>
block drbd0: helper command: /sbin/drbdadm after-resync-target minor-0<br>block drbd0: helper command: /sbin/drbdadm after-resync-target minor-0 exit code 0 (0x0)<br><br>Now the situation is correctly at:<br><br> [root@virtfedbis ~]# service drbd status<br>
drbd driver loaded OK; device status:<br>version: 8.3.3rc2 (api:88/proto:86-91)<br>GIT-hash: 04b2f175d7076ef2e0dd7d5ba6f6843357a041ed build by root@virtfedbis, 2009-09-11 10:06:20<br>m:res cs ro ds p mounted fstype<br>
0:r0 Connected Primary/Primary UpToDate/UpToDate C<br><br>During the sync phase (some seconds):<br>[root@virtfedbis ~]# cat /proc/drbd <br>version: 8.3.3rc2 (api:88/proto:86-91)<br>GIT-hash: 04b2f175d7076ef2e0dd7d5ba6f6843357a041ed build by root@virtfedbis, 2009-09-11 10:06:20<br>
0: cs:SyncTarget ro:Primary/Primary ds:Inconsistent/UpToDate C r----<br> ns:0 nr:1186920 dw:1186824 dr:56 al:0 bm:383 lo:4 pe:2236 ua:3 ap:0 ep:1 wo:b oos:71648<br> [=================>..] sync'ed: 94.5% (71648/1258472)K<br>
finish: 0:00:01 speed: 64,736 (65,932) K/sec<br><br>Notice that I rebooted both the nodes so the network interfaces, during the start of the peer and the sync was in original state:<br><br> [root@virtfedbis ~]# ethtool -k eth3<br>
Offload parameters for eth3:<br>Cannot get device flags: Operation not supported<br>rx-checksumming: on<br>tx-checksumming: on<br>scatter-gather: on<br>tcp-segmentation-offload: on<br>udp-fragmentation-offload: off<br>generic-segmentation-offload: on<br>
generic-receive-offload: off<br>large-receive-offload: off<br><br>Thanks for the answers and support!<br>Gianluca<br><br>