Note: "permalinks" may not be as permanent as we would like,
direct links of old sources may well be a few messages off.
Hi Felix, > this reminds me of something I've seen during a drbdadm adjust. > The adjusting Primary would re-initialize its DRBD and then (apparently) > sync back its hot AL extents from the peer. Seeing as the peer was > Inconsistent in your case (it was still syncing), this can't work, and > the Primary may go StandAlone as a result. What? Do you say the primary updates its data from the secondary during an "adjust" command? > Please try and verify this scenario using the kernel logs of your Primary. Well, I'm not sure about the logfile entries- if appended the first entry where it went bananas below. > > It's a good question why DRBD would commit to such destructive action > without issuing a warning. What version are you using? I'm inclined to > call bug on this one. drbd82-8.2.6-1.el5.centos Greetings Christian Jul 24 21:31:38 backuppc kernel: drbd0: Handshake successful: Agreed network protocol version 88 Jul 24 21:31:38 backuppc kernel: drbd0: Peer authenticated using 20 bytes of 'sha1' HMAC Jul 24 21:31:38 backuppc kernel: drbd0: conn( WFConnection -> WFReportParams ) Jul 24 21:31:38 backuppc kernel: drbd0: Starting asender thread (from drbd0_receiver [3302]) Jul 24 21:31:38 backuppc kernel: drbd0: data-integrity-alg: <not-used> Jul 24 21:31:39 backuppc kernel: drbd0: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( DUnknown -> UpTo Date ) Jul 24 21:31:39 backuppc kernel: drbd0: Writing meta data super block now. Jul 24 21:31:41 backuppc kernel: drbd0: conn( WFBitMapS -> SyncSource ) pdsk( UpToDate -> Inconsistent ) Jul 24 21:31:41 backuppc kernel: drbd0: Began resync as SyncSource (will sync 0 KB [0 bits set]). Jul 24 21:31:41 backuppc kernel: drbd0: Resync done (total 1 sec; paused 0 sec; 0 K/sec) Jul 24 21:31:41 backuppc kernel: drbd0: conn( SyncSource -> Connected ) pdsk( Inconsistent -> UpToDate ) Jul 24 21:31:41 backuppc kernel: drbd0: Writing meta data super block now. Jul 24 21:41:58 backuppc kernel: drbd0: disk( UpToDate -> Diskless ) Jul 24 21:41:58 backuppc kernel: drbd0: disk( Diskless -> Attaching ) Jul 24 21:41:58 backuppc kernel: drbd0: Found 4 transactions (192 active extents) in activity log. Jul 24 21:41:58 backuppc kernel: drbd0: max_segment_size ( = BIO size ) = 32768 Jul 24 21:41:58 backuppc kernel: drbd0: reading of bitmap took 186 jiffies Jul 24 21:41:58 backuppc kernel: drbd0: recounting of set bits took additional 121 jiffies Jul 24 21:41:58 backuppc kernel: drbd0: 0 KB (0 bits) marked out-of-sync by on disk bit-map. Jul 24 21:41:58 backuppc kernel: drbd0: Marked additional 508 MB as out-of-sync based on AL. Jul 24 21:41:58 backuppc kernel: drbd0: disk( Attaching -> Negotiating ) Jul 24 21:41:58 backuppc kernel: drbd0: Writing meta data super block now. Jul 24 21:42:07 backuppc kernel: drbd0: State change failed: Refusing to be Primary without at least one UpToDate disk Jul 24 21:42:07 backuppc kernel: drbd0: state = { cs:Connected st:Primary/Secondary ds:Negotiating/UpToDate r--- } Jul 24 21:42:07 backuppc kernel: drbd0: wanted = { cs:Connected st:Primary/Secondary ds:Negotiating/Diskless r--- } Jul 24 21:42:09 backuppc kernel: drbd0: Writing the whole bitmap, full sync required after drbd_sync_handshake. Jul 24 21:42:09 backuppc kernel: drbd0: Writing meta data super block now. Jul 24 21:42:09 backuppc kernel: drbd0: writing of bitmap took 101 jiffies Jul 24 21:42:09 backuppc kernel: drbd0: 1204 GB (315595351 bits) marked out-of-sync by on disk bit-map. Jul 24 21:42:09 backuppc kernel: drbd0: Writing meta data super block now. Jul 24 21:42:09 backuppc kernel: drbd0: conn( Connected -> WFBitMapT ) Jul 24 21:42:10 backuppc kernel: drbd0: conn( WFBitMapT -> WFSyncUUID ) Jul 24 21:42:10 backuppc kernel: drbd0: helper command: /sbin/drbdadm before-resync-target Jul 24 21:42:10 backuppc kernel: drbd0: conn( WFSyncUUID -> SyncTarget ) disk( Negotiating -> Inconsistent ) Jul 24 21:42:10 backuppc kernel: drbd0: Began resync as SyncTarget (will sync 1262381404 KB [315595351 bits set]). Jul 24 21:42:10 backuppc kernel: drbd0: Writing meta data super block now. Jul 24 21:48:24 backuppc kernel: drbd0: State change failed: Refusing to be Primary without at least one UpToDate disk Jul 24 21:48:24 backuppc kernel: drbd0: state = { cs:SyncTarget st:Primary/Secondary ds:Inconsistent/UpToDate r--- } Jul 24 21:48:24 backuppc kernel: drbd0: wanted = { cs:TearDown st:Primary/Unknown ds:Inconsistent/DUnknown r--- } Jul 24 21:48:24 backuppc kernel: drbd0: State change failed: Refusing to be Primary without at least one UpToDate disk Jul 24 21:48:24 backuppc kernel: drbd0: state = { cs:SyncTarget st:Primary/Secondary ds:Inconsistent/UpToDate r--- } Jul 24 21:48:24 backuppc kernel: drbd0: wanted = { cs:TearDown st:Primary/Unknown ds:Inconsistent/Outdated r--- }