<div dir="ltr"><div>Hi,</div><div><br></div><div>After resync, disk status is "Outdated" sometimes.</div><div><br></div><div>1. drbd.conf</div><div><br></div><div> - we configure 5 nodes but use only 3 nodes on test.</div><div><br></div><div>[root@drbd9-01 ~]# drbdadm dump r0</div><div># resource r0 on drbd9-01: not ignored, not stacked</div><div># defined at /etc/drbd.d/r0.res:1</div><div>resource r0 {</div><div> device /dev/drbd1 minor 1;</div><div> meta-disk internal;</div><div> on drbd9-01 {</div><div> node-id 0;</div><div> address ipv4 <a href="http://100.100.10.11:7000" target="_blank">100.100.10.11:7000</a>;</div><div> }</div><div> on drbd9-02 {</div><div> node-id 1;</div><div> address ipv4 <a href="http://100.100.10.21:7000" target="_blank">100.100.10.21:7000</a>;</div><div> }</div><div> on drbd9-03 {</div><div> node-id 2;</div><div> address ipv4 <a href="http://100.100.10.31:7000" target="_blank">100.100.10.31:7000</a>;</div><div> }</div><div> on drbd9-04 {</div><div> node-id 3;</div><div> address ipv4 <a href="http://100.100.10.41:7000" target="_blank">100.100.10.41:7000</a>;</div><div> }</div><div> on drbd9-05 {</div><div> node-id 4;</div><div> address ipv4 <a href="http://100.100.10.51:7000" target="_blank">100.100.10.51:7000</a>;</div><div> }</div><div> connection-mesh {</div><div> hosts drbd9-01 drbd9-02 drbd9-03 drbd9-04 drbd9-05;</div><div> }</div><div>}</div><div><br></div><div><br></div><div><br></div><div>2. Version</div><div><br></div><div><div>[root@drbd9-01 ~]# cat /proc/drbd</div><div>version: 9.0.1-1 (api:2/proto:86-111)</div><div>GIT-hash: f57acfc22d29a95697e683fb6bbacd9a1ad4348e build by root@drbd9-01, 2016-02-16 17:26:06</div></div><div><br></div><div><br></div><div><br></div><div>3. Test</div><div><div> - 1) drbd up on 3 nodes</div><div> - 2) fullsync</div><div><br></div><div><br></div><div><br></div><div>4. Status/Logs</div><div><br></div><div> 1) Node1</div><div><br></div><div>[root@drbd9-01 ~]# drbdadm primary --force r0</div><div>[root@drbd9-01 ~]# drbdadm status r0</div><div>r0 role:Primary</div><div> disk:UpToDate</div><div> drbd9-02 role:Secondary</div><div> replication:SyncSource peer-disk:Inconsistent done:0.02</div><div> drbd9-03 role:Secondary</div><div> replication:SyncSource peer-disk:Inconsistent done:0.02</div><div> drbd9-04 connection:Connecting</div><div> drbd9-05 connection:Connecting</div><div><br></div></div><div><br></div><div><div> 11109 Feb 17 16:09:56 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: Resync done (total 122 sec; paused 0 sec; 40968 K/sec)</div><div> 11110 Feb 17 16:09:56 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( Inconsistent -> UpToDate ) repl( SyncSource -> Established )</div><div> 11111 Feb 17 16:09:57 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: Resync done (total 123 sec; paused 0 sec; 40636 K/sec)</div><div> 11112 Feb 17 16:09:57 drbd9-01 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( Inconsistent -> UpToDate ) repl( SyncSource -> Established )</div><div> 11113 Feb 17 16:10:00 drbd9-01 dbus-daemon: dbus[928]: [system] Activating service name='org.freedesktop.PackageKit' (using servicehelper )</div></div><div><br></div><div><br></div><div> 2) Node2</div><div><br></div><div><div>[root@drbd9-02 ~]# drbdadm status r0<br>r0 role:Secondary<br> disk:UpToDate<br> drbd9-01 role:Primary<br> peer-disk:UpToDate<br> drbd9-03 role:Secondary<br> peer-disk:UpToDate<br> drbd9-04 connection:Connecting<br> drbd9-05 connection:Connecting<br><br clear="all"><br>Feb 17 16:09:56 drbd9-02 kernel: drbd r0/0 drbd1 drbd9-01: updated UUIDs B6CAADFB7D215BC6:0000000000000000:0000000000000000:0000000000000000<br>Feb 17 16:09:56 drbd9-02 kernel: drbd r0/0 drbd1: disk( Inconsistent -> UpToDate )<br>Feb 17 16:09:56 drbd9-02 kernel: drbd r0/0 drbd1 drbd9-05: pdsk( DUnknown -> Outdated ) resync-susp( connection dependency -> no )<br>Feb 17 16:09:56 drbd9-02 kernel: drbd r0/0 drbd1 drbd9-04: pdsk( DUnknown -> Outdated ) resync-susp( connection dependency -> no )<br>Feb 17 16:09:56 drbd9-02 kernel: drbd r0/0 drbd1 drbd9-01: repl( SyncTarget -> Established )<br>Feb 17 16:09:56 drbd9-02 kernel: drbd r0/0 drbd1 drbd9-01: helper command: /sbin/drbdadm after-resync-target<br>Feb 17 16:09:56 drbd9-02 drbdadm[4714]: Don't know which config file belongs to resource r0, trying default ones...<br>Feb 17 16:09:56 drbd9-02 kernel: drbd r0/0 drbd1 drbd9-01: helper command: /sbin/drbdadm after-resync-target exit code 0 (0x0)<br>Feb 17 16:09:57 drbd9-02 kernel: drbd r0/0 drbd1 drbd9-03: updated UUIDs B6CAADFB7D215BC6:0000000000000000:0000000000000000:0000000000000000<br>Feb 17 16:09:57 drbd9-02 kernel: drbd r0/0 drbd1 drbd9-03: pdsk( Inconsistent -> UpToDate ) resync-susp( peer -> no )<br><br></div></div><div><br></div><div> 3) Node3</div><div><br></div><div><div>[root@drbd9-03 etc]# drbdadm status r0</div><div>r0 role:Secondary</div><div> disk:UpToDate</div><div> drbd9-01 role:Primary</div><div> peer-disk:UpToDate</div><div> drbd9-02 role:Secondary</div><div> peer-disk:Outdated <----------------------------------------- Why??????????</div><div> drbd9-04 connection:Connecting</div><div> drbd9-05 connection:Connecting</div></div><div><br></div><div><br></div><div><div><div>Feb 17 16:09:56 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( Inconsistent -> UpToDate )</div><div>Feb 17 16:09:57 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: Resync done (total 123 sec; paused 0 sec; 40636 K/sec)</div><div>Feb 17 16:09:57 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: updated UUIDs B6CAADFB7D215BC6:0000000000000000:0000000000000000:0000000000000000</div><div>Feb 17 16:09:57 drbd9-03 kernel: drbd r0/0 drbd1: disk( Inconsistent -> UpToDate )</div><div>Feb 17 16:09:57 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-05: pdsk( DUnknown -> Outdated ) resync-susp( connection dependency -> no )</div><div>Feb 17 16:09:57 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-04: pdsk( DUnknown -> Outdated ) resync-susp( connection dependency -> no )</div><div>Feb 17 16:09:57 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-02: pdsk( UpToDate -> Outdated ) resync-susp( connection dependency -> no )</div><div>Feb 17 16:09:57 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: repl( SyncTarget -> Established )</div><div>Feb 17 16:09:57 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: helper command: /sbin/drbdadm after-resync-target</div><div>Feb 17 16:09:57 drbd9-03 kernel: drbd r0/0 drbd1 drbd9-01: helper command: /sbin/drbdadm after-resync-target exit code 0 (0x0)</div></div></div><div><br></div><div><br></div><div><br></div><div>5. Question</div><div> - If we do disconnect and connect again on the Node3, the status becomes UpToDate.<br></div><div><br></div><div><div>[root@drbd9-03 drbd-utils-8.9.6]# drbdadm status r0</div><div>r0 role:Secondary</div><div> disk:UpToDate</div><div> drbd9-01 role:Primary</div><div> peer-disk:UpToDate</div><div> drbd9-02 role:Secondary</div><div> peer-disk:UpToDate <--------------------------- Changed to Normal!!!!</div><div> drbd9-04 connection:Connecting</div><div> drbd9-05 connection:Connecting</div></div><div><br></div><div> - Why did the node3 become Outdated after resync despite of normal?</div><div><br></div><div><br></div><div>Thanks.</div><div><br></div><div><br></div><div><br></div>
</div>