<div dir="ltr"><div>Hi Nigel,</div><div><br></div><div>I will rebuild the kmod package against kernel-425.19.2.el8_7 and see if that resolves the issue.</div><div><br></div><div>Akemi<br></div><div></div><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Apr 14, 2023 at 8:23 AM Nigel Phillips <<a href="mailto:nigel@ntalk.ie">nigel@ntalk.ie</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div style="font-family:arial,helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"><div><div><span style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:16px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;display:inline;float:none">Akemi,</span><div style="clear:both"><br></div><div style="clear:both">Current values, reboot to new kernel, then values again in steps below. And yes, on reboot to newer kernel I still see 9.1.13 for /proc/drbd</div><div style="clear:both"><br></div><div style="clear:both"><div style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:16px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial;background-color:rgb(255,255,255)">$ uname -r</div><div style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:16px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial;background-color:rgb(255,255,255)">4.18.0-425.13.1.el8_7.x86_64</div><div style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:16px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial;background-color:rgb(255,255,255)"><br></div><div style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:16px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial;background-color:rgb(255,255,255)"><div>$ drbdadm status</div><div>r0 role:Secondary</div><div> disk:UpToDate</div><div> vmstorage1-telecity role:Primary</div><div> peer-disk:UpToDate<br><br></div></div></div><div style="clear:both"><div style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:16px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">$ find /lib/modules -name drbd.ko</div><div style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:16px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">/lib/modules/4.18.0-425.13.1.el8_7.x86_64/weak-updates/drbd90/drbd.ko</div><div style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:16px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">/lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko</div><div style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:16px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">/lib/modules/4.18.0-425.19.2.el8_7.x86_64/weak-updates/drbd90/drbd.ko</div></div></div><div><br></div><div>$ grubby --set-default "/boot/vmlinuz-4.18.0-425.19.2.el8_7.x86_64"<br></div><div><br></div><div></div><div><span style="font-size:12pt">$shutdown -r now</span><br></div></div><div><br><div>$uname -r</div><div>4.18.0-425.19.2.el8_7.x86_64</div><div><br></div><div>$drbdadm status</div><div>r0 role:Secondary</div><div> disk:Diskless</div></div><div><br></div><div><div>$ find /lib/modules -name drbd.ko</div><div>/lib/modules/4.18.0-425.13.1.el8_7.x86_64/weak-updates/drbd90/drbd.ko</div><div>/lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko</div><div>/lib/modules/4.18.0-425.19.2.el8_7.x86_64/weak-updates/drbd90/drbd.ko</div><div><br></div><div><div>$ cat /proc/drbd</div><div>version: 9.1.13 (api:2/proto:86-121)</div><div>GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by mockbuild@, 2023-01-30 18:33:50</div><div>Transports (api:18):</div></div></div><div><br></div><div>Also some symbol errors from dmesg with newer kernel</div><div><br></div><div><div>[Fri Apr 14 16:14:18 2023] drbd r0: Starting worker thread (from drbdsetup [2088])</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_find_path_by_addr</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_find_path_by_addr (err -22)</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_get_listener</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_get_listener (err -22)</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_stream_send_timed_out</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_stream_send_timed_out (err -22)</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_register_transport_class</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_register_transport_class (err -22)</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_should_abort_listening</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_should_abort_listening (err -22)</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_put_listener</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_put_listener (err -22)</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_path_event</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_path_event (err -22)</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_free_pages</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_free_pages (err -22)</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_unregister_transport_class</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_unregister_transport_class (err -22)</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_alloc_pages</div><div>[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_alloc_pages (err -22)</div></div><div><br><br><br></div><div>Nigel</div><div><br></div><div><br></div><div><div><span style="font-family:"tahoma","new york","times",serif"><b><span style="color:rgb(153,51,0)"><br><br></span></b></span></div><div><span style="font-family:"tahoma","new york","times",serif"><b><span style="color:rgb(153,51,0)">Nigel Phillips</span> </b> | IT Consultant</span></div><div><span style="font-family:"tahoma","new york","times",serif"><br></span></div><div><span style="font-family:"tahoma","new york","times",serif">Tel: (+353) 86 6057580</span></div><div><span style="font-family:"tahoma","new york","times",serif">Skype: live:nigel_2260</span></div><div><hr><span style="font-size:11pt;color:rgb(153,153,153);font-family:"tahoma","new york","times",serif"><a href="http://www.ntalk.ie" target="_blank">www.ntalk.ie</a> | <a href="mailto:nigel@ntalk.ie" target="_blank">nigel@ntalk.ie</a> </span></div></div><div><br></div><hr id="m_-323227733798963260zwchr"><div><b>From: </b>"Akemi Yagi" <<a href="mailto:toracat@elrepo.org" target="_blank">toracat@elrepo.org</a>><br><b>To: </b>"Nigel Phillips" <<a href="mailto:nigel@ntalk.ie" target="_blank">nigel@ntalk.ie</a>><br><b>Cc: </b>"drbd-user" <<a href="mailto:drbd-user@lists.linbit.com" target="_blank">drbd-user@lists.linbit.com</a>><br><b>Sent: </b>Friday, 14 April, 2023 16:05:30<br><b>Subject: </b>Re: [DRBD-user] 9.1.14 upgrade issue<br></div><div><br></div><div><div dir="ltr"><div>Hi Nigel,</div><br><div>Can you show the output from:</div><br><div>$ find /lib/modules -name drbd.ko</div><br><div>Also, if you boot kernel 4.18.0-425.19.2.el8_7 once again, what happens? Do you still see version: 9.1.13?</div><br><div>Akemi<br></div><div dir="ltr"><br></div><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Apr 14, 2023 at 4:53 AM Nigel Phillips <<a href="mailto:nigel@ntalk.ie" rel="nofollow noopener noreferrer" target="_blank">nigel@ntalk.ie</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>Akemi,<br><br>Sorry syntax in email, did a copy and paste of the new update package name from the release email rather than from installed system package names. Actual system installed files are correct though, so the original problem does unfortunately still exist.<br><br>$dnf list --installed | grep drbd<br>drbd90-utils.x86_64 9.23.1-1.el8.elrepo @elrepo<br>kmod-drbd90.x86_64 9.1.14-1.el8_7.elrepo @elrepo<br><br>Best Regards,<br>Nigel<br><br><br><br><div class="gmail_quote">On 14 April 2023 10:28:42 IST, Akemi Yagi <<a href="mailto:toracat@elrepo.org" rel="nofollow noopener noreferrer" target="_blank">toracat@elrepo.org</a>> wrote:<blockquote class="gmail_quote" style="margin:0pt 0pt 0pt 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr"><div dir="ltr">On Fri, Apr 14, 2023 at 2:18 AM Nigel Phillips <<a href="mailto:nigel@ntalk.ie" rel="nofollow noopener noreferrer" target="_blank">nigel@ntalk.ie</a>> wrote:<br></div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div style="font-family:"arial","helvetica",sans-serif;font-size:12pt;color:rgb(0,0,0)"><div>Morning,</div><br><div>AlmaLinux 8.7, kernel 4.18.0-425.19.2.el8_7.x86_64<br></div><br><div>Just installed kmod-drbd9x-9.1.14-1.el9_1.elrepo.x86_64.rpm on my secondary and after a reboot was greeted with a </div><br><div>drbdadm status<br></div><div><div>r0 role:Secondary</div><div> disk:Diskless</div><br><div>Looking at /proc/drbd I noticed it still had the previous version listed</div><br><div><div>cat /proc/drbd</div><div> version: 9.1.13 (api:2/proto:86-121)</div><div> GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by mockbuild@, 2023-01-30 18:33:50</div><div> Transports (api:18):</div></div></div><br><div>Rebooting again into an earlier kernel, 4.18.0-425.13.1.el8_7.x86_64 and now back and working with /proc/drbd showing the correct version.</div><br><div><div>cat /proc/drbd </div><div>version: 9.1.14 (api:2/proto:86-121)</div><div>GIT-hash: df55dfb7a93484b7d7eb0c4deac62d887cfcbf67 build by mockbuild@, 2023-04-08 19:54:28</div><div>Transports (api:18): tcp (9.1.14)</div></div><br><div>Did I miss a step on the upgrade, should I have brought drbd down first (it was set to secondary) or intitally booted into an earlier kernel first before the upgrade?</div><br><div>Best Regards,</div><div>Nigel</div></div></div></blockquote><div> </div><div>You installed the kmod package built for el9 on your el8 system. Please try installing kmod-drbd90 for el8.</div><br><div>Akemi<br></div></div></div>
</blockquote></div><div>-- <br>Sent from my Android device with K-9 Mail. Please excuse my brevity.</div></div></blockquote></div></div><br></div></div></div></blockquote></div></div>