[DRBD-user] 9.1.14 upgrade issue

Fri Apr 14 19:51:38 CEST 2023

Akemi, 

Version kmod-drbd90-9.1.14-2.el8_7.x86_64 is in and installed and has sorted the issue, thank you. 

$ uname -r 
4.18.0-425.19.2.el8_7.x86_64 

$ cat /proc/drbd 
version: 9.1.14 (api:2/proto:86-121) 
GIT-hash: df55dfb7a93484b7d7eb0c4deac62d887cfcbf67 build by mockbuild@, 2023-04-14 11:47:35 
Transports (api:18): tcp (9.1.14) 

$ drbdadm status 
r0 role:Secondary 
disk:UpToDate 
vmstorage1-telecity role:Primary 
peer-disk:UpToDate 

Regards, 
Nigel 

Nigel Phillips | IT Consultant 

Tel: (+353) 86 6057580 
Skype: live:nigel_2260 

www.ntalk.ie | nigel at ntalk.ie 

From: "Akemi Yagi" <toracat at elrepo.org> 
To: "Nigel Phillips" <nigel at ntalk.ie> 
Cc: "drbd-user" <drbd-user at lists.linbit.com> 
Sent: Friday, 14 April, 2023 16:54:39 
Subject: Re: [DRBD-user] 9.1.14 upgrade issue 

Hi Nigel, 

kmod-drbd90-9.1.14-2.el8_7.x86_64.rpm will start syncing to our mirrors shortly. 

Akemi 

On Fri, Apr 14, 2023 at 8:31 AM Akemi Yagi < [ mailto:toracat at elrepo.org | toracat at elrepo.org ] > wrote: 

Hi Nigel, 

I will rebuild the kmod package against kernel-425.19.2.el8_7 and see if that resolves the issue. 

Akemi 
On Fri, Apr 14, 2023 at 8:23 AM Nigel Phillips < [ mailto:nigel at ntalk.ie | nigel at ntalk.ie ] > wrote: 

BQ_BEGIN

Akemi, 
Current values, reboot to new kernel, then values again in steps below. And yes, on reboot to newer kernel I still see 9.1.13 for /proc/drbd 

$ uname -r 
4.18.0-425.13.1.el8_7.x86_64 

$ drbdadm status 
r0 role:Secondary 
disk:UpToDate 
vmstorage1-telecity role:Primary 
peer-disk:UpToDate 

$ find /lib/modules -name drbd.ko 
/lib/modules/4.18.0-425.13.1.el8_7.x86_64/weak-updates/drbd90/drbd.ko 
/lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko 
/lib/modules/4.18.0-425.19.2.el8_7.x86_64/weak-updates/drbd90/drbd.ko 

$ grubby --set-default "/boot/vmlinuz-4.18.0-425.19.2.el8_7.x86_64" 

$shutdown -r now 

$uname -r 
4.18.0-425.19.2.el8_7.x86_64 

$drbdadm status 
r0 role:Secondary 
disk:Diskless 

$ find /lib/modules -name drbd.ko 
/lib/modules/4.18.0-425.13.1.el8_7.x86_64/weak-updates/drbd90/drbd.ko 
/lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko 
/lib/modules/4.18.0-425.19.2.el8_7.x86_64/weak-updates/drbd90/drbd.ko 

$ cat /proc/drbd 
version: 9.1.13 (api:2/proto:86-121) 
GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by mockbuild@, 2023-01-30 18:33:50 
Transports (api:18): 

Also some symbol errors from dmesg with newer kernel 

[Fri Apr 14 16:14:18 2023] drbd r0: Starting worker thread (from drbdsetup [2088]) 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_find_path_by_addr 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_find_path_by_addr (err -22) 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_get_listener 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_get_listener (err -22) 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_stream_send_timed_out 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_stream_send_timed_out (err -22) 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_register_transport_class 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_register_transport_class (err -22) 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_should_abort_listening 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_should_abort_listening (err -22) 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_put_listener 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_put_listener (err -22) 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_path_event 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_path_event (err -22) 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_free_pages 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_free_pages (err -22) 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_unregister_transport_class 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_unregister_transport_class (err -22) 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_alloc_pages 
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_alloc_pages (err -22) 

Nigel 

Nigel Phillips | IT Consultant 

Tel: (+353) 86 6057580 
Skype: live:nigel_2260 

[ http://www.ntalk.ie/ | www.ntalk.ie ] | [ mailto:nigel at ntalk.ie | nigel at ntalk.ie ] 

From: "Akemi Yagi" < [ mailto:toracat at elrepo.org | toracat at elrepo.org ] > 
To: "Nigel Phillips" < [ mailto:nigel at ntalk.ie | nigel at ntalk.ie ] > 
Cc: "drbd-user" < [ mailto:drbd-user at lists.linbit.com | drbd-user at lists.linbit.com ] > 
Sent: Friday, 14 April, 2023 16:05:30 
Subject: Re: [DRBD-user] 9.1.14 upgrade issue 

Hi Nigel, 

Can you show the output from: 

$ find /lib/modules -name drbd.ko 

Also, if you boot kernel 4.18.0-425.19.2.el8_7 once again, what happens? Do you still see version: 9.1.13? 

Akemi 

On Fri, Apr 14, 2023 at 4:53 AM Nigel Phillips < [ mailto:nigel at ntalk.ie | nigel at ntalk.ie ] > wrote: 

BQ_BEGIN

Akemi, 

Sorry syntax in email, did a copy and paste of the new update package name from the release email rather than from installed system package names. Actual system installed files are correct though, so the original problem does unfortunately still exist. 

$dnf list --installed | grep drbd 
drbd90-utils.x86_64 9.23.1-1.el8.elrepo @elrepo 
kmod-drbd90.x86_64 9.1.14-1.el8_7.elrepo @elrepo 

Best Regards, 
Nigel 

On 14 April 2023 10:28:42 IST, Akemi Yagi < [ mailto:toracat at elrepo.org | toracat at elrepo.org ] > wrote: 
BQ_BEGIN

On Fri, Apr 14, 2023 at 2:18 AM Nigel Phillips < [ mailto:nigel at ntalk.ie | nigel at ntalk.ie ] > wrote: 

BQ_BEGIN

Morning, 

AlmaLinux 8.7, kernel 4.18.0-425.19.2.el8_7.x86_64 

Just installed kmod-drbd9x-9.1.14-1.el9_1.elrepo.x86_64.rpm on my secondary and after a reboot was greeted with a 

drbdadm status 
r0 role:Secondary 
disk:Diskless 

Looking at /proc/drbd I noticed it still had the previous version listed 

cat /proc/drbd 
version: 9.1.13 (api:2/proto:86-121) 
GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by mockbuild@, 2023-01-30 18:33:50 
Transports (api:18): 

Rebooting again into an earlier kernel, 4.18.0-425.13.1.el8_7.x86_64 and now back and working with /proc/drbd showing the correct version. 

cat /proc/drbd 
version: 9.1.14 (api:2/proto:86-121) 
GIT-hash: df55dfb7a93484b7d7eb0c4deac62d887cfcbf67 build by mockbuild@, 2023-04-08 19:54:28 
Transports (api:18): tcp (9.1.14) 

Did I miss a step on the upgrade, should I have brought drbd down first (it was set to secondary) or intitally booted into an earlier kernel first before the upgrade? 

Best Regards, 
Nigel 

You installed the kmod package built for el9 on your el8 system. Please try installing kmod-drbd90 for el8. 

Akemi 

BQ_END

-- 
Sent from my Android device with K-9 Mail. Please excuse my brevity. 

BQ_END

BQ_END

BQ_END

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linbit.com/pipermail/drbd-user/attachments/20230414/e469c45a/attachment-0001.htm>