[DRBD-user] Failed deploying instance 1 of 10

[Rene Peinthor]

Thanks for the logs.

They reveal 2 things:

1. We discovered yesterday a bug in linstor that makes it currently
impossible to create new resources after a Controller restart if you
currently have
a resource-definition without resources, you can currently workaround this
by deleting such orphan resource definitions. Here is a one liner to find
such resource definitions:

jq --slurpfile r <(linstor -m r l | jq '[.[].resources[].name] | unique |
sort') '. -$r[0]'  <(linstor -m rd l | jq '[.[].rsc_dfns[].rsc_name] |
sort')

2. You still have the snapshot object that was temporarily created while
cloning the resource, this snapshot is usually deleted after the resource
was cloned, but
because the create resource failed it didn't remove the temp snapshot.
Those snapshots are prefixed "for-*" if you haven't currently any clone
operation running you
can delete all of those snapshots with `linstor snapshot delete for-{name}`
With today's opennebula addon release temp snapshots will always be deleted.

Cheers,
Rene

On Thu, Jun 6, 2019 at 11:46 AM Luke Camilleri <
luke.camilleri at zylacomputing.com> wrote:

> List from that time gap shows:
>
>
>
> ┊ 239 ┊ 5CF7F56F-00000-000000 ┊ 2019-06-05 19:15:26 ┊ Controller ┊
>
> ┊ 240 ┊ 5CF7F56F-00000-000001 ┊ 2019-06-05 19:15:26 ┊ Controller ┊
>
> ┊ 241 ┊ 5CF7F56F-00000-000002 ┊ 2019-06-05 19:15:31 ┊ Controller ┊
>
> ┊ 242 ┊ 5CF7F56F-00000-000003 ┊ 2019-06-05 19:15:31 ┊ Controller ┊
>
> ┊ 243 ┊ 5CF7F56F-00000-000004 ┊ 2019-06-05 19:15:33 ┊ Controller ┊
>
> ┊ 244 ┊ 5CF7F56F-00000-000005 ┊ 2019-06-05 19:15:33 ┊ Controller ┊
>
> ┊ 245 ┊ 5CF7F56F-00000-000006 ┊ 2019-06-05 19:15:36 ┊ Controller ┊
>
> ┊ 246 ┊ 5CF7F56F-00000-000007 ┊ 2019-06-05 19:15:37 ┊ Controller ┊
>
> ┊ 247 ┊ 5CF7F56F-00000-000008 ┊ 2019-06-05 19:16:02 ┊ Controller ┊
>
> ┊ 248 ┊ 5CF7F56F-00000-000009 ┊ 2019-06-05 19:16:02 ┊ Controller ┊
>
> ┊ 249 ┊ 5CF7F56F-00000-000010 ┊ 2019-06-05 19:16:02 ┊ Controller ┊
>
> ┊ 250 ┊ 5CF7F56F-00000-000011 ┊ 2019-06-05 19:16:04 ┊ Controller ┊
>
> ┊ 251 ┊ 5CF7F56F-00000-000012 ┊ 2019-06-05 19:16:04 ┊ Controller ┊
>
> ┊ 252 ┊ 5CF7F56F-00000-000013 ┊ 2019-06-05 19:16:04 ┊ Controller ┊
>
> ┊ 253 ┊ 5CF7F56F-00000-000014 ┊ 2019-06-05 19:16:08 ┊ Controller ┊
>
> ┊ 254 ┊ 5CF7F56F-00000-000015 ┊ 2019-06-05 19:16:08 ┊ Controller ┊
>
> ┊ 255 ┊ 5CF7F56F-00000-000016 ┊ 2019-06-05 19:16:09 ┊ Controller ┊
>
> ┊ 256 ┊ 5CF7F56F-00000-000017 ┊ 2019-06-05 19:16:33 ┊ Controller ┊
>
> ┊ 257 ┊ 5CF7F56F-00000-000018 ┊ 2019-06-05 19:16:33 ┊ Controller ┊
>
> ┊ 258 ┊ 5CF7F56F-00000-000019 ┊ 2019-06-05 19:16:34 ┊ Controller ┊
>
> ┊ 259 ┊ 5CF7F56F-00000-000020 ┊ 2019-06-05 19:16:35 ┊ Controller ┊
>
> ┊ 260 ┊ 5CF7F56F-00000-000021 ┊ 2019-06-05 19:16:35 ┊ Controller ┊
>
> ┊ 261 ┊ 5CF7F56F-00000-000022 ┊ 2019-06-05 19:16:36 ┊ Controller ┊
>
> ┊ 262 ┊ 5CF7F56F-00000-000023 ┊ 2019-06-05 19:16:39 ┊ Controller ┊
>
> ┊ 263 ┊ 5CF7F56F-00000-000024 ┊ 2019-06-05 19:16:39 ┊ Controller ┊
>
> ┊ 264 ┊ 5CF7F56F-00000-000025 ┊ 2019-06-05 19:16:40 ┊ Controller ┊
>
> ┊ 265 ┊ 5CF7F56F-00000-000026 ┊ 2019-06-05 19:17:01 ┊ Controller ┊
>
> ┊ 266 ┊ 5CF7F56F-00000-000027 ┊ 2019-06-05 19:17:03 ┊ Controller ┊
>
> ┊ 267 ┊ 5CF7F56F-00000-000028 ┊ 2019-06-05 19:17:06 ┊ Controller ┊
>
> ┊ 268 ┊ 5CF7F56F-00000-000029 ┊ 2019-06-05 19:18:06 ┊ Controller ┊
>
> ┊ 269 ┊ 5CF7F56F-00000-000030 ┊ 2019-06-05 19:18:36 ┊ Controller ┊
>
> ┊ 270 ┊ 5CF7F56F-00000-000031 ┊ 2019-06-05 19:18:57 ┊ Controller ┊
>
> ╰────────────────────────────────────────────────────────────────╯
>
>
>
> **TIME IS SET TO UTC IN THE LOG FILE OF OPENNEBULA SO THERE IS A 2 HOUT
> DIFFERENCE
>
>
>
> Logs attached
>
>
>
> *From:* Rene Peinthor [mailto:rene.peinthor at linbit.com]
> *Sent:* 06 June 2019 08:11
> *To:* Luke Camilleri <luke.camilleri at zylacomputing.com>
> *Cc:* drbd-user at lists.linbit.com
> *Subject:* Re: [DRBD-user] Failed deploying instance 1 of 10
>
>
>
> Hi!
>
>
>
> Could you check linstor for error reports at that time?
>
>
>
> `linstor err list`
>
> `linstor err show {id}`
>
>
>
> and paste error report(s) here?
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linbit.com/pipermail/drbd-user/attachments/20190606/3f4814ca/attachment-0001.htm>