<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p><br>
</p>
<div class="moz-cite-prefix">On 24/9/20 23:48, Rene Peinthor wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAHmn2DMx+q7pm7jFg-HphOTRhbaHH4Y0o-UFvdv4D24c+f7NNQ@mail.gmail.com">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<div dir="ltr">I can only recreate that error, if I actively
change the password in the linstor.toml to something incorrect.
<div>I don't know how this would happen in normal operation, are
you sure you never had another password or changed the
password?</div>
<div><br>
</div>
<div>if you can connect to the h2 database with the commandline
tool, you might be able to set a new password.</div>
<div><br>
</div>
</div>
</blockquote>
<p>I tried this method:</p>
<p>castle:/usr/share/linstor-server/lib# java -cp h2*.jar
org.h2.tools.Shell<br>
<br>
Welcome to H2 Shell 1.4.197 (2018-03-18)<br>
Exit with Ctrl+C<br>
[Enter] jdbc:h2:~/test<br>
URL jdbc:h2:/var/lib/linstor/linstordb<br>
[Enter] org.h2.Driver<br>
Driver <br>
[Enter] <br>
User linstor<br>
[Enter] Hide<br>
Password linstor<br>
SQL Exception: Wrong user name or password [28000-197]<br>
</p>
<p>However, it requires user/pass, which clearly is wrong....</p>
<p>Is there a method to confirm that the file is "valid" ? I seem to
have three versions of this file all identical content:</p>
<p>-rw-r--r-- 1 root root 376832 Sep 18 16:45 linstordb.mv.db<br>
-rw-r--r-- 1 root root 376832 Sep 24 02:25
linstordb.mv.db-2020-09-24T02:25+10:00.bak<br>
-rw-r--r-- 1 root root 376832 Sep 24 02:25 linstordb.mv.db.bak<br>
</p>
<p>Should I just delete the DB file and start again? Is this data
replicated to other nodes automatically?</p>
<p>Thanks,<br>
Adam<br>
</p>
<br>
<blockquote type="cite"
cite="mid:CAHmn2DMx+q7pm7jFg-HphOTRhbaHH4Y0o-UFvdv4D24c+f7NNQ@mail.gmail.com">
<div dir="ltr">
<div>Cheers,</div>
<div>Rene</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Thu, Sep 24, 2020 at 2:48
PM Adam Goryachev <<a
href="mailto:mailinglists@websitemanagers.com.au"
moz-do-not-send="true">mailinglists@websitemanagers.com.au</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<p><br>
</p>
<div>On 24/9/20 22:42, Rene Peinthor wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">They are.
<div>And how do you start the controller?</div>
</div>
<br>
</blockquote>
<p>It should start automatically at boot from systemd, but I
can start it manually with:</p>
<p>systemctl restart linstor-controller</p>
<p>In case it is your next question, here is the content of
/etc/systemd/system/multi-user.target.wants/linstor-controller.service</p>
<p>[Unit]<br>
Description=LINSTOR Controller Service<br>
Wants=network-online.target<br>
After=network-online.target<br>
<br>
[Service]<br>
Type=simple<br>
ExecStart=/usr/share/linstor-server/bin/Controller
--logs=/var/log/linstor-controller
--config-directory=/etc/linstor<br>
# if killed by signal 143 -> SIGTERM, 129 -> SIGHUP<br>
SuccessExitStatus=0 143 129<br>
User=root<br>
PrivateTmp=yes<br>
<br>
[Install]<br>
WantedBy=multi-user.target<br>
</p>
<p>Regards,<br>
Adam<br>
</p>
<blockquote type="cite">
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Thu, Sep 24, 2020
at 2:19 PM Adam Goryachev <<a
href="mailto:mailinglists@websitemanagers.com.au"
target="_blank" moz-do-not-send="true">mailinglists@websitemanagers.com.au</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px
0px 0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div> <br>
<div>On 24/9/20 15:30, Rene Peinthor wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Sounds weird, I don't think we
changed anything with the database
initialization.
<div><br>
</div>
<div>Can you post your
/etc/linstor/linstor.toml?</div>
<div><br>
</div>
<div>Cheers,</div>
<div>Rene</div>
</div>
<br>
</blockquote>
<p>Hi, please see the contents below (I assume these
are default settings):</p>
<p># Basic linstor configuration toml file<br>
# For more options check documentation<br>
<br>
[db]<br>
user = "linstor"<br>
password = "linstor"<br>
connection_url =
"jdbc:h2:/var/lib/linstor/linstordb"<br>
</p>
<p>Thanks,<br>
Adam</p>
<p><br>
</p>
<blockquote type="cite">
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Wed, Sep
23, 2020 at 6:54 PM Adam Goryachev <<a
href="mailto:mailinglists@websitemanagers.com.au"
target="_blank" moz-do-not-send="true">mailinglists@websitemanagers.com.au</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote"
style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div>
<p>Hi,</p>
<p>After upgrading on one of my test nodes I
got some errors, so I thought to upgrade
the controller, and now I am unable to
start the controller.</p>
<p>Here is what I get in the system log:</p>
<p>Sep 24 02:33:40 castle systemd[1]:
Started LINSTOR Controller Service.<br>
Sep 24 02:33:41 castle Controller[1093]:
LINSTOR, Module Controller<br>
Sep 24 02:33:41 castle Controller[1093]:
Version: 1.9.0
(678acd24a8b9b73a735407cd79ca33a5e95eb2e2)<br>
Sep 24 02:33:41 castle Controller[1093]:
Build time:
2020-09-23T10:27:49+00:00<br>
Sep 24 02:33:41 castle Controller[1093]:
Java Version: 11<br>
Sep 24 02:33:41 castle Controller[1093]:
Java VM: Debian, Version
11.0.8+10-post-Debian-1deb10u1<br>
Sep 24 02:33:41 castle Controller[1093]:
Operating system: Linux, Version
4.19.0-10-amd64<br>
Sep 24 02:33:41 castle Controller[1093]:
Environment: amd64, 2 processors,
1988 MiB memory reserved for allocations<br>
Sep 24 02:33:41 castle Controller[1093]:
System components initialization in
progress<br>
Sep 24 02:33:42 castle Controller[1093]:
02:33:42.355 [main] INFO
LINSTOR/Controller - SYSTEM -
ErrorReporter DB version 1 found.<br>
Sep 24 02:33:42 castle Controller[1093]:
02:33:42.359 [main] INFO
LINSTOR/Controller - SYSTEM - Log
directory set to:
'/var/log/linstor-controller'<br>
Sep 24 02:33:42 castle Controller[1093]:
02:33:42.410 [main] WARN
io.sentry.dsn.Dsn - *** Couldn't find a
suitable DSN, Sentry operations will do
nothing! See documentation: <a
href="https://docs.sentry.io/clients/java/"
target="_blank" moz-do-not-send="true">https://docs.sentry.io/clients/java/</a>
***<br>
Sep 24 02:33:42 castle Controller[1093]:
02:33:42.434 [Main] INFO
LINSTOR/Controller - SYSTEM - Loading API
classes started.<br>
Sep 24 02:33:43 castle Controller[1093]:
02:33:43.046 [Main] INFO
LINSTOR/Controller - SYSTEM - API classes
loading finished: 611ms<br>
Sep 24 02:33:43 castle Controller[1093]:
02:33:43.047 [Main] INFO
LINSTOR/Controller - SYSTEM - Dependency
injection started.<br>
Sep 24 02:33:43 castle Controller[1093]:
02:33:43.065 [Main] INFO
LINSTOR/Controller - SYSTEM - Attempting
dynamic load of extension module
"com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"<br>
Sep 24 02:33:43 castle Controller[1093]:
02:33:43.065 [Main] INFO
LINSTOR/Controller - SYSTEM - Extension
module
"com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
is not installed<br>
Sep 24 02:33:43 castle Controller[1093]:
WARNING: An illegal reflective access
operation has occurred<br>
Sep 24 02:33:43 castle Controller[1093]:
WARNING: Illegal reflective access by
com.google.inject.internal.cglib.core.$ReflectUtils$1
(<a moz-do-not-send="true">file:/usr/share/linstor-server/lib/guice-4.2.2.jar</a>)
to method
java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)<br>
Sep 24 02:33:43 castle Controller[1093]:
WARNING: Please consider reporting this to
the maintainers of
com.google.inject.internal.cglib.core.$ReflectUtils$1<br>
Sep 24 02:33:43 castle Controller[1093]:
WARNING: Use --illegal-access=warn to
enable warnings of further illegal
reflective access operations<br>
Sep 24 02:33:43 castle Controller[1093]:
WARNING: All illegal access operations
will be denied in a future release<br>
Sep 24 02:33:44 castle Controller[1093]:
02:33:44.962 [Main] INFO
LINSTOR/Controller - SYSTEM - Dependency
injection finished: 1915ms<br>
Sep 24 02:33:45 castle Controller[1093]:
02:33:45.533 [Main] INFO
LINSTOR/Controller - SYSTEM - Initializing
authentication subsystem<br>
Sep 24 02:33:45 castle Controller[1093]:
02:33:45.736 [Main] INFO
LINSTOR/Controller - SYSTEM - Starting
service instance 'TimerEventService' of
type TimerEventService<br>
Sep 24 02:33:45 castle Controller[1093]:
02:33:45.740 [Main] INFO
LINSTOR/Controller - SYSTEM - Initializing
the database connection pool<br>
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.303 [Main] ERROR
LINSTOR/Controller - SYSTEM - Database
initialization error [Report number
5F6B78E5-00000-000000]<br>
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.343 [Thread-2] INFO
LINSTOR/Controller - SYSTEM - Shutdown in
progress<br>
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.344 [Thread-2] INFO
LINSTOR/Controller - SYSTEM - Shutting
down service instance
'TaskScheduleService' of type
TaskScheduleService<br>
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.345 [Thread-2] INFO
LINSTOR/Controller - SYSTEM - Waiting for
service instance 'TaskScheduleService' to
complete shutdown<br>
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.345 [Thread-2] INFO
LINSTOR/Controller - SYSTEM - Shutting
down service instance 'DatabaseService' of
type DatabaseService<br>
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.349 [Thread-2] INFO
LINSTOR/Controller - SYSTEM - Waiting for
service instance 'DatabaseService' to
complete shutdown<br>
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.350 [Thread-2] INFO
LINSTOR/Controller - SYSTEM - Shutting
down service instance 'TimerEventService'
of type TimerEventService<br>
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.351 [Thread-2] INFO
LINSTOR/Controller - SYSTEM - Waiting for
service instance 'TimerEventService' to
complete shutdown<br>
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.351 [Thread-2] INFO
LINSTOR/Controller - SYSTEM - Shutdown
complete<br>
Sep 24 02:33:46 castle systemd[1]:
linstor-controller.service: Main process
exited, code=exited, status=20/n/a<br>
Sep 24 02:33:46 castle systemd[1]:
linstor-controller.service: Failed with
result 'exit-code'.<br>
</p>
<p>Here is
/var/log/linstor-controller/ErrorReport-5F6B78E5-00000-000000.log</p>
<p>ERROR REPORT 5F6B78E5-00000-000000<br>
<br>
============================================================<br>
<br>
Application:
LINBIT® LINSTOR<br>
Module:
Controller<br>
Version: 1.9.0<br>
Build ID:
678acd24a8b9b73a735407cd79ca33a5e95eb2e2<br>
Build time:
2020-09-23T10:27:49+00:00<br>
Error time:
2020-09-24 02:33:46<br>
Node: castle<br>
<br>
============================================================<br>
<br>
Reported error:<br>
===============<br>
<br>
Description:<br>
Database initialization error<br>
<br>
Category:
LinStorException<br>
Class name:
SystemServiceStartException<br>
Class canonical name:
com.linbit.SystemServiceStartException<br>
Generated at: Method
'initialize', Source file
'DbConnectionPoolInitializer.java', Line
#56<br>
Error message:
Database initialization error<br>
<br>
Call backtrace:<br>
<br>
Method
Native Class:Line number<br>
initialize
N
com.linbit.linstor.dbcp.DbConnectionPoolInitializer:56<br>
startSystemServices
N
com.linbit.linstor.core.ApplicationLifecycleManager:87<br>
start
N
com.linbit.linstor.core.Controller:337<br>
main
N
com.linbit.linstor.core.Controller:556<br>
<br>
Caused by:<br>
==========<br>
<br>
Category:
RuntimeException<br>
Class name:
LinStorDBRuntimeException<br>
Class canonical name:
com.linbit.linstor.LinStorDBRuntimeException<br>
Generated at: Method
'setTransactionIsolation', Source file
'DbConnectionPool.java', Line #485<br>
<br>
Error message: Failed
to set transaction isolation<br>
<br>
Call backtrace:<br>
<br>
Method
Native Class:Line number<br>
setTransactionIsolation
N
com.linbit.linstor.dbcp.DbConnectionPool:485<br>
migrate
N
com.linbit.linstor.dbcp.DbConnectionPool:202<br>
initialize
N
com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50<br>
startSystemServices
N
com.linbit.linstor.core.ApplicationLifecycleManager:87<br>
start
N
com.linbit.linstor.core.Controller:337<br>
main
N
com.linbit.linstor.core.Controller:556<br>
<br>
Caused by:<br>
==========<br>
<br>
Category:
Exception<br>
Class name:
JdbcSQLException<br>
Class canonical name:
org.h2.jdbc.JdbcSQLException<br>
Generated at: Method
'getJdbcSQLException', Source file
'DbException.java', Line #357<br>
<br>
Error message: Wrong
user name or password [28000-197]<br>
<br>
Call backtrace:<br>
<br>
Method
Native Class:Line number<br>
getJdbcSQLException
N org.h2.message.DbException:357<br>
get
N org.h2.message.DbException:179<br>
get
N org.h2.message.DbException:155<br>
get
N org.h2.message.DbException:144<br>
validateUserAndPassword
N org.h2.engine.Engine:341<br>
createSessionAndValidate
N org.h2.engine.Engine:165<br>
createSession
N org.h2.engine.Engine:140<br>
createSession
N org.h2.engine.Engine:28<br>
connectEmbeddedOrServer
N org.h2.engine.SessionRemote:351<br>
<init>
N org.h2.jdbc.JdbcConnection:124<br>
<init>
N org.h2.jdbc.JdbcConnection:103<br>
connect
N org.h2.Driver:69<br>
getConnection
N java.sql.DriverManager:677<br>
getConnection
N java.sql.DriverManager:189<br>
createConnection
N
org.apache.commons.dbcp2.DriverManagerConnectionFactory:123<br>
makeObject
N
org.apache.commons.dbcp2.PoolableConnectionFactory:355<br>
create
N
org.apache.commons.pool2.impl.GenericObjectPool:889<br>
borrowObject
N
org.apache.commons.pool2.impl.GenericObjectPool:424<br>
borrowObject
N
org.apache.commons.pool2.impl.GenericObjectPool:349<br>
getConnection
N
org.apache.commons.dbcp2.PoolingDataSource:134<br>
setTransactionIsolation
N
com.linbit.linstor.dbcp.DbConnectionPool:477<br>
migrate
N
com.linbit.linstor.dbcp.DbConnectionPool:202<br>
initialize
N
com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50<br>
startSystemServices
N
com.linbit.linstor.core.ApplicationLifecycleManager:87<br>
start
N
com.linbit.linstor.core.Controller:337<br>
main
N
com.linbit.linstor.core.Controller:556<br>
<br>
Finally I found another log in
/var/lib/linstor/linstordb.trace.db</p>
<p>2020-09-24 02:33:45 database: wrong user
or password; user: "LINSTOR"<br>
org.h2.message.DbException: Wrong user
name or password [28000-197]<br>
at
org.h2.message.DbException.get(DbException.java:179)<br>
at
org.h2.message.DbException.get(DbException.java:155)<br>
at
org.h2.message.DbException.get(DbException.java:144)<br>
at
org.h2.engine.Engine.openSession(Engine.java:107)<br>
at
org.h2.engine.Engine.openSession(Engine.java:179)<br>
at
org.h2.engine.Engine.createSessionAndValidate(Engine.java:157)<br>
at
org.h2.engine.Engine.createSession(Engine.java:140)<br>
at
org.h2.engine.Engine.createSession(Engine.java:28)<br>
at
org.h2.engine.SessionRemote.connectEmbeddedOrServer(SessionRemote.java:351)<br>
at
org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:124)<br>
at
org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:103)<br>
at
org.h2.Driver.connect(Driver.java:69)<br>
at
java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)<br>
at
java.sql/java.sql.DriverManager.getConnection(DriverManager.java:189)<br>
at
org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:123)<br>
at
org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:355)<br>
at
org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:889)<br>
at
org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:424)<br>
at
org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:349)<br>
at
org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)<br>
at
com.linbit.linstor.dbcp.DbConnectionPool.setTransactionIsolation(DbConnectionPool.java:477)<br>
at
com.linbit.linstor.dbcp.DbConnectionPool.migrate(DbConnectionPool.java:202)<br>
at
com.linbit.linstor.dbcp.DbConnectionPoolInitializer.initialize(DbConnectionPoolInitializer.java:50)<br>
at
com.linbit.linstor.core.ApplicationLifecycleManager.startSystemServices(ApplicationLifecycleManager.java:87)<br>
at
com.linbit.linstor.core.Controller.start(Controller.java:337)<br>
at
com.linbit.linstor.core.Controller.main(Controller.java:556)<br>
Caused by: org.h2.jdbc.JdbcSQLException:
Wrong user name or password [28000-197]<br>
at
org.h2.message.DbException.getJdbcSQLException(DbException.java:357)<br>
... 26 more<br>
</p>
<p><br>
</p>
<p>Luckily, this is just a test environment,
but I'd like to know if I messed up in my
upgrade process somehow or this is a bug
in the new version. I haven't downgraded
or anything yet.<br>
</p>
<p>Regards,<br>
Adam<br>
</p>
<p><br>
</p>
<div>On 23/9/20 22:31, Rene Peinthor wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hi!
<div><br>
</div>
<div>Here is a new minor Linstor
release, this release contains more
bug fixes than new features.</div>
<div>Notable features are a new
auto-unplace option, to reduce the
replica-count of resources</div>
<div>to the value set in the
resource-group after a certain time.
And error-reports can now be deleted</div>
<div>from the REST-API (client).<br>
<div><br>
</div>
<div><font face="monospace">linstor-server
1.9.0<br>
--------------------<br>
* Added auto-"unplace",
automatically removes resources if
they exceed the replica count if
`DrbdOptions/auto-unplace` is set<br>
* Added error-report deletion API<br>
* Expose DRBD promotion_score and
may_promote via REST-API and
server sent events<br>
* Prometheus metrics are now
mostly cached and much faster to
query<br>
* Send SD_NOTIFY READY to systemd
if services are ready<br>
* OpenFlex resource are now
correctly limited to 32 characters<br>
* Fix etcd modify net-interface
(incorrect serialization)<br>
* Fix autoplacer also toggling
diskless resources<br>
* Fix snapshot-shipping with more
than 1 volume definitions<br>
* Fix zfs create options handling<br>
* Fixed recaching of lvm-filter<br>
* Fix missing client answer if
drbd device doesn't become ready
in reasonable time<br>
* REST-API v1.4.0</font><br>
</div>
<div><br>
</div>
<div>
<div><font face="monospace"><a
href="https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz"
target="_blank"
moz-do-not-send="true">https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz</a></font><br>
</div>
<div><br>
</div>
<div>
<div>
<div>Linstor PPA:<br>
<a
href="https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack"
rel="noreferrer"
target="_blank"
moz-do-not-send="true">https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack</a></div>
</div>
<div><br>
</div>
<div>Cheers,<br>
</div>
<div>Rene</div>
</div>
</div>
</div>
</div>
<br>
<fieldset></fieldset>
<pre>_______________________________________________
Star us on GITHUB: <a href="https://github.com/LINBIT" target="_blank" moz-do-not-send="true">https://github.com/LINBIT</a>
drbd-user mailing list
<a href="mailto:drbd-user@lists.linbit.com" target="_blank" moz-do-not-send="true">drbd-user@lists.linbit.com</a>
<a href="https://lists.linbit.com/mailman/listinfo/drbd-user" target="_blank" moz-do-not-send="true">https://lists.linbit.com/mailman/listinfo/drbd-user</a>
</pre>
</blockquote>
</div>
_______________________________________________<br>
Star us on GITHUB: <a
href="https://github.com/LINBIT"
rel="noreferrer" target="_blank"
moz-do-not-send="true">https://github.com/LINBIT</a><br>
drbd-user mailing list<br>
<a href="mailto:drbd-user@lists.linbit.com"
target="_blank" moz-do-not-send="true">drbd-user@lists.linbit.com</a><br>
<a
href="https://lists.linbit.com/mailman/listinfo/drbd-user"
rel="noreferrer" target="_blank"
moz-do-not-send="true">https://lists.linbit.com/mailman/listinfo/drbd-user</a><br>
</blockquote>
</div>
</blockquote>
</div>
</blockquote>
</div>
</blockquote>
</div>
</blockquote>
</div>
</blockquote>
</body>
</html>