[DRBD-user] linstor-server 1.9.0 release

Adam Goryachev mailinglists at websitemanagers.com.au
Thu Sep 24 16:55:26 CEST 2020


On 24/9/20 23:48, Rene Peinthor wrote:
> I can only recreate that error, if I actively change the password in 
> the linstor.toml to something incorrect.
> I don't know how this would happen in normal operation, are you sure 
> you never had another password or changed the password?
>
> if you can connect to the h2 database with the commandline tool, you 
> might be able to set a new password.
>
I tried this method:

castle:/usr/share/linstor-server/lib#  java -cp h2*.jar org.h2.tools.Shell

Welcome to H2 Shell 1.4.197 (2018-03-18)
Exit with Ctrl+C
[Enter]   jdbc:h2:~/test
URL       jdbc:h2:/var/lib/linstor/linstordb
[Enter]   org.h2.Driver
Driver
[Enter]
User      linstor
[Enter]   Hide
Password  linstor
SQL Exception: Wrong user name or password [28000-197]

However, it requires user/pass, which clearly is wrong....

Is there a method to confirm that the file is "valid" ? I seem to have 
three versions of this file all identical content:

-rw-r--r-- 1 root root 376832 Sep 18 16:45 linstordb.mv.db
-rw-r--r-- 1 root root 376832 Sep 24 02:25 
linstordb.mv.db-2020-09-24T02:25+10:00.bak
-rw-r--r-- 1 root root 376832 Sep 24 02:25 linstordb.mv.db.bak

Should I just delete the DB file and start again? Is this data 
replicated to other nodes automatically?

Thanks,
Adam


> Cheers,
> Rene
>
> On Thu, Sep 24, 2020 at 2:48 PM Adam Goryachev 
> <mailinglists at websitemanagers.com.au 
> <mailto:mailinglists at websitemanagers.com.au>> wrote:
>
>
>     On 24/9/20 22:42, Rene Peinthor wrote:
>>     They are.
>>     And how do you start the controller?
>>
>     It should start automatically at boot from systemd, but I can
>     start it manually with:
>
>     systemctl restart linstor-controller
>
>     In case it is your next question, here is the content of
>     /etc/systemd/system/multi-user.target.wants/linstor-controller.service
>
>     [Unit]
>     Description=LINSTOR Controller Service
>     Wants=network-online.target
>     After=network-online.target
>
>     [Service]
>     Type=simple
>     ExecStart=/usr/share/linstor-server/bin/Controller
>     --logs=/var/log/linstor-controller --config-directory=/etc/linstor
>     # if killed by signal 143 -> SIGTERM, 129 -> SIGHUP
>     SuccessExitStatus=0 143 129
>     User=root
>     PrivateTmp=yes
>
>     [Install]
>     WantedBy=multi-user.target
>
>     Regards,
>     Adam
>
>>     On Thu, Sep 24, 2020 at 2:19 PM Adam Goryachev
>>     <mailinglists at websitemanagers.com.au
>>     <mailto:mailinglists at websitemanagers.com.au>> wrote:
>>
>>
>>         On 24/9/20 15:30, Rene Peinthor wrote:
>>>         Sounds weird, I don't think we changed anything with the
>>>         database initialization.
>>>
>>>         Can you post your /etc/linstor/linstor.toml?
>>>
>>>         Cheers,
>>>         Rene
>>>
>>         Hi, please see the contents below (I assume these are default
>>         settings):
>>
>>         # Basic linstor configuration toml file
>>         # For more options check documentation
>>
>>         [db]
>>           user = "linstor"
>>           password = "linstor"
>>           connection_url = "jdbc:h2:/var/lib/linstor/linstordb"
>>
>>         Thanks,
>>         Adam
>>
>>
>>>         On Wed, Sep 23, 2020 at 6:54 PM Adam Goryachev
>>>         <mailinglists at websitemanagers.com.au
>>>         <mailto:mailinglists at websitemanagers.com.au>> wrote:
>>>
>>>             Hi,
>>>
>>>             After upgrading on one of my test nodes I got some
>>>             errors, so I thought to upgrade the controller, and now
>>>             I am unable to start the controller.
>>>
>>>             Here is what I get in the system log:
>>>
>>>             Sep 24 02:33:40 castle systemd[1]: Started LINSTOR
>>>             Controller Service.
>>>             Sep 24 02:33:41 castle Controller[1093]: LINSTOR, Module
>>>             Controller
>>>             Sep 24 02:33:41 castle Controller[1093]:
>>>             Version:            1.9.0
>>>             (678acd24a8b9b73a735407cd79ca33a5e95eb2e2)
>>>             Sep 24 02:33:41 castle Controller[1093]: Build time:
>>>             2020-09-23T10:27:49+00:00
>>>             Sep 24 02:33:41 castle Controller[1093]: Java
>>>             Version:       11
>>>             Sep 24 02:33:41 castle Controller[1093]: Java
>>>             VM:            Debian, Version
>>>             11.0.8+10-post-Debian-1deb10u1
>>>             Sep 24 02:33:41 castle Controller[1093]: Operating
>>>             system:   Linux, Version 4.19.0-10-amd64
>>>             Sep 24 02:33:41 castle Controller[1093]:
>>>             Environment:        amd64, 2 processors, 1988 MiB memory
>>>             reserved for allocations
>>>             Sep 24 02:33:41 castle Controller[1093]: System
>>>             components initialization in progress
>>>             Sep 24 02:33:42 castle Controller[1093]: 02:33:42.355
>>>             [main] INFO LINSTOR/Controller - SYSTEM - ErrorReporter
>>>             DB version 1 found.
>>>             Sep 24 02:33:42 castle Controller[1093]: 02:33:42.359
>>>             [main] INFO LINSTOR/Controller - SYSTEM - Log directory
>>>             set to: '/var/log/linstor-controller'
>>>             Sep 24 02:33:42 castle Controller[1093]: 02:33:42.410
>>>             [main] WARN io.sentry.dsn.Dsn - *** Couldn't find a
>>>             suitable DSN, Sentry operations will do nothing! See
>>>             documentation: https://docs.sentry.io/clients/java/
>>>             <https://docs.sentry.io/clients/java/> ***
>>>             Sep 24 02:33:42 castle Controller[1093]: 02:33:42.434
>>>             [Main] INFO LINSTOR/Controller - SYSTEM - Loading API
>>>             classes started.
>>>             Sep 24 02:33:43 castle Controller[1093]: 02:33:43.046
>>>             [Main] INFO LINSTOR/Controller - SYSTEM - API classes
>>>             loading finished: 611ms
>>>             Sep 24 02:33:43 castle Controller[1093]: 02:33:43.047
>>>             [Main] INFO LINSTOR/Controller - SYSTEM - Dependency
>>>             injection started.
>>>             Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065
>>>             [Main] INFO LINSTOR/Controller - SYSTEM - Attempting
>>>             dynamic load of extension module
>>>             "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
>>>             Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065
>>>             [Main] INFO LINSTOR/Controller - SYSTEM - Extension
>>>             module
>>>             "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
>>>             is not installed
>>>             Sep 24 02:33:43 castle Controller[1093]: WARNING: An
>>>             illegal reflective access operation has occurred
>>>             Sep 24 02:33:43 castle Controller[1093]: WARNING:
>>>             Illegal reflective access by
>>>             com.google.inject.internal.cglib.core.$ReflectUtils$1
>>>             (file:/usr/share/linstor-server/lib/guice-4.2.2.jar) to
>>>             method
>>>             java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
>>>             Sep 24 02:33:43 castle Controller[1093]: WARNING: Please
>>>             consider reporting this to the maintainers of
>>>             com.google.inject.internal.cglib.core.$ReflectUtils$1
>>>             Sep 24 02:33:43 castle Controller[1093]: WARNING: Use
>>>             --illegal-access=warn to enable warnings of further
>>>             illegal reflective access operations
>>>             Sep 24 02:33:43 castle Controller[1093]: WARNING: All
>>>             illegal access operations will be denied in a future release
>>>             Sep 24 02:33:44 castle Controller[1093]: 02:33:44.962
>>>             [Main] INFO LINSTOR/Controller - SYSTEM - Dependency
>>>             injection finished: 1915ms
>>>             Sep 24 02:33:45 castle Controller[1093]: 02:33:45.533
>>>             [Main] INFO LINSTOR/Controller - SYSTEM - Initializing
>>>             authentication subsystem
>>>             Sep 24 02:33:45 castle Controller[1093]: 02:33:45.736
>>>             [Main] INFO LINSTOR/Controller - SYSTEM - Starting
>>>             service instance 'TimerEventService' of type
>>>             TimerEventService
>>>             Sep 24 02:33:45 castle Controller[1093]: 02:33:45.740
>>>             [Main] INFO LINSTOR/Controller - SYSTEM - Initializing
>>>             the database connection pool
>>>             Sep 24 02:33:46 castle Controller[1093]: 02:33:46.303
>>>             [Main] ERROR LINSTOR/Controller - SYSTEM - Database
>>>             initialization error [Report number 5F6B78E5-00000-000000]
>>>             Sep 24 02:33:46 castle Controller[1093]: 02:33:46.343
>>>             [Thread-2] INFO LINSTOR/Controller - SYSTEM - Shutdown
>>>             in progress
>>>             Sep 24 02:33:46 castle Controller[1093]: 02:33:46.344
>>>             [Thread-2] INFO LINSTOR/Controller - SYSTEM - Shutting
>>>             down service instance 'TaskScheduleService' of type
>>>             TaskScheduleService
>>>             Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345
>>>             [Thread-2] INFO LINSTOR/Controller - SYSTEM - Waiting
>>>             for service instance 'TaskScheduleService' to complete
>>>             shutdown
>>>             Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345
>>>             [Thread-2] INFO LINSTOR/Controller - SYSTEM - Shutting
>>>             down service instance 'DatabaseService' of type
>>>             DatabaseService
>>>             Sep 24 02:33:46 castle Controller[1093]: 02:33:46.349
>>>             [Thread-2] INFO LINSTOR/Controller - SYSTEM - Waiting
>>>             for service instance 'DatabaseService' to complete shutdown
>>>             Sep 24 02:33:46 castle Controller[1093]: 02:33:46.350
>>>             [Thread-2] INFO LINSTOR/Controller - SYSTEM - Shutting
>>>             down service instance 'TimerEventService' of type
>>>             TimerEventService
>>>             Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351
>>>             [Thread-2] INFO LINSTOR/Controller - SYSTEM - Waiting
>>>             for service instance 'TimerEventService' to complete
>>>             shutdown
>>>             Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351
>>>             [Thread-2] INFO LINSTOR/Controller - SYSTEM - Shutdown
>>>             complete
>>>             Sep 24 02:33:46 castle systemd[1]:
>>>             linstor-controller.service: Main process exited,
>>>             code=exited, status=20/n/a
>>>             Sep 24 02:33:46 castle systemd[1]:
>>>             linstor-controller.service: Failed with result 'exit-code'.
>>>
>>>             Here is
>>>             /var/log/linstor-controller/ErrorReport-5F6B78E5-00000-000000.log
>>>
>>>             ERROR REPORT 5F6B78E5-00000-000000
>>>
>>>             ============================================================
>>>
>>>             Application: LINBIT® LINSTOR
>>>             Module: Controller
>>>             Version:                            1.9.0
>>>             Build ID: 678acd24a8b9b73a735407cd79ca33a5e95eb2e2
>>>             Build time: 2020-09-23T10:27:49+00:00
>>>             Error time: 2020-09-24 02:33:46
>>>             Node:                               castle
>>>
>>>             ============================================================
>>>
>>>             Reported error:
>>>             ===============
>>>
>>>             Description:
>>>                 Database initialization error
>>>
>>>             Category: LinStorException
>>>             Class name: SystemServiceStartException
>>>             Class canonical name: com.linbit.SystemServiceStartException
>>>             Generated at:                       Method 'initialize',
>>>             Source file 'DbConnectionPoolInitializer.java', Line #56
>>>             Error message: Database initialization error
>>>
>>>             Call backtrace:
>>>
>>>             Method Native Class:Line number
>>>             initialize N
>>>             com.linbit.linstor.dbcp.DbConnectionPoolInitializer:56
>>>             startSystemServices N
>>>             com.linbit.linstor.core.ApplicationLifecycleManager:87
>>>             start N com.linbit.linstor.core.Controller:337
>>>             main N com.linbit.linstor.core.Controller:556
>>>
>>>             Caused by:
>>>             ==========
>>>
>>>             Category: RuntimeException
>>>             Class name: LinStorDBRuntimeException
>>>             Class canonical name:
>>>             com.linbit.linstor.LinStorDBRuntimeException
>>>             Generated at:                       Method
>>>             'setTransactionIsolation', Source file
>>>             'DbConnectionPool.java', Line #485
>>>
>>>             Error message:                      Failed to set
>>>             transaction isolation
>>>
>>>             Call backtrace:
>>>
>>>             Method Native Class:Line number
>>>             setTransactionIsolation N
>>>             com.linbit.linstor.dbcp.DbConnectionPool:485
>>>             migrate N com.linbit.linstor.dbcp.DbConnectionPool:202
>>>             initialize N
>>>             com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>>>             startSystemServices N
>>>             com.linbit.linstor.core.ApplicationLifecycleManager:87
>>>             start N com.linbit.linstor.core.Controller:337
>>>             main N com.linbit.linstor.core.Controller:556
>>>
>>>             Caused by:
>>>             ==========
>>>
>>>             Category: Exception
>>>             Class name: JdbcSQLException
>>>             Class canonical name: org.h2.jdbc.JdbcSQLException
>>>             Generated at:                       Method
>>>             'getJdbcSQLException', Source file 'DbException.java',
>>>             Line #357
>>>
>>>             Error message:                      Wrong user name or
>>>             password [28000-197]
>>>
>>>             Call backtrace:
>>>
>>>             Method Native Class:Line number
>>>             getJdbcSQLException N      org.h2.message.DbException:357
>>>             get N      org.h2.message.DbException:179
>>>             get N      org.h2.message.DbException:155
>>>             get N      org.h2.message.DbException:144
>>>             validateUserAndPassword N      org.h2.engine.Engine:341
>>>             createSessionAndValidate N      org.h2.engine.Engine:165
>>>             createSession N      org.h2.engine.Engine:140
>>>             createSession N      org.h2.engine.Engine:28
>>>             connectEmbeddedOrServer N     
>>>             org.h2.engine.SessionRemote:351
>>>             <init> N      org.h2.jdbc.JdbcConnection:124
>>>             <init> N      org.h2.jdbc.JdbcConnection:103
>>>             connect N      org.h2.Driver:69
>>>             getConnection N      java.sql.DriverManager:677
>>>             getConnection N      java.sql.DriverManager:189
>>>             createConnection N
>>>             org.apache.commons.dbcp2.DriverManagerConnectionFactory:123
>>>             makeObject N
>>>             org.apache.commons.dbcp2.PoolableConnectionFactory:355
>>>             create N org.apache.commons.pool2.impl.GenericObjectPool:889
>>>             borrowObject N
>>>             org.apache.commons.pool2.impl.GenericObjectPool:424
>>>             borrowObject N
>>>             org.apache.commons.pool2.impl.GenericObjectPool:349
>>>             getConnection N
>>>             org.apache.commons.dbcp2.PoolingDataSource:134
>>>             setTransactionIsolation N
>>>             com.linbit.linstor.dbcp.DbConnectionPool:477
>>>             migrate N com.linbit.linstor.dbcp.DbConnectionPool:202
>>>             initialize N
>>>             com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>>>             startSystemServices N
>>>             com.linbit.linstor.core.ApplicationLifecycleManager:87
>>>             start N com.linbit.linstor.core.Controller:337
>>>             main N com.linbit.linstor.core.Controller:556
>>>
>>>             Finally I found another log in
>>>             /var/lib/linstor/linstordb.trace.db
>>>
>>>             2020-09-24 02:33:45 database: wrong user or password;
>>>             user: "LINSTOR"
>>>             org.h2.message.DbException: Wrong user name or password
>>>             [28000-197]
>>>                     at
>>>             org.h2.message.DbException.get(DbException.java:179)
>>>                     at
>>>             org.h2.message.DbException.get(DbException.java:155)
>>>                     at
>>>             org.h2.message.DbException.get(DbException.java:144)
>>>                     at org.h2.engine.Engine.openSession(Engine.java:107)
>>>                     at org.h2.engine.Engine.openSession(Engine.java:179)
>>>                     at
>>>             org.h2.engine.Engine.createSessionAndValidate(Engine.java:157)
>>>                     at
>>>             org.h2.engine.Engine.createSession(Engine.java:140)
>>>                     at
>>>             org.h2.engine.Engine.createSession(Engine.java:28)
>>>                     at
>>>             org.h2.engine.SessionRemote.connectEmbeddedOrServer(SessionRemote.java:351)
>>>                     at
>>>             org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:124)
>>>                     at
>>>             org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:103)
>>>                     at org.h2.Driver.connect(Driver.java:69)
>>>                     at
>>>             java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
>>>                     at
>>>             java.sql/java.sql.DriverManager.getConnection(DriverManager.java:189)
>>>                     at
>>>             org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:123)
>>>                     at
>>>             org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:355)
>>>                     at
>>>             org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:889)
>>>                     at
>>>             org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:424)
>>>                     at
>>>             org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:349)
>>>                     at
>>>             org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
>>>                     at
>>>             com.linbit.linstor.dbcp.DbConnectionPool.setTransactionIsolation(DbConnectionPool.java:477)
>>>                     at
>>>             com.linbit.linstor.dbcp.DbConnectionPool.migrate(DbConnectionPool.java:202)
>>>                     at
>>>             com.linbit.linstor.dbcp.DbConnectionPoolInitializer.initialize(DbConnectionPoolInitializer.java:50)
>>>                     at
>>>             com.linbit.linstor.core.ApplicationLifecycleManager.startSystemServices(ApplicationLifecycleManager.java:87)
>>>                     at
>>>             com.linbit.linstor.core.Controller.start(Controller.java:337)
>>>                     at
>>>             com.linbit.linstor.core.Controller.main(Controller.java:556)
>>>             Caused by: org.h2.jdbc.JdbcSQLException: Wrong user name
>>>             or password [28000-197]
>>>                     at
>>>             org.h2.message.DbException.getJdbcSQLException(DbException.java:357)
>>>                     ... 26 more
>>>
>>>
>>>             Luckily, this is just a test environment, but I'd like
>>>             to know if I messed up in my upgrade process somehow or
>>>             this is a bug in the new version. I haven't downgraded
>>>             or anything yet.
>>>
>>>             Regards,
>>>             Adam
>>>
>>>
>>>             On 23/9/20 22:31, Rene Peinthor wrote:
>>>>             Hi!
>>>>
>>>>             Here is a new minor Linstor release, this release
>>>>             contains more bug fixes than new features.
>>>>             Notable features are a new auto-unplace option, to
>>>>             reduce the replica-count of resources
>>>>             to the value set in the resource-group after a certain
>>>>             time. And error-reports can now be deleted
>>>>             from the REST-API (client).
>>>>
>>>>             linstor-server 1.9.0
>>>>             --------------------
>>>>              * Added auto-"unplace", automatically removes
>>>>             resources if they exceed the replica count if
>>>>             `DrbdOptions/auto-unplace` is set
>>>>              * Added error-report deletion API
>>>>              * Expose DRBD promotion_score and may_promote via
>>>>             REST-API and server sent events
>>>>              * Prometheus metrics are now mostly cached and much
>>>>             faster to query
>>>>              * Send SD_NOTIFY READY to systemd if services are ready
>>>>              * OpenFlex resource are now correctly limited to 32
>>>>             characters
>>>>              * Fix etcd modify net-interface (incorrect serialization)
>>>>              * Fix autoplacer also toggling diskless resources
>>>>              * Fix snapshot-shipping with more than 1 volume
>>>>             definitions
>>>>              * Fix zfs create options handling
>>>>              * Fixed recaching of lvm-filter
>>>>              * Fix missing client answer if drbd device doesn't
>>>>             become ready in reasonable time
>>>>              * REST-API v1.4.0
>>>>
>>>>             https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz
>>>>             <https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz>
>>>>
>>>>             Linstor PPA:
>>>>             https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack
>>>>             <https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack>
>>>>
>>>>             Cheers,
>>>>             Rene
>>>>
>>>>             _______________________________________________
>>>>             Star us on GITHUB:https://github.com/LINBIT  <https://github.com/LINBIT>
>>>>             drbd-user mailing list
>>>>             drbd-user at lists.linbit.com  <mailto:drbd-user at lists.linbit.com>
>>>>             https://lists.linbit.com/mailman/listinfo/drbd-user  <https://lists.linbit.com/mailman/listinfo/drbd-user>
>>>             _______________________________________________
>>>             Star us on GITHUB: https://github.com/LINBIT
>>>             <https://github.com/LINBIT>
>>>             drbd-user mailing list
>>>             drbd-user at lists.linbit.com
>>>             <mailto:drbd-user at lists.linbit.com>
>>>             https://lists.linbit.com/mailman/listinfo/drbd-user
>>>             <https://lists.linbit.com/mailman/listinfo/drbd-user>
>>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linbit.com/pipermail/drbd-user/attachments/20200925/2697a974/attachment-0001.htm>


More information about the drbd-user mailing list