linstor-satellite restart leads to linstor-controller overutillization about linstor-server

[ghernadi]

Please upgrade to at least 1.26.1 and see if this issue persists. In the said version we tried to fix a bug that could lead to such a behavior.

[ddpolyakov]

Updated at the 1.26.2 - the same behaviour

[ddpolyakov]

and the same thing using mysqld galera cluster as a database

[ddpolyakov]

switching back to H2 seems to resolve the problem

[ghernadi]

If this is reproducible and you are willing to test this further, can you trigger the controller into this state and poke it a few times with kill -3 <pid_of_controller_java_process> and get me an SOS report? kill -3 causes the JVM to print a thread-dump to its stdout (which is usually captured by journalctl, which is then collected via LINSTOR's SOS report). If possible, run the kill -3 a few times, so we have a chance to see what the Threads are doing.

Additionally you could also activate TRACE logging for the controller and then trigger this behavior. Feel free to send me the resulting SOS report to the email from my profile

[ddpolyakov]

Here is my sos-report - ive run kill -3 few times just after all satellites restart. The same picture - Controller ate all cpu