Comments (18)
cockroach-teamcity
commented on September 18, 2024
cli.TestLossOfQuorumRecovery failed on master @ 93ad913106b6f0f6ec98bc2cfa788ff6d8085bd4:
=== RUN TestLossOfQuorumRecovery
test_log_scope.go:170: test logs captured to: outputs.zip/logTestLossOfQuorumRecovery490737238
test_log_scope.go:81: use -show-logs to present logs inline
debug recover collect-info --store=/var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1020529722/store-1 /var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1020529722/node-1.json
[debug recover collect-info --store=/var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1020529722/store-1 /var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1020529722/node-1.json]
ERROR: failed to collect replica info from local stores: key /Local/RangeID/1/r/RangeGCThreshold does not have /Local/Range prefix
[debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1020529722/recovery-plan.json /var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1020529722/node-1.json]
debug_recover_loss_of_quorum_test.go:238:
Error Trace: github.com/cockroachdb/cockroach/pkg/cli/debug_recover_loss_of_quorum_test.go:238
Error: "debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1020529722/recovery-plan.json /var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1020529722/node-1.json\nERROR: failed to read replica info file \"/var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1020529722/node-1.json\": open /var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1020529722/node-1.json: no such file or directory\n" does not contain "- node n1"
Test: TestLossOfQuorumRecovery
Messages: planner didn't provide correct apply instructions
panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestLossOfQuorumRecovery490737238
--- FAIL: TestLossOfQuorumRecovery (43.28s)
Parameters:
attempt=1race=truerun=1shard=12
This test on roachdash | Improve this report!
from cockroach.
cockroach-teamcity
commented on September 18, 2024
cli.TestLossOfQuorumRecovery failed on master @ e4d744226f47e37b9179632711067277b2b0ab80:
=== RUN TestLossOfQuorumRecovery
test_log_scope.go:170: test logs captured to: outputs.zip/logTestLossOfQuorumRecovery2006475443
test_log_scope.go:81: use -show-logs to present logs inline
[debug recover collect-info --store=/var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery2206972140/store-1 /var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery2206972140/node-1.json]
debug recover collect-info --store=/var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery2206972140/store-1 /var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery2206972140/node-1.json
ERROR: failed to collect replica info from local stores: key /Local/RangeID/1/r/RangeGCThreshold does not have /Local/Range prefix
[debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery2206972140/recovery-plan.json /var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery2206972140/node-1.json]
debug_recover_loss_of_quorum_test.go:238:
Error Trace: github.com/cockroachdb/cockroach/pkg/cli/debug_recover_loss_of_quorum_test.go:238
Error: "debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery2206972140/recovery-plan.json /var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery2206972140/node-1.json\nERROR: failed to read replica info file \"/var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery2206972140/node-1.json\": open /var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery2206972140/node-1.json: no such file or directory\n" does not contain "- node n1"
Test: TestLossOfQuorumRecovery
Messages: planner didn't provide correct apply instructions
panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestLossOfQuorumRecovery2006475443
--- FAIL: TestLossOfQuorumRecovery (56.42s)
Parameters:
attempt=1race=truerun=2shard=12
This test on roachdash | Improve this report!
from cockroach.
kvoli
commented on September 18, 2024
The test is getting tripped up finding the node-1.json file.
/var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery2206972140/node-1.json: no such file or directory
This reproduces on the first attempt with --race.
from cockroach.
cockroach-teamcity
commented on September 18, 2024
cli.TestLossOfQuorumRecovery failed on master @ d146ecff6f687e438706cf63591cafca60cc116d:
=== RUN TestLossOfQuorumRecovery
test_log_scope.go:170: test logs captured to: outputs.zip/logTestLossOfQuorumRecovery1679014351
test_log_scope.go:81: use -show-logs to present logs inline
debug recover collect-info --store=/var/lib/engflow/worker/work/2/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery688954486/store-1 /var/lib/engflow/worker/work/2/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery688954486/node-1.json
[debug recover collect-info --store=/var/lib/engflow/worker/work/2/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery688954486/store-1 /var/lib/engflow/worker/work/2/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery688954486/node-1.json]
ERROR: failed to collect replica info from local stores: key /Local/RangeID/1/r/RangeGCThreshold does not have /Local/Range prefix
[debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/2/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery688954486/recovery-plan.json /var/lib/engflow/worker/work/2/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery688954486/node-1.json]
debug_recover_loss_of_quorum_test.go:238:
Error Trace: github.com/cockroachdb/cockroach/pkg/cli/debug_recover_loss_of_quorum_test.go:238
Error: "debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/2/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery688954486/recovery-plan.json /var/lib/engflow/worker/work/2/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery688954486/node-1.json\nERROR: failed to read replica info file \"/var/lib/engflow/worker/work/2/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery688954486/node-1.json\": open /var/lib/engflow/worker/work/2/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery688954486/node-1.json: no such file or directory\n" does not contain "- node n1"
Test: TestLossOfQuorumRecovery
Messages: planner didn't provide correct apply instructions
panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestLossOfQuorumRecovery1679014351
--- FAIL: TestLossOfQuorumRecovery (62.28s)
Parameters:
attempt=1race=truerun=1shard=12
This test on roachdash | Improve this report!
from cockroach.
cockroach-teamcity
commented on September 18, 2024
cli.TestLossOfQuorumRecovery failed on master @ 74d5e3e8021e53d27d823ef7f8694d59df8c3414:
=== RUN TestLossOfQuorumRecovery
test_log_scope.go:170: test logs captured to: outputs.zip/logTestLossOfQuorumRecovery2381170779
test_log_scope.go:81: use -show-logs to present logs inline
[debug recover collect-info --store=/var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery398467435/store-1 /var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery398467435/node-1.json]
debug recover collect-info --store=/var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery398467435/store-1 /var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery398467435/node-1.json
ERROR: failed to collect replica info from local stores: key /Local/RangeID/1/r/RangeGCThreshold does not have /Local/Range prefix
[debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery398467435/recovery-plan.json /var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery398467435/node-1.json]
debug_recover_loss_of_quorum_test.go:238:
Error Trace: github.com/cockroachdb/cockroach/pkg/cli/debug_recover_loss_of_quorum_test.go:238
Error: "debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery398467435/recovery-plan.json /var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery398467435/node-1.json\nERROR: failed to read replica info file \"/var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery398467435/node-1.json\": open /var/lib/engflow/worker/work/3/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery398467435/node-1.json: no such file or directory\n" does not contain "- node n1"
Test: TestLossOfQuorumRecovery
Messages: planner didn't provide correct apply instructions
panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestLossOfQuorumRecovery2381170779
--- FAIL: TestLossOfQuorumRecovery (32.37s)
Parameters:
attempt=1race=truerun=2shard=12
This test on roachdash | Improve this report!
from cockroach.
cockroach-teamcity
commented on September 18, 2024
cli.TestLossOfQuorumRecovery failed on master @ b5081e997adaf5950c9b85dfb6655f226bf16d29:
=== RUN TestLossOfQuorumRecovery
test_log_scope.go:170: test logs captured to: outputs.zip/logTestLossOfQuorumRecovery3497700717
test_log_scope.go:81: use -show-logs to present logs inline
[debug recover collect-info --store=/var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3913649780/store-1 /var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3913649780/node-1.json]
debug recover collect-info --store=/var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3913649780/store-1 /var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3913649780/node-1.json
ERROR: failed to collect replica info from local stores: key /Local/RangeID/1/r/RangeGCThreshold does not have /Local/Range prefix
[debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3913649780/recovery-plan.json /var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3913649780/node-1.json]
debug_recover_loss_of_quorum_test.go:238:
Error Trace: github.com/cockroachdb/cockroach/pkg/cli/debug_recover_loss_of_quorum_test.go:238
Error: "debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3913649780/recovery-plan.json /var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3913649780/node-1.json\nERROR: failed to read replica info file \"/var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3913649780/node-1.json\": open /var/lib/engflow/worker/work/1/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3913649780/node-1.json: no such file or directory\n" does not contain "- node n1"
Test: TestLossOfQuorumRecovery
Messages: planner didn't provide correct apply instructions
panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestLossOfQuorumRecovery3497700717
--- FAIL: TestLossOfQuorumRecovery (43.35s)
Parameters:
attempt=1race=truerun=1shard=12
This test on roachdash | Improve this report!
from cockroach.
cockroach-teamcity
commented on September 18, 2024
cli.TestLossOfQuorumRecovery failed on master @ e999ede1ed2bc87b34e01eedba1da58e09b8c4d3:
=== RUN TestLossOfQuorumRecovery
test_log_scope.go:170: test logs captured to: outputs.zip/logTestLossOfQuorumRecovery2040517784
test_log_scope.go:81: use -show-logs to present logs inline
debug recover collect-info --store=/var/lib/engflow/worker/work/0/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery543497606/store-1 /var/lib/engflow/worker/work/0/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery543497606/node-1.json
[debug recover collect-info --store=/var/lib/engflow/worker/work/0/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery543497606/store-1 /var/lib/engflow/worker/work/0/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery543497606/node-1.json]
ERROR: failed to collect replica info from local stores: key /Local/RangeID/1/r/RangeGCThreshold does not have /Local/Range prefix
[debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/0/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery543497606/recovery-plan.json /var/lib/engflow/worker/work/0/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery543497606/node-1.json]
debug_recover_loss_of_quorum_test.go:238:
Error Trace: github.com/cockroachdb/cockroach/pkg/cli/debug_recover_loss_of_quorum_test.go:238
Error: "debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/0/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery543497606/recovery-plan.json /var/lib/engflow/worker/work/0/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery543497606/node-1.json\nERROR: failed to read replica info file \"/var/lib/engflow/worker/work/0/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery543497606/node-1.json\": open /var/lib/engflow/worker/work/0/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery543497606/node-1.json: no such file or directory\n" does not contain "- node n1"
Test: TestLossOfQuorumRecovery
Messages: planner didn't provide correct apply instructions
panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestLossOfQuorumRecovery2040517784
--- FAIL: TestLossOfQuorumRecovery (52.57s)
Parameters:
attempt=1race=truerun=2shard=12
This test on roachdash | Improve this report!
from cockroach.
cockroach-teamcity
commented on September 18, 2024
cli.TestLossOfQuorumRecovery failed on master @ 0ea8b622c5354a891cfb867d8d872a0746ba77b3:
=== RUN TestLossOfQuorumRecovery
test_log_scope.go:170: test logs captured to: outputs.zip/logTestLossOfQuorumRecovery2410259060
test_log_scope.go:81: use -show-logs to present logs inline
[debug recover collect-info --store=/var/lib/engflow/worker/work/0/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2708355366/store-1 /var/lib/engflow/worker/work/0/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2708355366/node-1.json]
debug recover collect-info --store=/var/lib/engflow/worker/work/0/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2708355366/store-1 /var/lib/engflow/worker/work/0/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2708355366/node-1.json
ERROR: failed to collect replica info from local stores: key /Local/RangeID/1/r/RangeGCThreshold does not have /Local/Range prefix
[debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/0/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2708355366/recovery-plan.json /var/lib/engflow/worker/work/0/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2708355366/node-1.json]
debug_recover_loss_of_quorum_test.go:238:
Error Trace: github.com/cockroachdb/cockroach/pkg/cli/debug_recover_loss_of_quorum_test.go:238
Error: "debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/0/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2708355366/recovery-plan.json /var/lib/engflow/worker/work/0/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2708355366/node-1.json\nERROR: failed to read replica info file \"/var/lib/engflow/worker/work/0/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2708355366/node-1.json\": open /var/lib/engflow/worker/work/0/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2708355366/node-1.json: no such file or directory\n" does not contain "- node n1"
Test: TestLossOfQuorumRecovery
Messages: planner didn't provide correct apply instructions
panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestLossOfQuorumRecovery2410259060
--- FAIL: TestLossOfQuorumRecovery (32.12s)
Parameters:
attempt=1race=truerun=1shard=12
This test on roachdash | Improve this report!
from cockroach.
cockroach-teamcity
commented on September 18, 2024
cli.TestLossOfQuorumRecovery failed on master @ 46b6fab1cbc3c25229f0487711f9a5210ed6fb31:
=== RUN TestLossOfQuorumRecovery
test_log_scope.go:170: test logs captured to: outputs.zip/logTestLossOfQuorumRecovery1387788284
test_log_scope.go:81: use -show-logs to present logs inline
[debug recover collect-info --store=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2373033329/store-1 /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2373033329/node-1.json]
debug recover collect-info --store=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2373033329/store-1 /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2373033329/node-1.json
ERROR: failed to collect replica info from local stores: key /Local/RangeID/1/r/RangeGCThreshold does not have /Local/Range prefix
[debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2373033329/recovery-plan.json /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2373033329/node-1.json]
debug_recover_loss_of_quorum_test.go:238:
Error Trace: github.com/cockroachdb/cockroach/pkg/cli/debug_recover_loss_of_quorum_test.go:238
Error: "debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2373033329/recovery-plan.json /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2373033329/node-1.json\nERROR: failed to read replica info file \"/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2373033329/node-1.json\": open /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2373033329/node-1.json: no such file or directory\n" does not contain "- node n1"
Test: TestLossOfQuorumRecovery
Messages: planner didn't provide correct apply instructions
panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestLossOfQuorumRecovery1387788284
--- FAIL: TestLossOfQuorumRecovery (53.47s)
Parameters:
attempt=1race=truerun=1shard=12
This test on roachdash | Improve this report!
from cockroach.
cockroach-teamcity
commented on September 18, 2024
cli.TestLossOfQuorumRecovery failed on master @ d5f825ce04362a75781b75e19cf429f2ed5ed61b:
=== RUN TestLossOfQuorumRecovery
test_log_scope.go:170: test logs captured to: outputs.zip/logTestLossOfQuorumRecovery1084667291
test_log_scope.go:81: use -show-logs to present logs inline
[debug recover collect-info --store=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1754731743/store-1 /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1754731743/node-1.json]
debug recover collect-info --store=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1754731743/store-1 /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1754731743/node-1.json
ERROR: failed to collect replica info from local stores: key /Local/RangeID/1/r/RangeGCThreshold does not have /Local/Range prefix
[debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1754731743/recovery-plan.json /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1754731743/node-1.json]
debug_recover_loss_of_quorum_test.go:238:
Error Trace: github.com/cockroachdb/cockroach/pkg/cli/debug_recover_loss_of_quorum_test.go:238
Error: "debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1754731743/recovery-plan.json /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1754731743/node-1.json\nERROR: failed to read replica info file \"/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1754731743/node-1.json\": open /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery1754731743/node-1.json: no such file or directory\n" does not contain "- node n1"
Test: TestLossOfQuorumRecovery
Messages: planner didn't provide correct apply instructions
panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestLossOfQuorumRecovery1084667291
--- FAIL: TestLossOfQuorumRecovery (55.07s)
Parameters:
attempt=1race=truerun=1shard=12
This test on roachdash | Improve this report!
from cockroach.
cockroach-teamcity
commented on September 18, 2024
cli.TestLossOfQuorumRecovery failed on master @ e5f5597b1c1570fff03ee6dfd4a1e8be65c0e008:
=== RUN TestLossOfQuorumRecovery
test_log_scope.go:170: test logs captured to: outputs.zip/logTestLossOfQuorumRecovery4072590901
test_log_scope.go:81: use -show-logs to present logs inline
debug recover collect-info --store=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2276823754/store-1 /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2276823754/node-1.json
[debug recover collect-info --store=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2276823754/store-1 /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2276823754/node-1.json]
ERROR: failed to collect replica info from local stores: key /Local/RangeID/1/r/RangeGCThreshold does not have /Local/Range prefix
[debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2276823754/recovery-plan.json /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2276823754/node-1.json]
debug_recover_loss_of_quorum_test.go:238:
Error Trace: github.com/cockroachdb/cockroach/pkg/cli/debug_recover_loss_of_quorum_test.go:238
Error: "debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2276823754/recovery-plan.json /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2276823754/node-1.json\nERROR: failed to read replica info file \"/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2276823754/node-1.json\": open /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery2276823754/node-1.json: no such file or directory\n" does not contain "- node n1"
Test: TestLossOfQuorumRecovery
Messages: planner didn't provide correct apply instructions
panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestLossOfQuorumRecovery4072590901
--- FAIL: TestLossOfQuorumRecovery (32.33s)
Parameters:
attempt=1race=truerun=1shard=12
This test on roachdash | Improve this report!
from cockroach.
miraradeva
commented on September 18, 2024
Duplicate of #124396.
from cockroach.
cockroach-teamcity
commented on September 18, 2024
cli.TestLossOfQuorumRecovery failed on master @ 64bd4bbac8f8d27a2fe4968404cc3d048480375f:
=== RUN TestLossOfQuorumRecovery
test_log_scope.go:170: test logs captured to: outputs.zip/logTestLossOfQuorumRecovery628676283
test_log_scope.go:81: use -show-logs to present logs inline
[debug recover collect-info --store=/var/lib/engflow/worker/work/3/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery905773074/store-1 /var/lib/engflow/worker/work/3/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery905773074/node-1.json]
debug recover collect-info --store=/var/lib/engflow/worker/work/3/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery905773074/store-1 /var/lib/engflow/worker/work/3/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery905773074/node-1.json
ERROR: failed to collect replica info from local stores: key /Local/RangeID/1/r/RangeGCThreshold does not have /Local/Range prefix
[debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/3/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery905773074/recovery-plan.json /var/lib/engflow/worker/work/3/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery905773074/node-1.json]
debug_recover_loss_of_quorum_test.go:238:
Error Trace: github.com/cockroachdb/cockroach/pkg/cli/debug_recover_loss_of_quorum_test.go:238
Error: "debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/3/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery905773074/recovery-plan.json /var/lib/engflow/worker/work/3/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery905773074/node-1.json\nERROR: failed to read replica info file \"/var/lib/engflow/worker/work/3/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery905773074/node-1.json\": open /var/lib/engflow/worker/work/3/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery905773074/node-1.json: no such file or directory\n" does not contain "- node n1"
Test: TestLossOfQuorumRecovery
Messages: planner didn't provide correct apply instructions
panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestLossOfQuorumRecovery628676283
--- FAIL: TestLossOfQuorumRecovery (53.52s)
Parameters:
attempt=1race=truerun=3shard=12
This test on roachdash | Improve this report!
from cockroach.
cockroach-teamcity
commented on September 18, 2024
cli.TestLossOfQuorumRecovery failed on master @ a21a5fc2c955415a5e1b44cf0d995e1048f667c9:
=== RUN TestLossOfQuorumRecovery
test_log_scope.go:170: test logs captured to: outputs.zip/logTestLossOfQuorumRecovery893642250
test_log_scope.go:81: use -show-logs to present logs inline
[debug recover collect-info --store=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3051545086/store-1 /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3051545086/node-1.json]
debug recover collect-info --store=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3051545086/store-1 /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3051545086/node-1.json
ERROR: failed to collect replica info from local stores: key /Local/RangeID/1/r/RangeGCThreshold does not have /Local/Range prefix
[debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3051545086/recovery-plan.json /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3051545086/node-1.json]
debug_recover_loss_of_quorum_test.go:238:
Error Trace: github.com/cockroachdb/cockroach/pkg/cli/debug_recover_loss_of_quorum_test.go:238
Error: "debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3051545086/recovery-plan.json /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3051545086/node-1.json\nERROR: failed to read replica info file \"/var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3051545086/node-1.json\": open /var/lib/engflow/worker/work/3/exec/_tmp/0ede0149c79dc299cd458e6d0ea4f601/TestLossOfQuorumRecovery3051545086/node-1.json: no such file or directory\n" does not contain "- node n1"
Test: TestLossOfQuorumRecovery
Messages: planner didn't provide correct apply instructions
panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestLossOfQuorumRecovery893642250
--- FAIL: TestLossOfQuorumRecovery (42.44s)
Parameters:
attempt=1race=truerun=1shard=12
This test on roachdash | Improve this report!
from cockroach.
cockroach-teamcity
commented on September 18, 2024
cli.TestLossOfQuorumRecovery failed on master @ c84a89569fab4cc4896a0234bec1e1822dd420d8:
=== RUN TestLossOfQuorumRecovery
test_log_scope.go:170: test logs captured to: outputs.zip/logTestLossOfQuorumRecovery3780743331
test_log_scope.go:81: use -show-logs to present logs inline
[debug recover collect-info --store=/var/lib/engflow/worker/work/1/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery3921904848/store-1 /var/lib/engflow/worker/work/1/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery3921904848/node-1.json]
debug recover collect-info --store=/var/lib/engflow/worker/work/1/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery3921904848/store-1 /var/lib/engflow/worker/work/1/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery3921904848/node-1.json
ERROR: failed to collect replica info from local stores: key /Local/RangeID/1/r/RangeGCThreshold does not have /Local/Range prefix
[debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/1/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery3921904848/recovery-plan.json /var/lib/engflow/worker/work/1/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery3921904848/node-1.json]
debug_recover_loss_of_quorum_test.go:238:
Error Trace: github.com/cockroachdb/cockroach/pkg/cli/debug_recover_loss_of_quorum_test.go:238
Error: "debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/1/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery3921904848/recovery-plan.json /var/lib/engflow/worker/work/1/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery3921904848/node-1.json\nERROR: failed to read replica info file \"/var/lib/engflow/worker/work/1/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery3921904848/node-1.json\": open /var/lib/engflow/worker/work/1/exec/_tmp/33cad9ecca6f841bff6186de727627fd/TestLossOfQuorumRecovery3921904848/node-1.json: no such file or directory\n" does not contain "- node n1"
Test: TestLossOfQuorumRecovery
Messages: planner didn't provide correct apply instructions
panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestLossOfQuorumRecovery3780743331
--- FAIL: TestLossOfQuorumRecovery (53.15s)
Parameters:
attempt=1race=truerun=2shard=12
This test on roachdash | Improve this report!
from cockroach.
cockroach-teamcity
commented on September 18, 2024
cli.TestLossOfQuorumRecovery failed on master @ 3d9eaa7939e4fb5aa0518ba7e19750a55c93cf11:
=== RUN TestLossOfQuorumRecovery
test_log_scope.go:170: test logs captured to: outputs.zip/logTestLossOfQuorumRecovery3216461640
test_log_scope.go:81: use -show-logs to present logs inline
[debug recover collect-info --store=/var/lib/engflow/worker/work/0/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery3077024577/store-1 /var/lib/engflow/worker/work/0/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery3077024577/node-1.json]
debug recover collect-info --store=/var/lib/engflow/worker/work/0/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery3077024577/store-1 /var/lib/engflow/worker/work/0/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery3077024577/node-1.json
ERROR: failed to collect replica info from local stores: key /Local/RangeID/1/r/RangeGCThreshold does not have /Local/Range prefix
[debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/0/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery3077024577/recovery-plan.json /var/lib/engflow/worker/work/0/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery3077024577/node-1.json]
debug_recover_loss_of_quorum_test.go:238:
Error Trace: github.com/cockroachdb/cockroach/pkg/cli/debug_recover_loss_of_quorum_test.go:238
Error: "debug recover make-plan --confirm=y --plan=/var/lib/engflow/worker/work/0/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery3077024577/recovery-plan.json /var/lib/engflow/worker/work/0/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery3077024577/node-1.json\nERROR: failed to read replica info file \"/var/lib/engflow/worker/work/0/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery3077024577/node-1.json\": open /var/lib/engflow/worker/work/0/exec/_tmp/ba24ddb5b5aa6d433fda6d631887a38c/TestLossOfQuorumRecovery3077024577/node-1.json: no such file or directory\n" does not contain "- node n1"
Test: TestLossOfQuorumRecovery
Messages: planner didn't provide correct apply instructions
panic.go:626: -- test log scope end --
test logs left over in: outputs.zip/logTestLossOfQuorumRecovery3216461640
--- FAIL: TestLossOfQuorumRecovery (42.59s)
Parameters:
attempt=1race=truerun=3shard=12
This test on roachdash | Improve this report!
from cockroach.
github-actions
commented on September 18, 2024
We have marked this test failure issue as stale because it has been
inactive for 1 month. If this failure is still relevant, removing the
stale label or adding a comment will keep it active. Otherwise,
we'll close it in 5 days to keep the test failure queue tidy.
from cockroach.
andrewbaptist
commented on September 18, 2024
Closing this out - It looks like it was fixed by #125094
from cockroach.
Related Issues (20)
- server: TestClusterConnectivity failed HOT 1
- roachtest: failover/chaos/read-write failed
- roachtest: perturbation/full/addNode failed HOT 1
- roachtest: perturbation/full/decommission failed HOT 1
- roachtest: perturbation/metamorphic/decommission failed
- roachtest: perturbation/full/partition failed
- roachtest: perturbation/full/backfill failed
- sql/catalog/lease: TestLeaseRenewedAutomatically failed
- : failed
- pkg/ccl/logictestccl/tests/3node-tenant/3node-tenant_test: TestTenantLogic_alter_table failed
- roachtest: backup-restore/online-restore failed
- ldap: Authorize users to CRDB
- ccl/crosscluster/logical: TestLWWConflictResolution failed
- roachtest: failover/non-system/deadlock failed HOT 1
- ccl/streamingccl/streamingest: TestTenantStreamingProducerJobTimedOut failed
- kv/kvserver: TestTxnReadWithinUncertaintyIntervalAfterLeaseTransfer failed HOT 1
- pkg/sql/logictest/tests/fakedist-vec-off/fakedist-vec-off_test: TestLogic_alter_table failed
- roachtest: perturbation/metamorphic/partition failed
- pkg/ccl/logictestccl/tests/local-read-committed/local-read-committed_test: TestReadCommittedLogic_zone_config_system_tenant failed
- pkg/ccl/logictestccl/tests/5node/5node_test_/5node_test_shard_4/5: pkg failed
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cockroach.