ccl/changefeedccl/schemafeed: TestDataDriven failed about cockroach

[cockroach-teamcity]

ccl/changefeedccl/schemafeed.TestDataDriven failed on master @ 934684d8134fd8bb34eae1a37f3aa83a4ac066b7:

Fatal error:

panic: test timed out after 24m57s
running tests:
	TestDataDriven (24m38s)
	TestDataDriven/add_column (24m38s)

Stack:

goroutine 337534187 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x385
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x2d

Log preceding fatal error

=== RUN   TestDataDriven/add_column
    test_server_shim.go:157: automatically injected a shared process virtual cluster under test; see comment at top of test_server_shim.go for details.
    table_event_filter_datadriven_test.go:105: exec
    datadriven.go:144: 
        /var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/changefeedccl/schemafeed/schemafeed_test_/schemafeed_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/changefeedccl/schemafeed/testdata/add_column:1:
        exec [0 args]
        CREATE TABLE t (i INT PRIMARY KEY)
        ----
    table_event_filter_datadriven_test.go:105: create
    datadriven.go:144: 
        /var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/changefeedccl/schemafeed/schemafeed_test_/schemafeed_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/changefeedccl/schemafeed/testdata/add_column:5:
        create [1 args]
        t
        ----
    table_event_filter_datadriven_test.go:105: exec
    datadriven.go:144: 
        /var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/changefeedccl/schemafeed/schemafeed_test_/schemafeed_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/changefeedccl/schemafeed/testdata/add_column:9:
        exec [0 args]
        ALTER TABLE t ADD COLUMN j INT;
        ----
    table_event_filter_datadriven_test.go:105: pop
    datadriven.go:144: 
        /var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/changefeedccl/schemafeed/schemafeed_test_/schemafeed_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/changefeedccl/schemafeed/testdata/add_column:13:
        pop [1 args]
        <no input to command>
        ----
        t 1->2: Unknown
        t 2->3: Unknown
        t 3->4: AddColumnNoBackfill
    table_event_filter_datadriven_test.go:105: exec
    datadriven.go:144: 
        /var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/changefeedccl/schemafeed/schemafeed_test_/schemafeed_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/changefeedccl/schemafeed/testdata/add_column:19:
        exec [0 args]
        ALTER TABLE t ADD COLUMN k INT DEFAULT 42;
        ----
    table_event_filter_datadriven_test.go:105: pop
    datadriven.go:144: 
        /var/lib/engflow/worker/work/1/exec/bazel-out/k8-fastbuild/bin/pkg/ccl/changefeedccl/schemafeed/schemafeed_test_/schemafeed_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/changefeedccl/schemafeed/testdata/add_column:23:
        pop [1 args]
        <no input to command>
        ----
        t 4->5: Unknown
        t 5->6: Unknown
        t 6->7: Unknown
        t 7->8: Unknown
        t 8->9: Unknown
        t 9->10: AddColumnWithBackfill|PrimaryKeyChange
        t 10->11: Unknown
        t 11->12: Unknown
    table_event_filter_datadriven_test.go:105: exec

Parameters:

• attempt=1
• deadlock=true
• run=3
• shard=1

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

[rickystewart]

Probable tenant upgrade deadlock problem internal discussion. Pro-actively closing.