tugraph-family / tugraph-analytics Goto Github PK
View Code? Open in Web Editor NEWTuGraph Analytics is the fastest OLAP graph database.
Home Page: https://tugraph-analytics.github.io
License: Apache License 2.0
TuGraph Analytics is the fastest OLAP graph database.
Home Page: https://tugraph-analytics.github.io
License: Apache License 2.0
🌈 G6VP 现在支持与 Tugraph 协作实现流图作业可视化了!
G6VP now supports visualization of flow graph jobs in collaboration with Tugraph!
仅需 5 步,即可呈现 🎊 / Just 5 steps to present
参考 快速开始 | Reference Quick Start
启动SocketServer
步骤使用下列命令代替
bin/socket.sh 9003 GI
输出下列内容时,即表示 Tugraph Analytics 准备好建立连接
When the terminal outputs the following, Tugraph Analytics is ready to establish a connection.
如启动服务过程中遇到问题,可见 #1
If any problem occurs during service startup, see #1
进入新建画布,输入工作簿名称。我们会在后面手动添加点边数据,所以这里随便选择一个案例数据集即可,模版使用极简模版
Enter New Canvas, enter a workbook name. We will manually add the dot edge data later, so choose a case data set here, and use the minimalist template
我们需要添加两个组件,在工具栏中添加 清空画布;然后在默认布局的侧边容器中添加环路检测 Demo
We need to add two components, in the toolbar add Clean canvas; Then add Loop Detection Demo to the side container of the default layout
点击工具栏中的🧹清除
选项来清空画布节点
Click the '🧹 Clear' option in the toolbar to clear the canvas node
默认情况下,添加完环路检测Demo
组件后,会自动建立连接。
By default, a connection is automatically established after the Loop Detection Demo component is added.
Tugraph Analytics 端建立连接后同样会输出以下内容:
Tugraph Analytics will also output the following after the connection is established:
环路检测 Demo 提供了两种方式来进行交互 / Loop detection Demo provides two ways to interact
两种方式本质都是调用 Tugraph Analytics 进行实时计算,不过方式二省略了手动输入过程。
Both methods essentially call Tugraph Analytics for real-time calculations, but Method 2 omits the manual input process.
这里我们使用内置数据进行快速演示,点击【选项】,选择添加点
,画布中出现了 7 个点信息;接着选择添加边
。我们可以在上方对话框中看到添加记录。
Here we use the built-in data for a quick demonstration, click [Options], select 'Add Points', 7 points of information appear in the canvas; Then select 'Add Edges'. We can see the add record in the above dialog.
同样的,Tugraph Analytics 终端也会实时输出操作信息,并自动启动计算任务。
Similarly, the Tugraph Analytics terminal outputs operational information in real time and automatically starts computation tasks.
Tugraph Analytics 完成环路检测计算任务后,会自动返回检测结果。
After the loop detection calculation task is completed, Tugraph Analytics automatically returns the detection results.
右侧画布中会动态显示出本次环路检测结果信息:
The loop detection results are dynamically displayed on the right canvas:
Currently GeaFlow have support hive 2.3.x version. Please support hive 3.x version based on the HiveVersionAdapter.
目前TuGraph-Analytics支持了ISO/GQL语言,参考ISO/GQL的实现方式,实现基础Gremlin语法。
较难
DSL原理介绍:https://github.com/TuGraph-family/tugraph-analytics/blob/master/docs/docs-cn/principle/dsl_principle.md
Gremlin语法:https://tinkerpop.apache.org/gremlin.html
TuGraph-Analytics是一个流式计算引擎,目前支持Kafka/File/Hive等多种数据源接入. Apache Pulsar是
一个开源的流式消息系统, 在TuGraph-Analytics中实现一个Pulsar的Connector插件。
一般
Remove the duplicate pom property config in the pom file.
KafkaTableSource invoke DateTimeUtil.toUnixTime code,The first parameter uses format, and the second parameter is startTimeStr,The parameter order is reversed
final String startTimeStr = tableConf.getString(ConnectorConfigKeys.GEAFLOW_DSL_START_TIME,
(String) ConnectorConfigKeys.GEAFLOW_DSL_START_TIME.getDefaultValue());
if (startTimeStr.equalsIgnoreCase(KafkaConstants.KAFKA_BEGIN)) {
startTime = 0;
} else {
startTime = DateTimeUtil.toUnixTime(ConnectorConstants.START_TIME_FORMAT, startTimeStr);
}
DateTimeUtil. toUnixTime Definition
public static int toUnixTime(String dateStr, String format) {
if (dateStr == null || dateStr.isEmpty()) {
return -1;
} else {
DateTimeFormatter dateTimeFormat = DateTimeFormat.forPattern(format);
return (int) (dateTimeFormat.parseMillis(dateStr) / 1000);
}
}
Problem:
geaflow-console use 8888 and 8080 port but can't be changed, to avoid port conflict, port configuration is needed.
Solution:
geaflow.web.port
and geaflow.gateway.port
by docker container environment variables..env
file before yarn start
.Exception in thread "rpc-executor-1" com.antgroup.geaflow.common.exception.GeaflowRuntimeException:
************
ERR_ID:
RUN-00000002
CAUSE:
Run error: rocksdb chk error
ACTION:
Please check your code, or contact admin.
DETAIL:
************
at com.antgroup.geaflow.store.rocksdb.RocksdbClient.checkpoint(RocksdbClient.java:142)
at com.antgroup.geaflow.store.rocksdb.BaseRocksdbStore.archive(BaseRocksdbStore.java:75)
at com.antgroup.geaflow.cluster.system.RocksdbClusterMetaKVStore.flush(RocksdbClusterMetaKVStore.java:54)
at com.antgroup.geaflow.cluster.system.ClusterMetaStore.flush(ClusterMetaStore.java:158)
at com.antgroup.geaflow.cluster.resourcemanager.DefaultResourceManager.persist(DefaultResourceManager.java:288)
at com.antgroup.geaflow.cluster.resourcemanager.DefaultResourceManager.onRegister(DefaultResourceManager.java:252)
at com.antgroup.geaflow.cluster.resourcemanager.DefaultResourceManager.lambda$onSuccess$2(DefaultResourceManager.java:201)
at com.antgroup.geaflow.cluster.resourcemanager.DefaultResourceManager.withLock(DefaultResourceManager.java:276)
at com.antgroup.geaflow.cluster.resourcemanager.DefaultResourceManager.onSuccess(DefaultResourceManager.java:194)
at com.antgroup.geaflow.cluster.clustermanager.AbstractClusterManager.handleRegisterResponse(AbstractClusterManager.java:190)
at com.antgroup.geaflow.cluster.clustermanager.AbstractClusterManager.access$000(AbstractClusterManager.java:47)
at com.antgroup.geaflow.cluster.clustermanager.AbstractClusterManager$1.onSuccess(AbstractClusterManager.java:160)
at com.antgroup.geaflow.cluster.clustermanager.AbstractClusterManager$1.onSuccess(AbstractClusterManager.java:152)
at com.antgroup.geaflow.cluster.rpc.impl.AbstractRpcEndpointRef$1.onSuccess(AbstractRpcEndpointRef.java:75)
at com.google.common.util.concurrent.Futures$4.run(Futures.java:1132)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Caused by: org.rocksdb.RocksDBException: While open a file for appending: /tmp/geaflow1686752263277105350/framework/cluster/geaflow1686752263277105350-1686799890038/0_chk1.tmp/CURRENT: No such file or directory
at org.rocksdb.Checkpoint.createCheckpoint(Native Method)
at org.rocksdb.Checkpoint.createCheckpoint(Checkpoint.java:51)
at com.antgroup.geaflow.store.rocksdb.RocksdbClient.checkpoint(RocksdbClient.java:140)
... 17 more
2023-06-15 03:31:33 ERROR Driver:135 - driver exception
com.antgroup.geaflow.common.exception.GeaflowRuntimeException:
************
ERR_ID:
RUN-00000002
CAUSE:
Run error: rocksdb chk error
ACTION:
Please check your code, or contact admin.
DETAIL:
************
at com.antgroup.geaflow.store.rocksdb.RocksdbClient.checkpoint(RocksdbClient.java:142) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.store.rocksdb.BaseRocksdbStore.archive(BaseRocksdbStore.java:75) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.system.RocksdbClusterMetaKVStore.flush(RocksdbClusterMetaKVStore.java:54) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.system.ClusterMetaStore.flush(ClusterMetaStore.java:158) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.driver.DriverContext$PipelineCheckpointFunction.doCheckpoint(DriverContext.java:85) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.common.ReliableContainerContext.checkpoint(ReliableContainerContext.java:45) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.driver.Driver.executePipelineInternal(Driver.java:108) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.driver.Driver.lambda$executePipeline$1(Driver.java:96) ~[geaflow-geaflow.jar:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
Caused by: org.rocksdb.RocksDBException: while link file to /tmp/geaflow1686752263277105350/framework/cluster/geaflow1686752263277105350-1686799890038/0_chk1.tmp/000011.sst: /tmp/geaflow1686752263277105350/framework/cluster/geaflow1686752263277105350-1686799890038/0/000011.sst: File exists
at org.rocksdb.Checkpoint.createCheckpoint(Native Method) ~[geaflow-geaflow.jar:?]
at org.rocksdb.Checkpoint.createCheckpoint(Checkpoint.java:51) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.store.rocksdb.RocksdbClient.checkpoint(RocksdbClient.java:140) ~[geaflow-geaflow.jar:?]
... 11 more
2023-06-15 03:31:33 ERROR DriverEndpoint:51 - execute pipeline failed: java.util.concurrent.ExecutionException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException:
************
ERR_ID:
RUN-00000002
CAUSE:
Run error: rocksdb chk error
ACTION:
Please check your code, or contact admin.
DETAIL:
************
com.antgroup.geaflow.common.exception.GeaflowRuntimeException: java.util.concurrent.ExecutionException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException:
************
ERR_ID:
RUN-00000002
CAUSE:
Run error: rocksdb chk error
ACTION:
Please check your code, or contact admin.
DETAIL:
************
at com.antgroup.geaflow.cluster.driver.Driver.executePipeline(Driver.java:100) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.driver.Driver.executePipeline(Driver.java:46) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.impl.DriverEndpoint.executePipeline(DriverEndpoint.java:45) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.rpc.proto.DriverServiceGrpc$MethodHandlers.invoke(DriverServiceGrpc.java:266) [geaflow-geaflow.jar:?]
at io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171) [geaflow-geaflow.jar:?]
at io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283) [geaflow-geaflow.jar:?]
at io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707) [geaflow-geaflow.jar:?]
at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37) [geaflow-geaflow.jar:?]
at io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123) [geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
Caused by: java.util.concurrent.ExecutionException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException:
************
ERR_ID:
RUN-00000002
CAUSE:
Run error: rocksdb chk error
ACTION:
Please check your code, or contact admin.
DETAIL:
************
at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[?:1.8.0_372]
at java.util.concurrent.FutureTask.get(FutureTask.java:192) ~[?:1.8.0_372]
at com.antgroup.geaflow.cluster.driver.Driver.executePipeline(Driver.java:98) ~[geaflow-geaflow.jar:?]
... 11 more
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException:
************
ERR_ID:
RUN-00000002
CAUSE:
Run error: rocksdb chk error
ACTION:
Please check your code, or contact admin.
DETAIL:
************
at com.antgroup.geaflow.store.rocksdb.RocksdbClient.checkpoint(RocksdbClient.java:142) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.store.rocksdb.BaseRocksdbStore.archive(BaseRocksdbStore.java:75) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.system.RocksdbClusterMetaKVStore.flush(RocksdbClusterMetaKVStore.java:54) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.system.ClusterMetaStore.flush(ClusterMetaStore.java:158) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.driver.DriverContext$PipelineCheckpointFunction.doCheckpoint(DriverContext.java:85) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.common.ReliableContainerContext.checkpoint(ReliableContainerContext.java:45) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.driver.Driver.executePipelineInternal(Driver.java:108) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.driver.Driver.lambda$executePipeline$1(Driver.java:96) ~[geaflow-geaflow.jar:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_372]
... 3 more
Caused by: org.rocksdb.RocksDBException: while link file to /tmp/geaflow1686752263277105350/framework/cluster/geaflow1686752263277105350-1686799890038/0_chk1.tmp/000011.sst: /tmp/geaflow1686752263277105350/framework/cluster/geaflow1686752263277105350-1686799890038/0/000011.sst: File exists
at org.rocksdb.Checkpoint.createCheckpoint(Native Method) ~[geaflow-geaflow.jar:?]
at org.rocksdb.Checkpoint.createCheckpoint(Checkpoint.java:51) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.store.rocksdb.RocksdbClient.checkpoint(RocksdbClient.java:140) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.store.rocksdb.BaseRocksdbStore.archive(BaseRocksdbStore.java:75) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.system.RocksdbClusterMetaKVStore.flush(RocksdbClusterMetaKVStore.java:54) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.system.ClusterMetaStore.flush(ClusterMetaStore.java:158) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.driver.DriverContext$PipelineCheckpointFunction.doCheckpoint(DriverContext.java:85) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.common.ReliableContainerContext.checkpoint(ReliableContainerContext.java:45) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.driver.Driver.executePipelineInternal(Driver.java:108) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.driver.Driver.lambda$executePipeline$1(Driver.java:96) ~[geaflow-geaflow.jar:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_372]
... 3 more
Exception in thread "main" io.grpc.StatusRuntimeException: UNKNOWN
at io.grpc.Status.asRuntimeException(Status.java:526)
at io.grpc.stub.ClientCalls$BlockingResponseStream.hasNext(ClientCalls.java:576)
at com.antgroup.geaflow.cluster.client.PipelineResult.isSuccess(PipelineResult.java:37)
at com.antgroup.geaflow.cluster.client.PipelineResult.get(PipelineResult.java:53)
at com.antgroup.geaflow.dsl.runtime.engine.GQLPipeLine.execute(GQLPipeLine.java:116)
at com.antgroup.geaflow.dsl.runtime.engine.GeaFlowGqlClient.main(GeaFlowGqlClient.java:56)
2023-06-15 03:31:33 WARN RpcServiceImpl:63 - *** shutting down gRPC server since JVM is shutting down
2023-06-15 03:31:33 WARN RpcServiceImpl:63 - *** shutting down gRPC server since JVM is shutting down
2023-06-15 03:31:33 WARN RpcServiceImpl:63 - *** shutting down gRPC server since JVM is shutting down
2023-06-15 03:31:33 WARN RpcServiceImpl:65 - *** server shut down
2023-06-15 03:31:33 WARN RpcServiceImpl:65 - *** server shut down
2023-06-15 03:31:33 WARN RpcServiceImpl:65 - *** server shut down
After implementing Prometheus metric reporting(issue#39 ), please integrate with the Console platform for display.
Support the elasticsearch connector which can write data to the elasticsearch.
Now the documents can only be viewed on the GitHub platform currently, but in fact, all the documents are written in markdown, which can be easily rendered using tools like 'mkdocs' and can be hosted on document hosting platforms like 'readthedocs'.
Problem:
FAILED
when completed, FINISHED
status is expected.Solution:
<task-id>.finish
) when task process exits with code 0.<task-id>.finish
existence when task process is not present.Problem:
user code in task page is readonly, to support fast dsl editing, navigation to job editor is need.
Solution:
1.add Dockerfile-arm for Geaflow image
2.update mysql version, reduce the size of the image: Geaflow-console-arm
The existing user-defined graph algorithm only supports algorithms for static graphs, and now it needs to be extended to dynamic graphs to continuously report the latest results of the UDGA as the graph continues to evolve.
Describe the bug
There are bugs in the built-in implementations of the PR and SSSP algorithms of UDGA.
Expected behavior
Fix the implementation of the built-in PR and SSSP algorithms.
Additional context
Add any other context about the problem here.
The existing DSL does not support BI tests in the LDBC test suite, and most of the tests have bugs. These DSL bugs need to be fixed to support the LDBC test suite.
基于quickStart 启动docker本地化部署
优化现有DSL图算法接口,输出类型接口支持感知输入图类型,优化现有图算法实现,同时实现新的图算法.
中
TuGraph-Analytics: https://github.com/TuGraph-family/tugraph-analytics
DSL自定义算法:https://github.com/TuGraph-family/tugraph-analytics/blob/master/docs/docs-cn/application-development/dsl/udf/udga.md
Describe the bug
A clear and concise description of what the bug is.
When follow https://github.com/TuGraph-family/tugraph-analytics/blob/master/docs/docs-cn/quick_start.md to compile in window, failed.
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[101,117] (whitespace) OperatorWrap: '+' 应另起一行。
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[102] (indentation) Indentation: 'method def' 子元素缩进了11个缩进符,应为12个。
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[103] (indentation) Indentation: 'method def rcurly' 缩进了3个缩进符,应为4个。
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[109] (javadoc) JavadocParagraph: 空行后应有 <p> 标签。
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[111] (javadoc) JavadocParagraph: 空行后应有 <p> 标签。
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[114] (indentation) Indentation: 'method def modifier' 缩进了3个缩进符,应为4个。
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[115] (indentation) Indentation: 'method def' 子元素缩进了6个缩进符,应为8个。
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[116] (indentation) Indentation: 'method def rcurly' 缩进了3个缩进符,应为4个。
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[122] (indentation) Indentation: 'ctor def modifier' 缩进了3个缩进符,应为4个。
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[123] (indentation) Indentation: 'ctor def rcurly' 缩进了3个缩进符,应为4个。
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[125] (indentation) Indentation: 'ctor def modifier' 缩进了3个缩进符,应为4个。
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[127] (indentation) Indentation: 'ctor def' 子元素缩进了6个缩进符,应为8个。
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[128] (indentation) Indentation: 'ctor def rcurly' 缩进了3个缩进符,应为4个。
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[130] (indentation) Indentation: 'ctor def modifier' 缩进了3个缩进符,应为4个。
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[130,33] (naming) ParameterName: Parameter name 'EOFSeen' must match pattern '^[a-z][a-z0-9]*[a-zA-Z0-9]*$'.
[WARNING] target\generated-sources\org\apache\calcite\sql\parser\impl\TokenMgrError.java:[132] (indentation) Indentation: 'ctor def rcurly' 缩进了3个缩进符,应为4个。
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for geaflow-parent 0.2-SNAPSHOT:
[INFO]
[INFO] geaflow-parent ..................................... SUCCESS [ 18.686 s]
[INFO] geaflow ............................................ SUCCESS [ 1.648 s]
[INFO] geaflow-common ..................................... SUCCESS [ 14.336 s]
[INFO] geaflow-model ...................................... SUCCESS [ 5.541 s]
[INFO] geaflow-utils ...................................... SUCCESS [ 12.125 s]
[INFO] geaflow-state ...................................... SUCCESS [ 0.463 s]
[INFO] geaflow-state-common ............................... SUCCESS [ 13.573 s]
[INFO] geaflow-metrics .................................... SUCCESS [ 0.334 s]
[INFO] geaflow-metrics-common ............................. SUCCESS [ 4.244 s]
[INFO] geaflow-state-api .................................. SUCCESS [ 3.429 s]
[INFO] geaflow-plugins .................................... SUCCESS [ 0.352 s]
[INFO] geaflow-store ...................................... SUCCESS [ 0.347 s]
[INFO] geaflow-store-api .................................. SUCCESS [ 3.032 s]
[INFO] geaflow-collection ................................. SUCCESS [ 6.214 s]
[INFO] geaflow-store-memory ............................... SUCCESS [ 7.097 s]
[INFO] geaflow-file ....................................... SUCCESS [ 0.381 s]
[INFO] geaflow-file-common ................................ SUCCESS [ 8.519 s]
[INFO] geaflow-file-dfs ................................... SUCCESS [ 8.249 s]
[INFO] geaflow-store-rocksdb .............................. SUCCESS [ 8.766 s]
[INFO] geaflow-state-strategy ............................. SUCCESS [ 5.602 s]
[INFO] geaflow-state-impl ................................. SUCCESS [ 7.466 s]
[INFO] geaflow-core ....................................... SUCCESS [ 0.344 s]
[INFO] geaflow-api ........................................ SUCCESS [ 6.847 s]
[INFO] geaflow-engine ..................................... SUCCESS [ 0.356 s]
[INFO] geaflow-rpc-proto .................................. SUCCESS [ 21.895 s]
[INFO] geaflow-core-common ................................ SUCCESS [ 3.187 s]
[INFO] geaflow-shuffle .................................... SUCCESS [ 8.905 s]
[INFO] geaflow-stats-metrics .............................. SUCCESS [ 4.055 s]
[INFO] geaflow-metrics-reporter ........................... SUCCESS [ 3.277 s]
[INFO] geaflow-metrics-slf4j .............................. SUCCESS [ 3.169 s]
[INFO] geaflow-store-redis ................................ SUCCESS [ 6.229 s]
[INFO] geaflow-store-jdbc ................................. SUCCESS [ 5.622 s]
[INFO] geaflow-highavailability ........................... SUCCESS [ 4.417 s]
[INFO] geaflow-cluster .................................... SUCCESS [ 11.491 s]
[INFO] geaflow-view-meta .................................. SUCCESS [ 4.525 s]
[INFO] geaflow-runtime .................................... SUCCESS [ 0.312 s]
[INFO] geaflow-operator ................................... SUCCESS [ 7.982 s]
[INFO] geaflow-pdata ...................................... SUCCESS [ 4.714 s]
[INFO] geaflow-runtime-common ............................. SUCCESS [ 3.061 s]
[INFO] geaflow-processor .................................. SUCCESS [ 5.058 s]
[INFO] geaflow-plan ....................................... SUCCESS [ 8.099 s]
[INFO] geaflow-runtime-core ............................... SUCCESS [ 10.618 s]
[INFO] geaflow-pipeline ................................... SUCCESS [ 3.237 s]
[INFO] geaflow-dsl ........................................ SUCCESS [ 0.311 s]
[INFO] geaflow-dsl-common ................................. SUCCESS [ 11.675 s]
[INFO] geaflow-dsl-parser ................................. FAILURE [01:46 min]
[INFO] geaflow-dsl-catalog ................................ SKIPPED
[INFO] geaflow-dsl-plan ................................... SKIPPED
[INFO] geaflow-dsl-connector .............................. SKIPPED
[INFO] geaflow-dsl-connector-api .......................... SKIPPED
[INFO] geaflow-dsl-connector-console ...................... SKIPPED
[INFO] geaflow-dsl-connector-file ......................... SKIPPED
[INFO] geaflow-dsl-connector-kafka ........................ SKIPPED
[INFO] geaflow-dsl-connector-hive ......................... SKIPPED
[INFO] geaflow-dsl-connector-socket ....................... SKIPPED
[INFO] geaflow-deploy ..................................... SKIPPED
[INFO] geaflow-on-local ................................... SKIPPED
[INFO] geaflow-dsl-runtime ................................ SKIPPED
[INFO] geaflow-on-ray ..................................... SKIPPED
[INFO] geaflow-examples ................................... SKIPPED
[INFO] geaflow-on-k8s ..................................... SKIPPED
[INFO] geaflow-metrics-influxdb ........................... SKIPPED
[INFO] geaflow-assembly ................................... SKIPPED
[INFO] geaflow-file-oss ................................... SKIPPED
[INFO] geaflow-console .................................... SKIPPED
[INFO] geaflow-console-common-util ........................ SKIPPED
[INFO] geaflow-console-common-dal ......................... SKIPPED
[INFO] geaflow-console-common-service-facade .............. SKIPPED
[INFO] geaflow-console-common-service-integration ......... SKIPPED
[INFO] geaflow-console-core-model ......................... SKIPPED
[INFO] geaflow-console-core-service ....................... SKIPPED
[INFO] geaflow-console-biz-shared ......................... SKIPPED
[INFO] geaflow-console-biz-service-impl ................... SKIPPED
[INFO] geaflow-console-web ................................ SKIPPED
[INFO] geaflow-console-bootstrap .......................... SKIPPED
[INFO] geaflow-console-test ............................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 06:25 min
[INFO] Finished at: 2023-06-20T14:28:18+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-checkstyle-plugin:2.17:check (validate) on project geaflow-dsl-parser: You have 66999 Checkstyle violations. -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <args> -rf :geaflow-dsl-parser
Expected behavior
A clear and concise description of what you expected to happen.
build success on win.
Additional context
Add any other context about the problem here.
It seems that because of checkstyle path error
Support jdbc connector which can read and write to the jdbc.
2023-06-20 14:23:10,004 ERROR scheduling-1 core.service.task.GeaflowTaskSubmitter:101 - Task ["1686902126697882985"] Submit Waiting Timeout
java.util.concurrent.TimeoutException: null
at java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1784) ~[?:1.8.0_372]
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1928) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.core.service.task.GeaflowTaskSubmitter.submit(GeaflowTaskSubmitter.java:98) ~[geaflow-console-core-service-0.1.jar!/:?]
at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source) ~[?:?]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) ~[spring-context-5.3.26.jar!/:5.3.26]
at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) ~[spring-context-5.3.26.jar!/:5.3.26]
at org.springframework.scheduling.concurrent.ReschedulingRunnable.run(ReschedulingRunnable.java:95) ~[spring-context-5.3.26.jar!/:5.3.26]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_372]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_372]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_372]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_372]
2023-06-20 14:23:51,446 ERROR pool-3-thread-11 common.util.exception.GeaflowLogException:24 - Start task 1686902126697882985 failed
com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687270930023-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:96) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.lambda$invoke$0(GeaflowInvocationHandler.java:43) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.LoaderSwitchUtil.call(LoaderSwitchUtil.java:38) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.invoke(GeaflowInvocationHandler.java:35) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.sun.proxy.$Proxy231.submitJob(Unknown Source) ~[?:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:86) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.start(K8sRuntime.java:55) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.task.GeaflowTaskOperator.start(GeaflowTaskOperator.java:100) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.task.GeaflowTaskSubmitter.lambda$submit$0(GeaflowTaskSubmitter.java:83) ~[geaflow-console-core-service-0.1.jar!/:?]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_372]
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687270930023-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:41) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.runWithRetries(GeaflowKubeClient.java:125) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.createPod(GeaflowKubeClient.java:104) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:93) ~[?:?]
... 16 more
Caused by: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687270930023-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.requestFailure(OperationSupport.java:639) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.assertResponseCode(OperationSupport.java:578) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:543) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:504) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleCreate(OperationSupport.java:292) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.handleCreate(BaseOperation.java:893) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.create(BaseOperation.java:372) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.create(BaseOperation.java:86) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.lambda$createPod$6(GeaflowKubeClient.java:101) ~[?:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.runWithRetries(GeaflowKubeClient.java:125) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.createPod(GeaflowKubeClient.java:104) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:93) ~[?:?]
... 16 more
2023-06-20 14:23:51,446 ERROR pool-3-thread-11 core.service.task.GeaflowTaskOperator:109 - Submit task 1686902126697882985 failed
com.antgroup.geaflow.console.common.util.exception.GeaflowLogException: Start task 1686902126697882985 failed
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:96) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.start(K8sRuntime.java:55) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.task.GeaflowTaskOperator.start(GeaflowTaskOperator.java:100) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.task.GeaflowTaskSubmitter.lambda$submit$0(GeaflowTaskSubmitter.java:83) ~[geaflow-console-core-service-0.1.jar!/:?]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_372]
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687270930023-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:96) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.lambda$invoke$0(GeaflowInvocationHandler.java:43) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.LoaderSwitchUtil.call(LoaderSwitchUtil.java:38) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.invoke(GeaflowInvocationHandler.java:35) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.sun.proxy.$Proxy231.submitJob(Unknown Source) ~[?:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:86) ~[geaflow-console-core-service-0.1.jar!/:?]
... 7 more
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687270930023-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:41) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.runWithRetries(GeaflowKubeClient.java:125) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.createPod(GeaflowKubeClient.java:104) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:93) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.lambda$invoke$0(GeaflowInvocationHandler.java:43) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.LoaderSwitchUtil.call(LoaderSwitchUtil.java:38) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.invoke(GeaflowInvocationHandler.java:35) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.sun.proxy.$Proxy231.submitJob(Unknown Source) ~[?:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:86) ~[geaflow-console-core-service-0.1.jar!/:?]
... 7 more
Caused by: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687270930023-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.requestFailure(OperationSupport.java:639) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.assertResponseCode(OperationSupport.java:578) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:543) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:504) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleCreate(OperationSupport.java:292) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.handleCreate(BaseOperation.java:893) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.create(BaseOperation.java:372) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.create(BaseOperation.java:86) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.lambda$createPod$6(GeaflowKubeClient.java:101) ~[?:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.runWithRetries(GeaflowKubeClient.java:125) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.createPod(GeaflowKubeClient.java:104) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:93) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.lambda$invoke$0(GeaflowInvocationHandler.java:43) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.LoaderSwitchUtil.call(LoaderSwitchUtil.java:38) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.invoke(GeaflowInvocationHandler.java:35) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.sun.proxy.$Proxy231.submitJob(Unknown Source) ~[?:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:86) ~[geaflow-console-core-service-0.1.jar!/:?]
... 7 more
2023-06-20 14:23:51,449 ERROR pool-3-thread-11 core.service.task.GeaflowTaskSubmitter:86 - task 1686902126697882985 submit error: Start task 1686902126697882985 failed
com.antgroup.geaflow.console.common.util.exception.GeaflowLogException: Start task 1686902126697882985 failed
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:96) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.start(K8sRuntime.java:55) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.task.GeaflowTaskOperator.start(GeaflowTaskOperator.java:100) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.task.GeaflowTaskSubmitter.lambda$submit$0(GeaflowTaskSubmitter.java:83) ~[geaflow-console-core-service-0.1.jar!/:?]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_372]
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687270930023-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:96) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.lambda$invoke$0(GeaflowInvocationHandler.java:43) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.LoaderSwitchUtil.call(LoaderSwitchUtil.java:38) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.invoke(GeaflowInvocationHandler.java:35) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.sun.proxy.$Proxy231.submitJob(Unknown Source) ~[?:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:86) ~[geaflow-console-core-service-0.1.jar!/:?]
... 7 more
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687270930023-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:41) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.runWithRetries(GeaflowKubeClient.java:125) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.createPod(GeaflowKubeClient.java:104) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:93) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.lambda$invoke$0(GeaflowInvocationHandler.java:43) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.LoaderSwitchUtil.call(LoaderSwitchUtil.java:38) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.invoke(GeaflowInvocationHandler.java:35) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.sun.proxy.$Proxy231.submitJob(Unknown Source) ~[?:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:86) ~[geaflow-console-core-service-0.1.jar!/:?]
... 7 more
Caused by: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687270930023-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687270930023-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.requestFailure(OperationSupport.java:639) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.assertResponseCode(OperationSupport.java:578) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:543) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:504) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleCreate(OperationSupport.java:292) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.handleCreate(BaseOperation.java:893) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.create(BaseOperation.java:372) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.create(BaseOperation.java:86) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.lambda$createPod$6(GeaflowKubeClient.java:101) ~[?:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.runWithRetries(GeaflowKubeClient.java:125) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.createPod(GeaflowKubeClient.java:104) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:93) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.lambda$invoke$0(GeaflowInvocationHandler.java:43) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.LoaderSwitchUtil.call(LoaderSwitchUtil.java:38) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.invoke(GeaflowInvocationHandler.java:35) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.sun.proxy.$Proxy231.submitJob(Unknown Source) ~[?:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:86) ~[geaflow-console-core-service-0.1.jar!/:?]
... 7 more
2023-06-20 14:31:50,010 INFO http-nio-8081-exec-10 core.service.file.RemoteFileStorage:73 - Start upload file, url=http://xxx:8081/api/tasks/%s/files?path=/tmp/geaflow/packages/1686898993810030898/release-20.zip
2023-06-20 14:31:50,011 INFO http-nio-8081-exec-10 core.service.file.RemoteFileStorage:75 - Upload success, url=http://xxx:8081/api/tasks/%s/files?path=/tmp/geaflow/packages/1686898993810030898/release-20.zip
2023-06-20 14:31:54,819 INFO http-nio-8081-exec-1 core.service.file.RemoteFileStorage:73 - Start upload file, url=http://xxx:8081/api/tasks/%s/files?path=/tmp/geaflow/packages/1686898993810030898/release-20.zip
2023-06-20 14:31:54,820 INFO http-nio-8081-exec-1 core.service.file.RemoteFileStorage:75 - Upload success, url=http://xxx:8081/api/tasks/%s/files?path=/tmp/geaflow/packages/1686898993810030898/release-20.zip
2023-06-20 14:31:54,821 WARN http-nio-8081-exec-1 common.dal.dao.ReleaseDao:179 - SqlSession [org.apache.ibatis.session.defaults.DefaultSqlSession@2bc8ded8] Transaction not enabled
2023-06-20 14:31:55,163 INFO http-nio-8081-exec-5 biz.shared.impl.TaskManagerImpl:146 - submit task successfully, waiting for scheduling. id: 1686902126697882985
2023-06-20 14:32:00,001 INFO scheduling-1 core.service.task.GeaflowTaskSubmitter:61 - task submitter start, task size: 1
2023-06-20 14:32:00,019 INFO pool-3-thread-12 core.service.task.GeaflowTaskSubmitter:75 - task 1686902126697882985 submit start, curr status: WAITING
2023-06-20 14:33:00,002 ERROR scheduling-1 core.service.task.GeaflowTaskSubmitter:101 - Task ["1686902126697882985"] Submit Waiting Timeout
java.util.concurrent.TimeoutException: null
at java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1784) ~[?:1.8.0_372]
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1928) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.core.service.task.GeaflowTaskSubmitter.submit(GeaflowTaskSubmitter.java:98) ~[geaflow-console-core-service-0.1.jar!/:?]
at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source) ~[?:?]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) ~[spring-context-5.3.26.jar!/:5.3.26]
at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) ~[spring-context-5.3.26.jar!/:5.3.26]
at org.springframework.scheduling.concurrent.ReschedulingRunnable.run(ReschedulingRunnable.java:95) ~[spring-context-5.3.26.jar!/:5.3.26]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_372]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_372]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_372]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_372]
2023-06-20 14:33:40,749 ERROR pool-3-thread-12 common.util.exception.GeaflowLogException:24 - Start task 1686902126697882985 failed
com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687271520022-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:96) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.lambda$invoke$0(GeaflowInvocationHandler.java:43) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.LoaderSwitchUtil.call(LoaderSwitchUtil.java:38) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.invoke(GeaflowInvocationHandler.java:35) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.sun.proxy.$Proxy231.submitJob(Unknown Source) ~[?:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:86) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.start(K8sRuntime.java:55) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.task.GeaflowTaskOperator.start(GeaflowTaskOperator.java:100) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.task.GeaflowTaskSubmitter.lambda$submit$0(GeaflowTaskSubmitter.java:83) ~[geaflow-console-core-service-0.1.jar!/:?]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_372]
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687271520022-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:41) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.runWithRetries(GeaflowKubeClient.java:125) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.createPod(GeaflowKubeClient.java:104) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:93) ~[?:?]
... 16 more
Caused by: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687271520022-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.requestFailure(OperationSupport.java:639) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.assertResponseCode(OperationSupport.java:578) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:543) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:504) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleCreate(OperationSupport.java:292) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.handleCreate(BaseOperation.java:893) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.create(BaseOperation.java:372) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.create(BaseOperation.java:86) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.lambda$createPod$6(GeaflowKubeClient.java:101) ~[?:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.runWithRetries(GeaflowKubeClient.java:125) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.createPod(GeaflowKubeClient.java:104) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:93) ~[?:?]
... 16 more
2023-06-20 14:33:40,749 ERROR pool-3-thread-12 core.service.task.GeaflowTaskOperator:109 - Submit task 1686902126697882985 failed
com.antgroup.geaflow.console.common.util.exception.GeaflowLogException: Start task 1686902126697882985 failed
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:96) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.start(K8sRuntime.java:55) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.task.GeaflowTaskOperator.start(GeaflowTaskOperator.java:100) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.task.GeaflowTaskSubmitter.lambda$submit$0(GeaflowTaskSubmitter.java:83) ~[geaflow-console-core-service-0.1.jar!/:?]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_372]
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687271520022-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:96) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.lambda$invoke$0(GeaflowInvocationHandler.java:43) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.LoaderSwitchUtil.call(LoaderSwitchUtil.java:38) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.invoke(GeaflowInvocationHandler.java:35) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.sun.proxy.$Proxy231.submitJob(Unknown Source) ~[?:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:86) ~[geaflow-console-core-service-0.1.jar!/:?]
... 7 more
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687271520022-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:41) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.runWithRetries(GeaflowKubeClient.java:125) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.createPod(GeaflowKubeClient.java:104) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:93) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.lambda$invoke$0(GeaflowInvocationHandler.java:43) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.LoaderSwitchUtil.call(LoaderSwitchUtil.java:38) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.invoke(GeaflowInvocationHandler.java:35) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.sun.proxy.$Proxy231.submitJob(Unknown Source) ~[?:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:86) ~[geaflow-console-core-service-0.1.jar!/:?]
... 7 more
Caused by: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687271520022-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.requestFailure(OperationSupport.java:639) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.assertResponseCode(OperationSupport.java:578) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:543) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:504) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleCreate(OperationSupport.java:292) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.handleCreate(BaseOperation.java:893) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.create(BaseOperation.java:372) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.create(BaseOperation.java:86) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.lambda$createPod$6(GeaflowKubeClient.java:101) ~[?:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.runWithRetries(GeaflowKubeClient.java:125) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.createPod(GeaflowKubeClient.java:104) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:93) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.lambda$invoke$0(GeaflowInvocationHandler.java:43) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.LoaderSwitchUtil.call(LoaderSwitchUtil.java:38) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.invoke(GeaflowInvocationHandler.java:35) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.sun.proxy.$Proxy231.submitJob(Unknown Source) ~[?:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:86) ~[geaflow-console-core-service-0.1.jar!/:?]
... 7 more
2023-06-20 14:33:40,752 ERROR pool-3-thread-12 core.service.task.GeaflowTaskSubmitter:86 - task 1686902126697882985 submit error: Start task 1686902126697882985 failed
com.antgroup.geaflow.console.common.util.exception.GeaflowLogException: Start task 1686902126697882985 failed
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:96) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.start(K8sRuntime.java:55) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.task.GeaflowTaskOperator.start(GeaflowTaskOperator.java:100) ~[geaflow-console-core-service-0.1.jar!/:?]
at com.antgroup.geaflow.console.core.service.task.GeaflowTaskSubmitter.lambda$submit$0(GeaflowTaskSubmitter.java:83) ~[geaflow-console-core-service-0.1.jar!/:?]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_372]
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687271520022-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:96) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.lambda$invoke$0(GeaflowInvocationHandler.java:43) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.LoaderSwitchUtil.call(LoaderSwitchUtil.java:38) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.invoke(GeaflowInvocationHandler.java:35) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.sun.proxy.$Proxy231.submitJob(Unknown Source) ~[?:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:86) ~[geaflow-console-core-service-0.1.jar!/:?]
... 7 more
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687271520022-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:41) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.runWithRetries(GeaflowKubeClient.java:125) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.createPod(GeaflowKubeClient.java:104) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:93) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.lambda$invoke$0(GeaflowInvocationHandler.java:43) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.LoaderSwitchUtil.call(LoaderSwitchUtil.java:38) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.invoke(GeaflowInvocationHandler.java:35) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.sun.proxy.$Proxy231.submitJob(Unknown Source) ~[?:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:86) ~[geaflow-console-core-service-0.1.jar!/:?]
... 7 more
Caused by: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://xxx:6443/api/v1/namespaces/tugraph/pods. Message: pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found. Received status: Status(apiVersion=v1, code=403, details=StatusDetails(causes=[], group=null, kind=pods, name=geaflow1686902126697882985-1687271520022-client, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "geaflow1686902126697882985-1687271520022-client" is forbidden: error looking up service account tugraph/geaflow: serviceaccount "geaflow" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=Forbidden, status=Failure, additionalProperties={}).
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.requestFailure(OperationSupport.java:639) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.assertResponseCode(OperationSupport.java:578) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:543) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:504) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleCreate(OperationSupport.java:292) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.handleCreate(BaseOperation.java:893) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.create(BaseOperation.java:372) ~[?:?]
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.create(BaseOperation.java:86) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.lambda$createPod$6(GeaflowKubeClient.java:101) ~[?:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.runWithRetries(GeaflowKubeClient.java:125) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.clustermanager.GeaflowKubeClient.createPod(GeaflowKubeClient.java:104) ~[?:?]
at com.antgroup.geaflow.cluster.k8s.client.KubernetesJobClient.submitJob(KubernetesJobClient.java:93) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.lambda$invoke$0(GeaflowInvocationHandler.java:43) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.LoaderSwitchUtil.call(LoaderSwitchUtil.java:38) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.antgroup.geaflow.console.common.util.proxy.GeaflowInvocationHandler.invoke(GeaflowInvocationHandler.java:35) ~[geaflow-console-common-util-0.1.jar!/:?]
at com.sun.proxy.$Proxy231.submitJob(Unknown Source) ~[?:?]
at com.antgroup.geaflow.console.core.service.runtime.K8sRuntime.doStart(K8sRuntime.java:86) ~[geaflow-console-core-service-0.1.jar!/:?]
... 7 more
Is your feature request related to a problem? Please describe.
图研发下面新增函数定义模块,可用于上传自定义 jar 包
Currently GeaFlow uses BinaryString as its implementation for string, which provides better performance. However, at present, most of the built-in String Function uses string as the input parameter, and a direct conversion from BinaryString to String is required in the calculation phase, which has performance overhead. Please Implement the Concat/ConcatWs function with BinaryString as an input.
Currently, GeaFlow DSL has implemented SSSP and PageRank algorithms, but there are still some graph algorithms that have not been implemented. Please implement the Triangle Counting algorithm. Here is the document for UDAG
Triangle Counting algorithm is an algorithm used in graph theory to determine the number of triangles present in an undirected graph. It works by examining each vertex in the graph and counting the number of triangles it is a part of. This is done by examining all pairs of neighbors of the vertex and checking if they are connected to each other. If they are, then a triangle is formed. The algorithm continues to examine each vertex in the graph in this way until all triangles have been counted. This algorithm is widely used in social network analysis, community detection, and recommendations systems.
Currently GeaFlow supports monitoring metric reporting for InfluxDB and SLF4J. In order to better support the open source ecosystem, it is necessary to support more metric reporting systems. Please implement Prometheus monitoring metric reporting.
2023-06-29 10:18:25 ERROR PipelineInputFetcher:148 - fetcher encounters unexpected exception: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost.
com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost.
at com.antgroup.geaflow.shuffle.api.reader.PipelineFetcher.next(PipelineFetcher.java:112) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.shuffle.api.reader.PipelineReader.next(PipelineReader.java:62) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.PipelineInputFetcher.fetch(PipelineInputFetcher.java:126) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.PipelineInputFetcher.fetch(PipelineInputFetcher.java:75) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.FetcherRunner.process(FetcherRunner.java:38) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.FetcherRunner.process(FetcherRunner.java:22) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) [geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
Caused by: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost.
at com.antgroup.geaflow.shuffle.network.netty.SliceRequestClientHandler.channelInactive(SliceRequestClientHandler.java:105) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) ~[geaflow-geaflow.jar:?]
at io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) ~[geaflow-geaflow.jar:?]
at io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.shuffle.network.netty.NettyFrameDecoder.channelInactive(NettyFrameDecoder.java:187) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) ~[geaflow-geaflow.jar:?]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1429) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:947) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:822) ~[geaflow-geaflow.jar:?]
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163) ~[geaflow-geaflow.jar:?]
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:404) ~[geaflow-geaflow.jar:?]
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:326) ~[geaflow-geaflow.jar:?]
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897) ~[geaflow-geaflow.jar:?]
... 1 more
2023-06-29 10:18:25 ERROR AbstractTaskRunner:48 - com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost.
com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost.
at com.antgroup.geaflow.cluster.fetcher.PipelineInputFetcher.fetch(PipelineInputFetcher.java:149) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.PipelineInputFetcher.fetch(PipelineInputFetcher.java:75) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.FetcherRunner.process(FetcherRunner.java:38) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.FetcherRunner.process(FetcherRunner.java:22) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) [geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost.
at com.antgroup.geaflow.shuffle.api.reader.PipelineFetcher.next(PipelineFetcher.java:112) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.shuffle.api.reader.PipelineReader.next(PipelineReader.java:62) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.PipelineInputFetcher.fetch(PipelineInputFetcher.java:126) ~[geaflow-geaflow.jar:?]
... 7 more
Caused by: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost.
at com.antgroup.geaflow.shuffle.network.netty.SliceRequestClientHandler.channelInactive(SliceRequestClientHandler.java:105) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) ~[geaflow-geaflow.jar:?]
at io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) ~[geaflow-geaflow.jar:?]
at io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.shuffle.network.netty.NettyFrameDecoder.channelInactive(NettyFrameDecoder.java:187) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) ~[geaflow-geaflow.jar:?]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1429) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:947) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:822) ~[geaflow-geaflow.jar:?]
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163) ~[geaflow-geaflow.jar:?]
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:404) ~[geaflow-geaflow.jar:?]
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:326) ~[geaflow-geaflow.jar:?]
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897) ~[geaflow-geaflow.jar:?]
... 1 more
2023-06-29 10:18:25 ERROR ComponentUncaughtExceptionHandler:27 - FATAL exception in thread:gryphon-fetcher-0
com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost.
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:49) ~[geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost.
at com.antgroup.geaflow.cluster.fetcher.PipelineInputFetcher.fetch(PipelineInputFetcher.java:149) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.PipelineInputFetcher.fetch(PipelineInputFetcher.java:75) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.FetcherRunner.process(FetcherRunner.java:38) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.FetcherRunner.process(FetcherRunner.java:22) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) ~[geaflow-geaflow.jar:?]
... 3 more
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost.
at com.antgroup.geaflow.shuffle.api.reader.PipelineFetcher.next(PipelineFetcher.java:112) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.shuffle.api.reader.PipelineReader.next(PipelineReader.java:62) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.PipelineInputFetcher.fetch(PipelineInputFetcher.java:126) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.PipelineInputFetcher.fetch(PipelineInputFetcher.java:75) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.FetcherRunner.process(FetcherRunner.java:38) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.FetcherRunner.process(FetcherRunner.java:22) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) ~[geaflow-geaflow.jar:?]
... 3 more
Caused by: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost.
at com.antgroup.geaflow.shuffle.network.netty.SliceRequestClientHandler.channelInactive(SliceRequestClientHandler.java:105) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) ~[geaflow-geaflow.jar:?]
at io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) ~[geaflow-geaflow.jar:?]
at io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.shuffle.network.netty.NettyFrameDecoder.channelInactive(NettyFrameDecoder.java:187) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) ~[geaflow-geaflow.jar:?]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1429) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:947) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:822) ~[geaflow-geaflow.jar:?]
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163) ~[geaflow-geaflow.jar:?]
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:404) ~[geaflow-geaflow.jar:?]
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:326) ~[geaflow-geaflow.jar:?]
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897) ~[geaflow-geaflow.jar:?]
... 1 more
2023-06-29 10:18:25 ERROR ComponentExceptionSupervisor:29 - Thread[gryphon-fetcher-0,5,] occur fatal exception, exit process now
com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost.
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:49) [geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost.
at com.antgroup.geaflow.cluster.fetcher.PipelineInputFetcher.fetch(PipelineInputFetcher.java:149) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.PipelineInputFetcher.fetch(PipelineInputFetcher.java:75) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.FetcherRunner.process(FetcherRunner.java:38) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.FetcherRunner.process(FetcherRunner.java:22) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) ~[geaflow-geaflow.jar:?]
... 3 more
Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost.
at com.antgroup.geaflow.shuffle.api.reader.PipelineFetcher.next(PipelineFetcher.java:112) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.shuffle.api.reader.PipelineReader.next(PipelineReader.java:62) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.PipelineInputFetcher.fetch(PipelineInputFetcher.java:126) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.PipelineInputFetcher.fetch(PipelineInputFetcher.java:75) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.FetcherRunner.process(FetcherRunner.java:38) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.fetcher.FetcherRunner.process(FetcherRunner.java:22) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) ~[geaflow-geaflow.jar:?]
... 3 more
Caused by: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost.
at com.antgroup.geaflow.shuffle.network.netty.SliceRequestClientHandler.channelInactive(SliceRequestClientHandler.java:105) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) ~[geaflow-geaflow.jar:?]
at io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) ~[geaflow-geaflow.jar:?]
at io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.shuffle.network.netty.NettyFrameDecoder.channelInactive(NettyFrameDecoder.java:187) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) ~[geaflow-geaflow.jar:?]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1429) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) ~[geaflow-geaflow.jar:?]
at io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:947) ~[geaflow-geaflow.jar:?]
at io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:822) ~[geaflow-geaflow.jar:?]
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163) ~[geaflow-geaflow.jar:?]
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:404) ~[geaflow-geaflow.jar:?]
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:326) ~[geaflow-geaflow.jar:?]
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897) ~[geaflow-geaflow.jar:?]
... 1 more
2023-06-29 10:18:25 INFO ExceptionClient:48 - Send exception com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.shuffle.util.TransportException: Connection unexpectedly closed by remote server '10.3.12.16/10.3.12.16:43190'. This might indicate that the remote server was lost. to master.
2023-06-29 10:18:25 INFO RpcClient:199 - invalidate rpc resource cache of : #_MASTER
2023-06-29 10:18:25 WARN RetryCommand:43 - Retry failed, will retry 109 times with interval 3000 ms.
2023-06-29 10:18:26 WARN SliceOutputChannelHandler:207 - channel inactive and release resource...
2023-06-29 10:18:26 INFO PipelineSlice:200 - PipelineTask#0 cycle#1-1 task#3: released SliceId{pipelineId=322431958376251776, edgeId=3, shardIndex=3, sliceIndex=4} with bufferSize:0
^C
[root@geaflow1688028564006294774-1688031920018-container-1 geaflow]# tailf -n 200 container.log
at com.antgroup.geaflow.ha.service.AbstractHAService.checkServiceAvailable(AbstractHAService.java:111) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.ha.service.AbstractHAService.loadDataFromStore(AbstractHAService.java:98) ~[geaflow-geaflow.jar:?]
at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.resolveResource(AbstractHAService.java:55) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.getResourceData(RpcClient.java:209) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.connectMaster(RpcClient.java:140) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$sendException$2(RpcClient.java:96) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$doRpcWithRetry$9(RpcClient.java:168) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.doRpcWithRetry(RpcClient.java:166) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.sendException(RpcClient.java:96) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ExceptionClient.sendException(ExceptionClient.java:49) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:35) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:21) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) [geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
2023-06-29 10:18:37 WARN AbstractHAService:84 - failed to resolve resource:_MASTER resourceData:ResourceData{host='10.3.11.245', processId=45, rpcPort=37181, shufflePort=0}
java.net.NoRouteToHostException: No route to host (Host unreachable)
at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_372]
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_372]
at java.net.Socket.connect(Socket.java:607) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.checkServiceAvailable(AbstractHAService.java:111) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.ha.service.AbstractHAService.loadDataFromStore(AbstractHAService.java:98) ~[geaflow-geaflow.jar:?]
at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.resolveResource(AbstractHAService.java:55) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.getResourceData(RpcClient.java:209) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.connectMaster(RpcClient.java:140) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$sendException$2(RpcClient.java:96) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$doRpcWithRetry$9(RpcClient.java:168) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.doRpcWithRetry(RpcClient.java:166) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.sendException(RpcClient.java:96) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ExceptionClient.sendException(ExceptionClient.java:49) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:35) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:21) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) [geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
2023-06-29 10:18:39 WARN AbstractHAService:84 - failed to resolve resource:_MASTER resourceData:ResourceData{host='10.3.11.245', processId=45, rpcPort=37181, shufflePort=0}
java.net.NoRouteToHostException: No route to host (Host unreachable)
at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_372]
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_372]
at java.net.Socket.connect(Socket.java:607) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.checkServiceAvailable(AbstractHAService.java:111) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.ha.service.AbstractHAService.loadDataFromStore(AbstractHAService.java:98) ~[geaflow-geaflow.jar:?]
at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.resolveResource(AbstractHAService.java:55) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.getResourceData(RpcClient.java:209) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.connectMaster(RpcClient.java:140) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$sendException$2(RpcClient.java:96) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$doRpcWithRetry$9(RpcClient.java:168) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.doRpcWithRetry(RpcClient.java:166) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.sendException(RpcClient.java:96) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ExceptionClient.sendException(ExceptionClient.java:49) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:35) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:21) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) [geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
2023-06-29 10:18:42 WARN AbstractHAService:84 - failed to resolve resource:_MASTER resourceData:ResourceData{host='10.3.11.245', processId=45, rpcPort=37181, shufflePort=0}
java.net.NoRouteToHostException: No route to host (Host unreachable)
at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_372]
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_372]
at java.net.Socket.connect(Socket.java:607) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.checkServiceAvailable(AbstractHAService.java:111) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.ha.service.AbstractHAService.loadDataFromStore(AbstractHAService.java:98) ~[geaflow-geaflow.jar:?]
at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.resolveResource(AbstractHAService.java:55) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.getResourceData(RpcClient.java:209) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.connectMaster(RpcClient.java:140) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$sendException$2(RpcClient.java:96) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$doRpcWithRetry$9(RpcClient.java:168) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.doRpcWithRetry(RpcClient.java:166) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.sendException(RpcClient.java:96) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ExceptionClient.sendException(ExceptionClient.java:49) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:35) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:21) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) [geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
2023-06-29 10:18:44 WARN AbstractHAService:84 - failed to resolve resource:_MASTER resourceData:ResourceData{host='10.3.11.245', processId=45, rpcPort=37181, shufflePort=0}
java.net.NoRouteToHostException: No route to host (Host unreachable)
at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_372]
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_372]
at java.net.Socket.connect(Socket.java:607) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.checkServiceAvailable(AbstractHAService.java:111) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.ha.service.AbstractHAService.loadDataFromStore(AbstractHAService.java:98) ~[geaflow-geaflow.jar:?]
at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.resolveResource(AbstractHAService.java:55) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.getResourceData(RpcClient.java:209) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.connectMaster(RpcClient.java:140) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$sendException$2(RpcClient.java:96) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$doRpcWithRetry$9(RpcClient.java:168) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.doRpcWithRetry(RpcClient.java:166) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.sendException(RpcClient.java:96) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ExceptionClient.sendException(ExceptionClient.java:49) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:35) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:21) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) [geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
2023-06-29 10:18:46 WARN AbstractHAService:84 - failed to resolve resource:_MASTER resourceData:ResourceData{host='10.3.11.245', processId=45, rpcPort=37181, shufflePort=0}
java.net.NoRouteToHostException: No route to host (Host unreachable)
at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_372]
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_372]
at java.net.Socket.connect(Socket.java:607) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.checkServiceAvailable(AbstractHAService.java:111) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.ha.service.AbstractHAService.loadDataFromStore(AbstractHAService.java:98) ~[geaflow-geaflow.jar:?]
at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.resolveResource(AbstractHAService.java:55) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.getResourceData(RpcClient.java:209) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.connectMaster(RpcClient.java:140) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$sendException$2(RpcClient.java:96) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$doRpcWithRetry$9(RpcClient.java:168) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.doRpcWithRetry(RpcClient.java:166) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.sendException(RpcClient.java:96) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ExceptionClient.sendException(ExceptionClient.java:49) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:35) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:21) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) [geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
2023-06-29 10:18:48 WARN AbstractHAService:84 - failed to resolve resource:_MASTER resourceData:ResourceData{host='10.3.11.245', processId=45, rpcPort=37181, shufflePort=0}
java.net.NoRouteToHostException: No route to host (Host unreachable)
at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_372]
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_372]
at java.net.Socket.connect(Socket.java:607) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.checkServiceAvailable(AbstractHAService.java:111) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.ha.service.AbstractHAService.loadDataFromStore(AbstractHAService.java:98) ~[geaflow-geaflow.jar:?]
at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.resolveResource(AbstractHAService.java:55) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.getResourceData(RpcClient.java:209) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.connectMaster(RpcClient.java:140) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$sendException$2(RpcClient.java:96) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$doRpcWithRetry$9(RpcClient.java:168) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.doRpcWithRetry(RpcClient.java:166) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.sendException(RpcClient.java:96) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ExceptionClient.sendException(ExceptionClient.java:49) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:35) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:21) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) [geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
2023-06-29 10:18:51 WARN AbstractHAService:84 - failed to resolve resource:_MASTER resourceData:ResourceData{host='10.3.11.245', processId=45, rpcPort=37181, shufflePort=0}
java.net.NoRouteToHostException: No route to host (Host unreachable)
at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_372]
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_372]
at java.net.Socket.connect(Socket.java:607) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.checkServiceAvailable(AbstractHAService.java:111) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.ha.service.AbstractHAService.loadDataFromStore(AbstractHAService.java:98) ~[geaflow-geaflow.jar:?]
at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.resolveResource(AbstractHAService.java:55) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.getResourceData(RpcClient.java:209) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.connectMaster(RpcClient.java:140) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$sendException$2(RpcClient.java:96) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$doRpcWithRetry$9(RpcClient.java:168) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.doRpcWithRetry(RpcClient.java:166) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.sendException(RpcClient.java:96) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ExceptionClient.sendException(ExceptionClient.java:49) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:35) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:21) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) [geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
2023-06-29 10:18:53 WARN AbstractHAService:84 - failed to resolve resource:_MASTER resourceData:ResourceData{host='10.3.11.245', processId=45, rpcPort=37181, shufflePort=0}
java.net.NoRouteToHostException: No route to host (Host unreachable)
at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_372]
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_372]
at java.net.Socket.connect(Socket.java:607) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.checkServiceAvailable(AbstractHAService.java:111) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.ha.service.AbstractHAService.loadDataFromStore(AbstractHAService.java:98) ~[geaflow-geaflow.jar:?]
at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.resolveResource(AbstractHAService.java:55) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.getResourceData(RpcClient.java:209) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.connectMaster(RpcClient.java:140) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$sendException$2(RpcClient.java:96) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$doRpcWithRetry$9(RpcClient.java:168) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.doRpcWithRetry(RpcClient.java:166) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.sendException(RpcClient.java:96) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ExceptionClient.sendException(ExceptionClient.java:49) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:35) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:21) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) [geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
2023-06-29 10:18:55 WARN AbstractHAService:84 - failed to resolve resource:_MASTER resourceData:ResourceData{host='10.3.11.245', processId=45, rpcPort=37181, shufflePort=0}
java.net.NoRouteToHostException: No route to host (Host unreachable)
at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_372]
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_372]
at java.net.Socket.connect(Socket.java:607) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.checkServiceAvailable(AbstractHAService.java:111) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.ha.service.AbstractHAService.loadDataFromStore(AbstractHAService.java:98) ~[geaflow-geaflow.jar:?]
at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.resolveResource(AbstractHAService.java:55) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.getResourceData(RpcClient.java:209) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.connectMaster(RpcClient.java:140) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$sendException$2(RpcClient.java:96) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$doRpcWithRetry$9(RpcClient.java:168) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.doRpcWithRetry(RpcClient.java:166) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.sendException(RpcClient.java:96) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ExceptionClient.sendException(ExceptionClient.java:49) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:35) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:21) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) [geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
2023-06-29 10:18:57 WARN AbstractHAService:84 - failed to resolve resource:_MASTER resourceData:ResourceData{host='10.3.11.245', processId=45, rpcPort=37181, shufflePort=0}
java.net.NoRouteToHostException: No route to host (Host unreachable)
at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_372]
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_372]
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_372]
at java.net.Socket.connect(Socket.java:607) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.checkServiceAvailable(AbstractHAService.java:111) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.ha.service.AbstractHAService.loadDataFromStore(AbstractHAService.java:98) ~[geaflow-geaflow.jar:?]
at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660) ~[?:1.8.0_372]
at com.antgroup.geaflow.ha.service.AbstractHAService.resolveResource(AbstractHAService.java:55) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.getResourceData(RpcClient.java:209) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.connectMaster(RpcClient.java:140) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$sendException$2(RpcClient.java:96) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.lambda$doRpcWithRetry$9(RpcClient.java:168) ~[geaflow-geaflow.jar:?]
at com.antgroup.geaflow.common.utils.RetryCommand.run(RetryCommand.java:36) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.doRpcWithRetry(RpcClient.java:166) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.rpc.RpcClient.sendException(RpcClient.java:96) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ExceptionClient.sendException(ExceptionClient.java:49) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:35) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.exception.ComponentExceptionSupervisor.process(ComponentExceptionSupervisor.java:21) [geaflow-geaflow.jar:?]
at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) [geaflow-geaflow.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_372]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_372]
Support create temporary table or graph which will store in the memory. Currently geaflow only support create persistent table or graph which will store the meta to console catalog. However it is not flexible to modify the config on the table. So we need support temporary table or graph.
Support the hbase connector which can write data to the hbase.
Currently GeaFlow uses BinaryString as its implementation for string, which provides better performance. However, at present, the built-in String Function uses string as the input parameter, and a direct conversion from BinaryString to String is required in the calculation phase, which has performance overhead. Implement the InStr/IndexOf function with BinaryString as an input.
Currently, GeaFlow has implemented many graph computing algorithms, but there are still some graph algorithms that have not been implemented. Please implement the Node Similarity algorithm.
异构图中存在实体A、B,两者之间存在关系e,且e基于时间存在多条不同的边作为历史记录
查看源码后,在构建EDGE时只有SOURCE ID| DESTINATION ID 作为边全局参数,是否边的唯一标识即为两者的一些操作作为该边
的唯一标识,当两个相同实体存在同类型多条边进入计算引擎时,如何能够有效的区分开
QueryCompiler support get unresolved function list. It is used to infer the user defined udf jar list for platform like geaflow-console.
Describe the bug
Now will run failed under ray cluster environment.
Support create function in the console web
RT
Describe the bug
A clear and concise description of what the bug is.
GQLAlgorithmTest fails in Windows but works in Ubuntu, logs:
2023-06-27 02:08:47 INFO EnvironmentFactory:104 - loaded IEnvironmentArgsParser implementation com.antgroup.geaflow.env.args.EnvironmentArgumentParser@6337c201
2023-06-27 02:08:47 INFO EnvironmentFactory:84 - loaded IEnvironment implementation com.antgroup.geaflow.cluster.local.client.LocalEnvironment@6304101a
2023-06-27 02:08:47 INFO GQLPipeLine:85 - queryPath:resource:///query/gql_algorithm_001.sql
2023-06-27 02:08:47 INFO GQLPipeLine:99 - execute query:
CREATE TABLE console (
vid int,
distance bigint
) WITH (
type='file',
geaflow.dsl.file.path='file://D:\Development\Code\Repository\tugraph-analytics\geaflow\geaflow-dsl\geaflow-dsl-runtime\target/gql_algorithm_001'
);
USE GRAPH modern;
INSERT INTO console
CALL SSSP(1) YIELD (vid, distance)
RETURN cast (vid as int), distance
;
2023-06-27 02:08:47 INFO GQLPipeLine:104 - Submit pipeline task ...
2023-06-27 02:08:48 INFO GQLPipeLine:109 - Execute pipeline task
2023-06-27 02:08:48 WARN MetricGroupRegistry:90 - report list is empty
2023-06-27 02:08:48 WARN HAServiceFactory:55 - unknown ha service type:memory, use default memoryHaService
2023-06-27 02:08:48 INFO ClusterMetaStoreFactory:55 - create memory cluster metastore
2023-06-27 02:08:48 ERROR LocalClusterClient:55 - deploy cluster failed
com.antgroup.geaflow.common.exception.GeaflowRuntimeException:
************
ERR_ID:
RUN-00000003
CAUSE:
SystemInternalError - not find 'MEMORY' SPI implement
ACTION:
Please contact admin.
DETAIL:
************
at com.antgroup.geaflow.store.api.key.StoreBuilderFactory.build(StoreBuilderFactory.java:40) ~[classes/:?]
at com.antgroup.geaflow.cluster.system.MemoryClusterMetaKVStore.init(MemoryClusterMetaKVStore.java:30) ~[classes/:?]
at com.antgroup.geaflow.cluster.system.ClusterMetaStoreFactory.create(ClusterMetaStoreFactory.java:43) ~[classes/:?]
at com.antgroup.geaflow.cluster.system.ClusterMetaStore.<init>(ClusterMetaStore.java:49) ~[classes/:?]
at com.antgroup.geaflow.cluster.system.ClusterMetaStore.init(ClusterMetaStore.java:55) ~[classes/:?]
Expected behavior
A clear and concise description of what you expected to happen.
tests pass
Additional context
Add any other context about the problem here.
In this method, it seems that only load jdbc-store
from SPI, but not includes rocksdb
, memory
and redis
in window.
public static synchronized IStoreBuilder build(String storeType) {
if (CONCURRENT_TYPE_MAP.containsKey(storeType)) {
return CONCURRENT_TYPE_MAP.get(storeType);
}
ServiceLoader<IStoreBuilder> serviceLoader = ServiceLoader.load(IStoreBuilder.class);
for (IStoreBuilder storeBuilder: serviceLoader) {
if (storeBuilder.getStoreDesc().name().equalsIgnoreCase(storeType)) {
CONCURRENT_TYPE_MAP.put(storeType, storeBuilder);
return storeBuilder;
}
}
throw new GeaflowRuntimeException(RuntimeErrors.INST.spiNotFoundError(storeType));
}
Currently GeaFlow uses BinaryString as its implementation for string, which provides better performance. However, at present, the built-in String Function uses string as the input parameter, and a direct conversion from BinaryString to String is required in the calculation phase, which has performance overhead. Implement the SplitEx/Substr/Reverse function with BinaryString as an input.
Currently a not support exception will throw out when running graph algorithm after insert data to data for DSL job.
Using the static traversal operator to the graph algorithm for insert data.
Origin:基于Docker启动后,8888界面报错 #10
Solutions:
Describe the bug
The column of static_graph does not created in console init file.
Expected behavior
Remove static_graph mark.
Additional context
Add any other context about the problem here.
Describe the bug
When run sssp with the shard count is 1 for graph, the following exception will throw out:
com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: java.lang.IllegalArgumentException: Maximum parallelism 1 must not be smaller than parallelism 2 at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:49) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: java.lang.IllegalArgumentException: Maximum parallelism 1 must not be smaller than parallelism 2 at com.antgroup.geaflow.runtime.core.worker.AbstractAlignedWorker.alignedProcess(AbstractAlignedWorker.java:104) at com.antgroup.geaflow.runtime.core.protocol.AbstractIterationComputeCommand.execute(AbstractIterationComputeCommand.java:51) at com.antgroup.geaflow.runtime.core.protocol.ExecuteComputeEvent.execute(ExecuteComputeEvent.java:40) at com.antgroup.geaflow.cluster.task.Task.execute(Task.java:36) at com.antgroup.geaflow.cluster.task.runner.TaskRunner.process(TaskRunner.java:54) at com.antgroup.geaflow.cluster.task.runner.TaskRunner.process(TaskRunner.java:24) at com.antgroup.geaflow.cluster.task.runner.AbstractTaskRunner.run(AbstractTaskRunner.java:43) ... 3 more Caused by: com.antgroup.geaflow.common.exception.GeaflowRuntimeException: java.lang.IllegalArgumentException: Maximum parallelism 1 must not be smaller than parallelism 2 at com.antgroup.geaflow.processor.impl.window.OneInputProcessor.processElement(OneInputProcessor.java:46) at com.antgroup.geaflow.processor.impl.window.OneInputProcessor.processElement(OneInputProcessor.java:26) at com.antgroup.geaflow.processor.impl.AbstractStreamProcessor.process(AbstractStreamProcessor.java:81) at com.antgroup.geaflow.runtime.core.worker.impl.ComputeWorker.process(ComputeWorker.java:62) at com.antgroup.geaflow.runtime.core.worker.impl.ComputeWorker.process(ComputeWorker.java:33)
Support read data from hudi datasource.
Currently, GeaFlow has implemented many graph computing algorithms, but there are still some graph algorithms that have not been implemented. Please implement the Jaccard Similarity algorithm.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.