Comments (5)
Is there any impact on usage?
from doris-spark-connector.
Is there any impact on usage?
when i submit sparksql task,it always give error,like:
:: problems summary ::
:::: WARNINGS
::::::::::::::::::::::::::::::::::::::::::::::
:: UNRESOLVED DEPENDENCIES ::
::::::::::::::::::::::::::::::::::::::::::::::
:: org.apache.doris#spark-doris-connector-3.2_2.12;1.3.0: java.text.ParseException: inconsistent module descriptor file found in 'https://repo1.maven.org/maven2/org/apache/doris/spark-doris-connector-3.2_2.12/1.3.0/spark-doris-connector-3.2_2.12-1.3.0.pom': bad revision: expected='1.3.0' found='1.3.0-SNAPSHOT';
::::::::::::::::::::::::::::::::::::::::::::::
:::: ERRORS
central: bad revision found in https://repo1.maven.org/maven2/org/apache/doris/spark-doris-connector-3.2_2.12/1.3.0/spark-doris-connector-3.2_2.12-1.3.0.pom: expected='1.3.0 found='1.3.0-SNAPSHOT'
:: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
Exception in thread "main" java.lang.RuntimeException: [unresolved dependency: org.apache.doris#spark-doris-connector-3.2_2.12;1.3.0: java.text.ParseException: inconsistent module descriptor file found in 'https://repo1.maven.org/maven2/org/apache/doris/spark-doris-connector-3.2_2.12/1.3.0/spark-doris-connector-3.2_2.12-1.3.0.pom': bad revision: expected='1.3.0' found='1.3.0-SNAPSHOT'; ]
at org.apache.spark.deploy.SparkSubmitUtils$.resolveMavenCoordinates(SparkSubmit.scala:1458)
at org.apache.spark.util.DependencyUtils$.resolveMavenDependencies(DependencyUtils.scala:185)
at org.apache.spark.deploy.SparkSubmit.prepareSubmitEnvironment(SparkSubmit.scala:319)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:909)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:191)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:214)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1054)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1063)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
from doris-spark-connector.
Is there any impact on usage?
when i submit sparksql task,it always give error,like:
:: problems summary ::
:::: WARNINGS
:::::::::::::::::::::::::::::::::::::::::::::::: UNRESOLVED DEPENDENCIES :: :::::::::::::::::::::::::::::::::::::::::::::: :: org.apache.doris#spark-doris-connector-3.2_2.12;1.3.0: java.text.ParseException: inconsistent module descriptor file found in 'https://repo1.maven.org/maven2/org/apache/doris/spark-doris-connector-3.2_2.12/1.3.0/spark-doris-connector-3.2_2.12-1.3.0.pom': bad revision: expected='1.3.0' found='1.3.0-SNAPSHOT'; ::::::::::::::::::::::::::::::::::::::::::::::
:::: ERRORS central: bad revision found in https://repo1.maven.org/maven2/org/apache/doris/spark-doris-connector-3.2_2.12/1.3.0/spark-doris-connector-3.2_2.12-1.3.0.pom: expected='1.3.0 found='1.3.0-SNAPSHOT'
:: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS Exception in thread "main" java.lang.RuntimeException: [unresolved dependency: org.apache.doris#spark-doris-connector-3.2_2.12;1.3.0: java.text.ParseException: inconsistent module descriptor file found in 'https://repo1.maven.org/maven2/org/apache/doris/spark-doris-connector-3.2_2.12/1.3.0/spark-doris-connector-3.2_2.12-1.3.0.pom': bad revision: expected='1.3.0' found='1.3.0-SNAPSHOT'; ] at org.apache.spark.deploy.SparkSubmitUtils$.resolveMavenCoordinates(SparkSubmit.scala:1458) at org.apache.spark.util.DependencyUtils$.resolveMavenDependencies(DependencyUtils.scala:185) at org.apache.spark.deploy.SparkSubmit.prepareSubmitEnvironment(SparkSubmit.scala:319) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:909) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:191) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:214) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1054) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1063) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
i submit sparksql task in k8s
from doris-spark-connector.
1.3.1 fixed this problem, can you help test it?
from doris-spark-connector.
i meet this problem when i submit sparksql task in k8s,because i can't sovle it. I give up k8s, so i can't test it now
from doris-spark-connector.
Related Issues (20)
- [Feature] support https
- [Bug] connot sink spark array to doris by connector HOT 1
- [Bug] cannot use bitmap to doris by doris spark connector HOT 1
- [Bug] 使用doris-spark-connector-3.3_2.12.jar 导数,执行中 repartition 的stage 并行度一直为1,导致做 HOT 1
- [Bug] doris-2.0.1 partial_columns update error HOT 1
- Spark Doris Connector Release Note 1.3.0 HOT 3
- [Bug] 最新版的connector在maven仓库中找不到
- [Bug] spark-doris-connector 1.3.0 : Unrecognized Doris type JSON HOT 1
- Spark Doris Connector Release Note 1.3.1
- [Feature] Not inculude scala in release jar
- [Not to Use save_mode] HOT 2
- [Bug] 无法将datetime类型数据转换成日期格式 HOT 1
- Spark Doris Connector Release Note 1.3.2
- [Bug] Unable to correctly recognize time partition fields HOT 6
- [Bug] data loss when enable 2pc
- [Feature] support spark 3.5 HOT 2
- [Bug] HOT 1
- [Enhancement] The executor memory usage will be double when write to doris with csv&gz
- [Bug] SaveMode.Overwrite failed write data to doris HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from doris-spark-connector.