huaweicloud / huaweicloud-mrs-example Goto Github PK
View Code? Open in Web Editor NEWExamples for HUAWEI CLOUD MRS.
huaweicloud-mrs-example's People
Contributors
Stargazers
Watchers
Forkers
slijian tomcat119 hanzhizhuo jasonwayne xiedeqi guanglong-ji superainbower dangdang2011 hhao99 mryang001 hzgy15 helloxu lothar1993 plunixlp chengdh90 hflsf toolsonkeys ksiailaohuyou wangxixiaoge xinjingqing liangzi470 huiliqh zhangshuai404 zz-big caidixi jiaowodashujiaowoemo yinxiang-huawei cuixfsx litchies smallyellowcat yyhhdd zvs0981 topersuit kaiyangzhang 1251853373 daydayup-zyn tianshengke towwb xiaotuzi615 meyp xiaodu-hub renhao313 yang7935 justlikeapig msxjx javenzhu zhibinzheng lirong9392 peanut-chenzhong fhygh lisyfun xuanzaipiece y00187570 nwpuyc frankf7 zhangrg1989 qizhiliu0639 harukishioya zmf4 frankfengye shinefly9951 chenqixu yanglingxianghw recentprogress zengzhenyu0051 1232421512 geek12580 bakea iswdzh shiliang17671467654 boson234 wnlife-li ssisme2019 fnck githubprogramman lrzgl mydream135 koudaicat scuthyx rowen110 zhang4040 cydaicc csyigy xuelinchao kioco alioving mysky528 q-o-o-q 7mming7 helakelas wslljlljsw 690788513 tju2015zc babumahesh-koo damianadam g748553840 zml4518079 echoas8 jim-liutao escaperunhuaweicloud-mrs-example's Issues
使用华为云产品Cloud Stack时提交jar报NPE
提交任务时报错:the main method caused an error :null。一直找不到方法入口，用的华为的cloud stack产品
flink-table-api-java-bridge_2.11:jar:1.10.0-hw-ei-302002 is missing, no dependency information available 这个咋整呀???
Building FlinkSqlJavaExample 1.0
[INFO] --------------------------------[ jar ]---------------------------------
[WARNING] The POM for org.apache.flink:flink-core:jar:1.10.0-hw-ei-302002 is missing, no dependency information available
[WARNING] The POM for org.apache.flink:flink-streaming-java_2.11:jar:1.10.0-hw-ei-302002 is missing, no dependency information available
[WARNING] The POM for org.apache.flink:flink-table-api-java:jar:1.10.0-hw-ei-302002 is missing, no dependency information available
[WARNING] The POM for org.apache.flink:flink-table-api-java-bridge_2.11:jar:1.10.0-hw-ei-302002 is missing, no dependency information available
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 0.189 s
[INFO] Finished at: 2021-03-05T10:39:12+08:00
[INFO] ------------------------------------------------------------------------
[WARNING] The requested profile "hw_source" could not be activated because it does not exist.
[ERROR] Failed to execute goal on project FlinkSqlJavaExample: Could not resolve dependencies for project com.huawei.bigdata.flink.examples:FlinkSqlJavaExample:jar:1.0: The following artifacts could not be resolved: org.apache.flink:flink-core:jar:1.10.0-hw-ei-302002, org.apache.flink:flink-streaming-java_2.11:jar:1.10.0-hw-ei-302002, org.apache.flink:flink-table-api-java:jar:1.10.0-hw-ei-302002, org.apache.flink:flink-table-api-java-bridge_2.11:jar:1.10.0-hw-ei-302002: Failure to find org.apache.flink:flink-core:jar:1.10.0-hw-ei-302002 in http://cmc.cloudartifact.dragon.tools.hihonor.com/artifactory/maven-remote was cached in the local repository, resolution will not be reattempted until the update interval of hw-source has elapsed or updates are forced -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
huaweicloudsdk中的包没有源码下载吗
huaweicloudsdk中的包（比如org.apache.spark.spark-core_2.12-3.1.1-hw-ei-312005）没有源码吗？
hudi样例代码报错
使用3.3.1-h0.cbu.mrs.320.r33版本example进行认证连接时，会出现javax.security.sasl.SaslException: GSS initiate failed
发现example中没有设置认证模式，添加以下代码后认证成功
Configuration conf = new Configuration();
conf.set("hadoop.security.authentication", "Kerberos");
请教下，mrs使用的就是kerberos认证，这里example为什么不集成配置，是有什么特殊原因吗
github上的代码和线下版本（如HD 651）客户端下载的代码有什么差异？
github上的代码和线下版本（如HD 651）客户端下载的代码有什么差异？以后还能否从客户端内获取代码？
按照你们样例代码有些包还是找不到
mrs-3.0.2: mvn Could not find zookeeper-3.5.6-hw-ei-302002-tests.jar (org.apache.zookeeper:zookeeper:3.5.6-hw-ei-302002).
huaweicloud-mrs-example/src/spark-examples/sparksecurity-examples/SparkHivetoHbaseJavaExample/pom.xml
url = https://repo.huaweicloud.com/repository/maven/huaweicloudsdk/org/apache/zookeeper/zookeeper/3.5.6-hw-ei-302002/"
not found zookeeper-3.5.6-hw-ei-302002-tests.jar
repo2.maven.org:80 failed to respond
repo2.maven.org:80 failed to respond
mrs-2.0: maven cannot download dependency jars : Not authorized
use mrs-2.0 branch hive-example code.
pom.xml
<repositories>
<repository>
<id>huaweicloudsdk</id>
<url>https://mirrors.huaweicloud.com/repository/maven/huaweicloudsdk/</url>
<releases><enabled>true</enabled></releases>
<snapshots><enabled>true</enabled></snapshots>
</repository>
<repository>
<id>central</id>
<name>Mavn Centreal</name>
<url>https://repo1.maven.org/maven2/</url>
</repository>
</repositories>mvn clean compile
[INFO] --------------------< hive-examples:hive-examples >---------------------
[INFO] Building hive-examples mrs-2.0
[INFO] --------------------------------[ jar ]---------------------------------
Downloading from apache.staging.https: https://repository.apache.org/service/local/staging/deploy/maven2/org/glassfish/javax.el/maven-metadata.xml
[WARNING] Could not transfer metadata org.glassfish:javax.el/maven-metadata.xml from/to apache.staging.https (https://repository.apache.org/service/local/staging/deploy/maven2): Not authorized
Downloading from apache.staging.https: https://repository.apache.org/service/local/staging/deploy/maven2/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/maven-metadata.xml
[WARNING] Could not transfer metadata org.glassfish:javax.el:3.0.1-b06-SNAPSHOT/maven-metadata.xml from/to apache.staging.https (https://repository.apache.org/service/local/staging/deploy/maven2): Not authorized
[WARNING] Failure to transfer org.glassfish:javax.el:3.0.1-b06-SNAPSHOT/maven-metadata.xml from https://repository.apache.org/service/local/staging/deploy/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of apache.staging.https has elapsed or updates are forced. Original error: Could not transfer metadata org.glassfish:javax.el:3.0.1-b06-SNAPSHOT/maven-metadata.xml from/to apache.staging.https (https://repository.apache.org/service/local/staging/deploy/maven2): Not authorized
Downloading from apache.staging.https: https://repository.apache.org/service/local/staging/deploy/maven2/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/javax.el-3.0.1-b06-SNAPSHOT.pom
Downloading from apache.staging.https: https://repository.apache.org/service/local/staging/deploy/maven2/org/glassfish/javax.el/3.0.1-b07-SNAPSHOT/maven-metadata.xml
[WARNING] Could not transfer metadata org.glassfish:javax.el:3.0.1-b07-SNAPSHOT/maven-metadata.xml from/to apache.staging.https (https://repository.apache.org/service/local/staging/deploy/maven2): Not authorized
[WARNING] Failure to transfer org.glassfish:javax.el:3.0.1-b07-SNAPSHOT/maven-metadata.xml from https://repository.apache.org/service/local/staging/deploy/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of apache.staging.https has elapsed or updates are forced. Original error: Could not transfer metadata org.glassfish:javax.el:3.0.1-b07-SNAPSHOT/maven-metadata.xml from/to apache.staging.https (https://repository.apache.org/service/local/staging/deploy/maven2): Not authorized
Downloading from apache.staging.https: https://repository.apache.org/service/local/staging/deploy/maven2/org/glassfish/javax.el/3.0.1-b07-SNAPSHOT/javax.el-3.0.1-b07-SNAPSHOT.pom
Downloading from apache.staging.https: https://repository.apache.org/service/local/staging/deploy/maven2/org/glassfish/javax.el/3.0.1-b08-SNAPSHOT/maven-metadata.xml
[WARNING] Could not transfer metadata org.glassfish:javax.el:3.0.1-b08-SNAPSHOT/maven-metadata.xml from/to apache.staging.https (https://repository.apache.org/service/local/staging/deploy/maven2): Not authorized
[WARNING] Failure to transfer org.glassfish:javax.el:3.0.1-b08-SNAPSHOT/maven-metadata.xml from https://repository.apache.org/service/local/staging/deploy/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of apache.staging.https has elapsed or updates are forced. Original error: Could not transfer metadata org.glassfish:javax.el:3.0.1-b08-SNAPSHOT/maven-metadata.xml from/to apache.staging.https (https://repository.apache.org/service/local/staging/deploy/maven2): Not authorized
Downloading from apache.staging.https: https://repository.apache.org/service/local/staging/deploy/maven2/org/glassfish/javax.el/3.0.1-b08-SNAPSHOT/javax.el-3.0.1-b08-SNAPSHOT.pom
Downloading from apache.staging.https: https://repository.apache.org/service/local/staging/deploy/maven2/org/glassfish/javax.el/3.0.1-b11-SNAPSHOT/maven-metadata.xml
[WARNING] Could not transfer metadata org.glassfish:javax.el:3.0.1-b11-SNAPSHOT/maven-metadata.xml from/to apache.staging.https (https://repository.apache.org/service/local/staging/deploy/maven2): Not authorized
[WARNING] Failure to transfer org.glassfish:javax.el:3.0.1-b11-SNAPSHOT/maven-metadata.xml from https://repository.apache.org/service/local/staging/deploy/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of apache.staging.https has elapsed or updates are forced. Original error: Could not transfer metadata org.glassfish:javax.el:3.0.1-b11-SNAPSHOT/maven-metadata.xml from/to apache.staging.https (https://repository.apache.org/service/local/staging/deploy/maven2): Not authorized
Downloading from apache.staging.https: https://repository.apache.org/service/local/staging/deploy/maven2/org/glassfish/javax.el/3.0.1-b11-SNAPSHOT/javax.el-3.0.1-b11-SNAPSHOT.pom
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 9.624 s
[INFO] Finished at: 2020-12-07T17:44:56+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project hive-examples: Could not resolve dependencies for project hive-examples:hive-examples:jar:mrs-2.0: Failed to collect dependencies at org.apache.hive:hive-service:jar:3.1.0-mrs-2.0 -> org.apache.hive:hive-llap-server:jar:3.1.0-mrs-2.0 -> org.apache.hbase:hbase-server:jar:2.1.1.0101-mrs-2.0 -> org.glassfish.web:javax.servlet.jsp:jar:2.3.2 -> org.glassfish:javax.el:jar:3.0.1-b06-SNAPSHOT: Failed to read artifact descriptor for org.glassfish:javax.el:jar:3.0.1-b06-SNAPSHOT: Could not transfer artifact org.glassfish:javax.el:pom:3.0.1-b06-SNAPSHOT from/to apache.staging.https (https://repository.apache.org/service/local/staging/deploy/maven2): Not authorized -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.