Comments (7)
adrian-wang
commented on July 19, 2024
Hi Jaeki,
so did you use the master branch or the yarn branch? yarn branch has been tested for cdh5, while there are some issues when running master branch of HiBench against cdh5
from hibench.
Jaeki
commented on July 19, 2024
I used yarn branch.
Also, I have setup CDH5 cluster using Cloudera manager.
Cluster consists of 1 master and 5 slave nodes.
I have installed HDFS and YARN and Hive services..
I have no problems with any other benchmarks...
thank you for your comment.
from hibench.
adrian-wang
commented on July 19, 2024
@shimingfei can you take a look at this?
from hibench.
adrian-wang
commented on July 19, 2024
Hi Jaeki, there's a PR for nutchindexing available for cdh5, can you check that?
see #49
from hibench.
adrian-wang
commented on July 19, 2024
Hi Jaeki, I've merged #49 , I think that would resolve your problem.
from hibench.
Jaeki
commented on July 19, 2024
Thank you. I didn't try yet but I think it works well.
from hibench.
adrian-wang
commented on July 19, 2024
Let's close this first. If problem persists, you're welcome to reopen this.
Thanks!
from hibench.
Related Issues (20)
- can you add me pls
- I am facing the below mentioned issue while trying to execute the pagerank algorithm in hadoop from hibench. Please give a solution. HOT 1
- upgrade kafka version
- Hi
- HiveError:HiveException java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient HOT 1
- Does Hibench Suite work with spark version 3.2.1 ? HOT 1
- Hi
- Error when run sql test
- Does Hibench Suite support Hadoop version 3.x ? HOT 1
- i don't no what i do -_- HOT 2
- Could tasks submitted to Spark by Hibench be viewed in Spark's History Server?
- Issues with run-sparkbench on Google Cloud Platform (GCP)
- spark config value modification does not apply.
- for single node hadoop configuration
- Hi
- The
- ERROR [26/26] RUN cd /root/HiBench && mvn clean package -Dspark=1.6 -Dscala=2.10
- Attempt to run HiBench on JDK 17 or higher versions HOT 1
- Hi
- Runstreaming job failed with error in bench.log like "org.apache.spark.SparkException: Error getting partition metadata for 'identity'. Does the topic exist?"
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hibench.