Comments (3)
Changed my core-site.xml solved the issue.
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:8020</value>
</property>
</configuration>
Now I am facing a problem with:
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /tmp/hadoop-yarn/staging/gabrielmunumel/.staging/job_1525387543266_0001/job.split could only be replicated to 0 nodes instead of minReplication (=1). There are 0 datanode(s) running and no node(s) are excluded in this operation.
at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1559)
But this is another issue I guess.
from spring-hadoop-samples.
Looks like your cluster has some issues with the datanodes. Also, we have not used the framework with Hadoop 3 and have no plans on evolving it further, see notice at https://projects.spring.io/spring-hadoop/
from spring-hadoop-samples.
Realized that. I have downgraded hadoop to version 2.6.
To solved the last issue I have removed my tmp dir and recreated with hdfs namenode -format
. It is working now. The only issue is that the job hangs.
I will close the issue because seems not related to spring.
from spring-hadoop-samples.
Related Issues (20)
- Issue while writing data to hdfs from remote client HOT 5
- Protocol message contained an invalid tag HOT 3
- hiveAppWithApacheLogs demo hangs on: Returning cached instance of singleton bean 'hiveRunner'
- I need a Hive 13, HiverServer2 sample HOT 1
- I need a SpringBatch Hive 13, HiverServer2 sample HOT 2
- I need a SpringBatch Hive 13, HiverServer2 sample
- spring-yarn examples not finding / using hadoop classpath HOT 5
- yarn-examples-simple-command failed on cdh5@centos HOT 3
- Hadoop Spring mapreduce multiple inputs and mappers in a job
- Can I have a working sample for spring hbase using hbaseTemplate with lastest stable hBase build? HOT 2
- Working for Hive2, error: org.apache.thrift.TApplicationException: Invalid method name: 'execute'
- Exceptions for Running HiveApp in Mac
- Hbase Connection Issue?
- issue while reading data on hdfs from remote HOT 1
- hbase running app
- Unable to initialize 'javax.el.ExpressionFactory' after update Spring Boot to 1.5.2 HOT 4
- Mapreduce program could only be replicated to 0 nodes instead of minReplication (=1)
- new Interface of Hbase
- Debug hive in eclipse,it didn't work.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from spring-hadoop-samples.