suhothayan / hadoop-spark-pig-hive Goto Github PK
View Code? Open in Web Editor NEWDocker with hadoop spark pig hive
License: Apache License 2.0
Docker with hadoop spark pig hive
License: Apache License 2.0
I want to run pig in mapreduce mode.
But I am getting this error.
2020-12-26 00:18:55,435 [main] INFO org.apache.hadoop.mapred.ClientServiceDelegate - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
2020-12-26 00:18:56,440 [main] INFO org.apache.hadoop.ipc.Client - Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2020-12-26 00:18:57,442 [main] INFO org.apache.hadoop.ipc.Client - Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2020-12-26 00:19:05,560 [main] WARN org.apache.pig.tools.pigstats.mapreduce.MRJobStats - Failed to get reduce task report
Is this is an configuration issue? Please support
i tried it with below command:
yarn jar mapreduce-design-patterns/mapreduce-design-patterns/target/mapreduce-design-patterns-1.0-SNAPSHOT.jar week4.count.WordCount stackapps.com/stackapps.com/comments/ output/wordCount
RunJar jarFile [mainClass] args...
bash-4.1# yarn jar mapreduce-design-patterns/mapreduce-design-patterns/target/mapreduce-design-patterns-1.0-SNAPSHOT.jar week4.count.WordCount stackapps.com/stackapps.com/comments/ output/wordCount
23/11/03 10:10:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
23/11/03 10:10:35 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
23/11/03 10:10:35 INFO input.FileInputFormat: Total input paths to process : 1
23/11/03 10:10:35 INFO mapreduce.JobSubmitter: number of splits:1
23/11/03 10:10:35 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1699020468106_0001
23/11/03 10:10:36 INFO impl.YarnClientImpl: Submitted application application_1699020468106_0001
23/11/03 10:10:36 INFO mapreduce.Job: The url to track the job: http://8c0d59f0a1c5:8088/proxy/application_1699020468106_0001/
23/11/03 10:10:36 INFO mapreduce.Job: Running job: job_1699020468106_0001
my operating system is lsb_release -a
please advise on this matter
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.