GithubHelp home page GithubHelp logo

hadoop-spark-pig-hive's People

Contributors

suhothayan avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

hadoop-spark-pig-hive's Issues

Failed to get reduce task report after execution of pig in mapreduce mode

I want to run pig in mapreduce mode.
But I am getting this error.

2020-12-26 00:18:55,435 [main] INFO  org.apache.hadoop.mapred.ClientServiceDelegate - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
2020-12-26 00:18:56,440 [main] INFO  org.apache.hadoop.ipc.Client - Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2020-12-26 00:18:57,442 [main] INFO  org.apache.hadoop.ipc.Client - Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2020-12-26 00:19:05,560 [main] WARN  org.apache.pig.tools.pigstats.mapreduce.MRJobStats - Failed to get reduce task report

Is this is an configuration issue? Please support

Map Reduce Jobs not competed

I have submitted several map-reduce jobs (jar) files, but all are getting stuck in map-reduce. Job: Running job: job_id state

i tried it with below command:

yarn jar mapreduce-design-patterns/mapreduce-design-patterns/target/mapreduce-design-patterns-1.0-SNAPSHOT.jar week4.count.WordCount stackapps.com/stackapps.com/comments/ output/wordCount

RunJar jarFile [mainClass] args...
bash-4.1# yarn jar mapreduce-design-patterns/mapreduce-design-patterns/target/mapreduce-design-patterns-1.0-SNAPSHOT.jar week4.count.WordCount stackapps.com/stackapps.com/comments/ output/wordCount
23/11/03 10:10:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
23/11/03 10:10:35 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
23/11/03 10:10:35 INFO input.FileInputFormat: Total input paths to process : 1
23/11/03 10:10:35 INFO mapreduce.JobSubmitter: number of splits:1
23/11/03 10:10:35 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1699020468106_0001
23/11/03 10:10:36 INFO impl.YarnClientImpl: Submitted application application_1699020468106_0001
23/11/03 10:10:36 INFO mapreduce.Job: The url to track the job: http://8c0d59f0a1c5:8088/proxy/application_1699020468106_0001/
23/11/03 10:10:36 INFO mapreduce.Job: Running job: job_1699020468106_0001

my operating system is lsb_release -a

please advise on this matter

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.