GithubHelp home page GithubHelp logo

Can't get cube segment size about kylin HOT 4 CLOSED

kylinolap avatar kylinolap commented on August 19, 2024
Can't get cube segment size

from kylin.

Comments (4)

binmahone avatar binmahone commented on August 19, 2024

job engine will retrieve the stats from hadoop log after the cube building is done. it seems the job engine failed to find the log it needed. please check the log output of a job step called "Convert Cuboid Data to HFile" (see attached image) to see if there's anything like

HDFS: Number of bytes read=3851451742573

screen shot 2014-11-11 at 1 05 43 pm
screen shot 2014-11-11 at 1 04 46 pm

from kylin.

binmahone avatar binmahone commented on August 19, 2024

btw, if you could leave us your contact info, we might be able to communicate directly with you, so that we could better understand your requirements.

from kylin.

xingfengshen avatar xingfengshen commented on August 19, 2024

Hi, we have fixed this issue.

1st: we start JobHistoryServer
java.net.ConnectException: to 0.0.0.0:10020 failed on connection exception
config hadoop的/etc/hadoop/mapred-site.xml file

mapreduce.jobhistory.address
host:10020

execute this cmd:
mr-jobhistory-daemon.sh start historyserver

2nd: because HBase-0.98.0-hadoop2 use hadoop 2.2.0, but in our cluster the hadoop version is 2.4.1, so it will cause an exception, details can see https://issues.apache.org/jira/browse/MAPREDUCE-5831, so we replace the hadoop jars to 2.4.1

now we build the cube successful.

Thank you very much!

from kylin.

lukehan avatar lukehan commented on August 19, 2024

Hi @xfhap, this is really great reference for others to setup their cluster.

Thank you very much.
Luke

from kylin.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.