an error occurred when build a sample cube at step 5:create HTable about kylin

[liyang-gmt8]

It seems the new table KYLIN_XSLUXA5KGI was not fully successfully created. You will want to recover the new table to a good state (as well as HBase itself), and then resume job in Kylin.

You have found the new regions were in transition, which is a good clue. It seems the new table was assigned to some unstable region server, so the new regions had to be transferred quickly after the table was created. And leave the table in an unavailable state.

HBase master log is where to find more info about the unstable region server. Identify the unstable region server, fix it, or remove it from cluster to ensure it won't take new regions again. Verify the HBase cluster by creating new table from hbase shell and scanning it.

Finally drop table KYLIN_XSLUXA5KGI and resume job in Kylin. Step 5 will recreated the table anyway, the old table is not needed.

[liyang-gmt8]

Btw, next time pls raise questions in [email protected] -- there you find all the Kylin community.

This KylinOLAP git repo is deprecated.

[yeqing0907]

tks,liyang,i will send issue to [email protected] next time.

BTW, i resolve the problem .

i check my hdfs log and find some information below:

2016-04-12 12:05:05,726 ERROR [RS_OPEN_REGION-slave2:16020-0] handler.OpenRegionHandler: Failed open of region=KYLIN_VKRC32OKFP,,1460433926913.73fb906719a75b2733f046e87fbe8105., starting to roll back the global memstore size. org.apache.hadoop.hbase.DoNotRetryIOException: Compression algorithm 'snappy' previously failed test. at org.apache.hadoop.hbase.util.CompressionTest.testCompression(CompressionTest.java:91) at org.apache.hadoop.hbase.regionserver.HRegion.checkCompressionCodecs(HRegion.java:6300) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6251) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6218) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6189) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6145) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6096) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:362) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:129) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:129) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2016-04-12 12:05:05,727 INFO [RS_OPEN_REGION-slave2:16020-0] coordination.ZkOpenRegionCoordination: Opening of region {ENCODED => 73fb906719a75b2733f046e87fbe8105, NAME => 'KYLIN_VKRC32OKFP,,1460433926913.73fb906719a75b2733f046e87fbe8105.', STARTKEY => '', ENDKEY => '\x00\x01'} failed, transitioning from OPENING to FAILED_OPEN in ZK, expecting version 1 2016-04-12 12:05:05,775 INFO [PriorityRpcServer.handler=18,queue=0,port=16020] regionserver.RSRpcServices: Open KYLIN_VKRC32OKFP,\x00\x01,1460433926913.06978b9fb1e423563a5aae7e1df044d8.

then i realized probably my config about Compression algorithm is wrong
so i disabled Compression algorithm of snappy by delete relative config.

To disable compressing MR jobs you need to modify $KYLIN_HOME/conf/kylin_job_conf.xml by removing all configuration entries related to compression(Just grep the keyword “compress”). To disable compressing hbase tables you need to open $KYLIN_HOME/conf/kylin.properties and remove the line starting with kylin.hbase.default.compression.codec.

finally, i restart my service and it works well.

[liyang-gmt8]

Thanks for sharing the solution. Others will learn from it.

On Tue, Apr 12, 2016 at 3:54 PM, yeqing0907 [email protected]
wrote:

tks,liyang,i will send issue to [email protected] next time.

BTW, i resolve the problem .

i check my hdfs log and find some information below:

2016-04-12 12:05:05,726 ERROR [RS_OPEN_REGION-slave2:16020-0]
handler.OpenRegionHandler: Failed open of
region=KYLIN_VKRC32OKFP,,1460433926913.73fb906719a75b2733f046e87fbe8105.,
starting to roll back the global memstore size.
org.apache.hadoop.hbase.DoNotRetryIOException: Compression algorithm
'snappy' previously failed test.
at
org.apache.hadoop.hbase.util.CompressionTest.testCompression(CompressionTest.java:91)
at
org.apache.hadoop.hbase.regionserver.HRegion.checkCompressionCodecs(HRegion.java:6300)
at
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6251)
at
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6218)
at
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6189)
at
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6145)
at
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6096)
at
org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:362)
at
org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:129)
at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:129)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-04-12 12:05:05,727 INFO [RS_OPEN_REGION-slave2:16020-0]
coordination.ZkOpenRegionCoordination: Opening of region {ENCODED =>
73fb906719a75b2733f046e87fbe8105, NAME =>
'KYLIN_VKRC32OKFP,,1460433926913.73fb906719a75b2733f046e87fbe8105.',
STARTKEY => '', ENDKEY => '\x00\x01'} failed, transitioning from OPENING to
FAILED_OPEN in ZK, expecting version 1
2016-04-12 12:05:05,775 INFO
[PriorityRpcServer.handler=18,queue=0,port=16020]
regionserver.RSRpcServices: Open
KYLIN_VKRC32OKFP,\x00\x01,1460433926913.06978b9fb1e423563a5aae7e1df044d8.

then i realized probably my config about Compression algorithm is wrong
so i disabled Compression algorithm of snappy by delete relative config.

To disable compressing MR jobs you need to modify
$KYLIN_HOME/conf/kylin_job_conf.xml by removing all configuration entries
related to compression(Just grep the keyword “compress”). To disable
compressing hbase tables you need to open $KYLIN_HOME/conf/kylin.properties
and remove the line starting with kylin.hbase.default.compression.codec.

finally, i restart my service and it works well.

—
You are receiving this because you commented.
Reply to this email directly or view it on GitHub
#470 (comment)

[tuxtorres]

赞！

[HongzhuLiu]

open $KYLIN_HOME/conf/kylin.properties and remove the line starting with kylin.hbase.default.compression.codec.