Comments (6)
It seems the new table KYLIN_XSLUXA5KGI was not fully successfully created. You will want to recover the new table to a good state (as well as HBase itself), and then resume job in Kylin.
You have found the new regions were in transition, which is a good clue. It seems the new table was assigned to some unstable region server, so the new regions had to be transferred quickly after the table was created. And leave the table in an unavailable state.
HBase master log is where to find more info about the unstable region server. Identify the unstable region server, fix it, or remove it from cluster to ensure it won't take new regions again. Verify the HBase cluster by creating new table from hbase shell and scanning it.
Finally drop table KYLIN_XSLUXA5KGI and resume job in Kylin. Step 5 will recreated the table anyway, the old table is not needed.
from kylin.
Btw, next time pls raise questions in [email protected] -- there you find all the Kylin community.
This KylinOLAP git repo is deprecated.
from kylin.
tks,liyang,i will send issue to [email protected] next time.
BTW, i resolve the problem .
i check my hdfs log and find some information below:
2016-04-12 12:05:05,726 ERROR [RS_OPEN_REGION-slave2:16020-0] handler.OpenRegionHandler: Failed open of region=KYLIN_VKRC32OKFP,,1460433926913.73fb906719a75b2733f046e87fbe8105., starting to roll back the global memstore size. org.apache.hadoop.hbase.DoNotRetryIOException: Compression algorithm 'snappy' previously failed test. at org.apache.hadoop.hbase.util.CompressionTest.testCompression(CompressionTest.java:91) at org.apache.hadoop.hbase.regionserver.HRegion.checkCompressionCodecs(HRegion.java:6300) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6251) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6218) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6189) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6145) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6096) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:362) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:129) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:129) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2016-04-12 12:05:05,727 INFO [RS_OPEN_REGION-slave2:16020-0] coordination.ZkOpenRegionCoordination: Opening of region {ENCODED => 73fb906719a75b2733f046e87fbe8105, NAME => 'KYLIN_VKRC32OKFP,,1460433926913.73fb906719a75b2733f046e87fbe8105.', STARTKEY => '', ENDKEY => '\x00\x01'} failed, transitioning from OPENING to FAILED_OPEN in ZK, expecting version 1 2016-04-12 12:05:05,775 INFO [PriorityRpcServer.handler=18,queue=0,port=16020] regionserver.RSRpcServices: Open KYLIN_VKRC32OKFP,\x00\x01,1460433926913.06978b9fb1e423563a5aae7e1df044d8.
then i realized probably my config about Compression algorithm is wrong
so i disabled Compression algorithm of snappy by delete relative config.
To disable compressing MR jobs you need to modify $KYLIN_HOME/conf/kylin_job_conf.xml by removing all configuration entries related to compression(Just grep the keyword “compress”). To disable compressing hbase tables you need to open $KYLIN_HOME/conf/kylin.properties and remove the line starting with kylin.hbase.default.compression.codec.
finally, i restart my service and it works well.
from kylin.
Thanks for sharing the solution. Others will learn from it.
On Tue, Apr 12, 2016 at 3:54 PM, yeqing0907 [email protected]
wrote:
tks,liyang,i will send issue to [email protected] next time.
BTW, i resolve the problem .
i check my hdfs log and find some information below:
2016-04-12 12:05:05,726 ERROR [RS_OPEN_REGION-slave2:16020-0]
handler.OpenRegionHandler: Failed open of
region=KYLIN_VKRC32OKFP,,1460433926913.73fb906719a75b2733f046e87fbe8105.,
starting to roll back the global memstore size.
org.apache.hadoop.hbase.DoNotRetryIOException: Compression algorithm
'snappy' previously failed test.
at
org.apache.hadoop.hbase.util.CompressionTest.testCompression(CompressionTest.java:91)
at
org.apache.hadoop.hbase.regionserver.HRegion.checkCompressionCodecs(HRegion.java:6300)
at
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6251)
at
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6218)
at
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6189)
at
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6145)
at
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:6096)
at
org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:362)
at
org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:129)
at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:129)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-04-12 12:05:05,727 INFO [RS_OPEN_REGION-slave2:16020-0]
coordination.ZkOpenRegionCoordination: Opening of region {ENCODED =>
73fb906719a75b2733f046e87fbe8105, NAME =>
'KYLIN_VKRC32OKFP,,1460433926913.73fb906719a75b2733f046e87fbe8105.',
STARTKEY => '', ENDKEY => '\x00\x01'} failed, transitioning from OPENING to
FAILED_OPEN in ZK, expecting version 1
2016-04-12 12:05:05,775 INFO
[PriorityRpcServer.handler=18,queue=0,port=16020]
regionserver.RSRpcServices: Open
KYLIN_VKRC32OKFP,\x00\x01,1460433926913.06978b9fb1e423563a5aae7e1df044d8.then i realized probably my config about Compression algorithm is wrong
so i disabled Compression algorithm of snappy by delete relative config.To disable compressing MR jobs you need to modify
$KYLIN_HOME/conf/kylin_job_conf.xml by removing all configuration entries
related to compression(Just grep the keyword “compress”). To disable
compressing hbase tables you need to open $KYLIN_HOME/conf/kylin.properties
and remove the line starting with kylin.hbase.default.compression.codec.finally, i restart my service and it works well.
—
You are receiving this because you commented.
Reply to this email directly or view it on GitHub
#470 (comment)
from kylin.
赞!
from kylin.
open $KYLIN_HOME/conf/kylin.properties and remove the line starting with kylin.hbase.default.compression.codec.
from kylin.
Related Issues (20)
- execute ./kylin.sh start error on ubuntu linux 0.14 HOT 1
- kylin on HDP-2.4.2.0-258 - Error creating bean with name HOT 4
- Kylin Web not running HOT 1
- A problem during RUN sample queries. HOT 1
- error: Caused by: com.kylinolap.rest.exception.InternalErrorException: Cube test_table_cube doesn't contain any ready segment
- An error when Cube runs the action "build" :java.lang.NoSuchMethodError: org.apache.hadoop.hive.shims.HadoopShims.getUGIForConf(Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/security/UserGroupInformation;
- can't be used "`"
- 1.5.2.1 hbase1.x IRealizationSegment not found. HOT 3
- java.lang.OutOfMemoryError: Java heap space
- 查询延时高 HOT 1
- Build cube with spark HOT 1
- build cube with api HOT 1
- docker run apachekylin/apache-kylin-standalone:3.0.1 error
- ERROR facing while starting kylin HOT 1
- kylin failed to connect postgress metastore
- No access attributes defined for login page URL
- Facing issue while building Kylin Cube need help to fix it Cube is not building, logs are given below
- Java heap space
- run `kylin.sh start` find_hive_dependency.sh can‘t get hive_warehouse_dir when the hive install TEZ HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kylin.