GithubHelp home page GithubHelp logo

sairamkrish / trino-superset-demo Goto Github PK

View Code? Open in Web Editor NEW
13.0 4.0 7.0 7 KB

Demo application to showcase integration of Trino with Apache superset using Minio and Hive metastore

Dockerfile 56.74% Shell 43.26%
trino trinodb superset apache-superset parquet demo showcase docker

trino-superset-demo's Introduction

Trino Superset Demo

This repository contains a demo integration of trino with Apache Superset. Many times, I like to visualize contents in formats like parquet, csv, json etc., But getting them in Apache Superset was little hard for me. With this repository, we can visualize columnar file formats.

The complete stack is runable in local. Useful for doing local data analytics experimentation.

Tech stack

  • Trino (formerly PrestoSQL)
  • Minio - for hosting the file. AWS S3 compatible.
  • Hive Metastore - for accessing files from Trino using Hive connector
  • Apache superset - for visualizing

The following file types are supported for the Hive connector:

  • ORC
  • Parquet
  • Avro
  • RCText (RCFile using ColumnarSerDe)
  • RCBinary (RCFile using LazyBinaryColumnarSerDe)
  • SequenceFile
  • JSON (using org.apache.hive.hcatalog.data.JsonSerDe)
  • CSV (using org.apache.hadoop.hive.serde2.OpenCSVSerde)
  • TextFile

Getting started

  • docker-compose up
  • Docker volumes are locally mounted. This should help in understanding the data of different service.

Setup superset

  • First time : sh superset_init.sh
  • In Superset, add trino with SqlAlchemy URI - trino://hive@trino-coordinator:8080/hive

Service links

  • Superset (username: admin, password: admin)
  • Minio - username: minio_access_key, password: minio_secret_key)
  • Trino

Trino CLI

docker exec -it trino trino

Run SQL commands listed trino/init.sql

Useful commands

# restart just trino
docker-compose restart trino-coordinator

trino-superset-demo's People

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar avatar

Forkers

slachiewicz myzhongguo johnjansen erusso7 sivatradepro daguito81 fdoperezi

trino-superset-demo's Issues

Hive not starting

Hi, on Docker Desktop 4.8.2 on Windows 10 I have this error:

Log4j appears to be running in a Servlet environment, but there's no log4j-web module available. If you want better web container support, please add the log4j-web JAR to your web archive or server lib directory.

Also, on Windows Docker I don't know how could this command be run on the Superset image:

First time : sh superset_init.sh

Thanks

The entire log

hive-metastore                  | Waiting for database on mariadb to launch on 3306 ...
hive-metastore                  | Database on mariadb:3306 started
hive-metastore                  | Init apache hive metastore on mariadb:3306
hive-metastore                  | SLF4J: Class path contains multiple SLF4J bindings.
hive-metastore                  | SLF4J: Found binding in [jar:file:/opt/apache-hive-metastore-3.0.0-bin/lib/log4j-slf4j-impl-2.8.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
hive-metastore                  | SLF4J: Found binding in [jar:file:/opt/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
hive-metastore                  | SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
hive-metastore                  | SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
hive-metastore                  | Metastore connection URL:  jdbc:mysql://mariadb:3306/metastore_db?createDatabaseIfNotExist=true
hive-metastore                  | Metastore Connection Driver :  com.mysql.jdbc.Driver
hive-metastore                  | Metastore connection User:  admin
hive-metastore                  | Loading class com.mysql.jdbc.Driver'. This is deprecated. The new driver class is com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.
hive-metastore                  | Starting metastore schema initialization to 3.0.0
hive-metastore                  | Initialization script hive-schema-3.0.0.mysql.sql
hive-metastore                  | 1/506        -- MySQL dump 10.13  Distrib 5.5.25, for osx10.6 (i386)
hive-metastore                  | 2/506        --
hive-metastore                  | 3/506        -- Host: localhost    Database: test
hive-metastore                  | 4/506        -- ------------------------------------------------------
hive-metastore                  | 5/506        -- Server version 5.5.25
hive-metastore                  | 6/506        
hive-metastore                  | 7/506        /*!40101 SET @OLD_CHARACTER_SET_CLIENT=@@CHARACTER_SET_CLIENT /;
hive-metastore                  | No rows affected (0.013 seconds)
hive-metastore                  | 8/506        /!40101 SET @OLD_CHARACTER_SET_RESULTS=@@CHARACTER_SET_RESULTS /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 9/506        /!40101 SET @OLD_COLLATION_CONNECTION=@@COLLATION_CONNECTION /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 10/506       /!40101 SET NAMES utf8 /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 11/506       /!40103 SET @OLD_TIME_ZONE=@@TIME_ZONE /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 12/506       /!40103 SET TIME_ZONE='+00:00' /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 13/506       /!40014 SET @OLD_UNIQUE_CHECKS=@@UNIQUE_CHECKS, UNIQUE_CHECKS=0 /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 14/506       /!40014 SET @OLD_FOREIGN_KEY_CHECKS=@@FOREIGN_KEY_CHECKS, FOREIGN_KEY_CHECKS=0 /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 15/506       /!40101 SET @OLD_SQL_MODE=@@SQL_MODE, SQL_MODE='NO_AUTO_VALUE_ON_ZERO' /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 16/506       /!40111 SET @OLD_SQL_NOTES=@@SQL_NOTES, SQL_NOTES=0 /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 17/506       
hive-metastore                  | 18/506       --
hive-metastore                  | 19/506       -- Table structure for table BUCKETING_COLS
hive-metastore                  | 20/506       --
hive-metastore                  | 21/506       
hive-metastore                  | 22/506       /!40101 SET @saved_cs_client     = @@character_set_client /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 23/506       /!40101 SET character_set_client = utf8 /;
hive-metastore                  | No rows affected (0.002 seconds)
hive-metastore                  | 24/506       CREATE TABLE IF NOT EXISTS BUCKETING_COLS ( 
hive-metastore                  | SD_ID bigint(20) NOT NULL, 
hive-metastore                  | BUCKET_COL_NAME varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, 
hive-metastore                  | INTEGER_IDX int(11) NOT NULL, 
hive-metastore                  | PRIMARY KEY (SD_ID,INTEGER_IDX), 
hive-metastore                  | KEY BUCKETING_COLS_N49 (SD_ID), 
hive-metastore                  | CONSTRAINT BUCKETING_COLS_FK1 FOREIGN KEY (SD_ID) REFERENCES SDS (SD_ID) 
hive-metastore                  | ) ENGINE=InnoDB DEFAULT CHARSET=latin1;
hive-metastore                  | No rows affected (0.007 seconds)
hive-metastore                  | 25/506       /!40101 SET character_set_client = @saved_cs_client /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 26/506       
hive-metastore                  | 27/506       --
hive-metastore                  | 28/506       -- Table structure for table CDS
hive-metastore                  | 29/506       --
hive-metastore                  | 30/506       
hive-metastore                  | 31/506       /!40101 SET @saved_cs_client     = @@character_set_client /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 32/506       /!40101 SET character_set_client = utf8 /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 33/506       CREATE TABLE IF NOT EXISTS CDS ( 
hive-metastore                  | CD_ID bigint(20) NOT NULL, 
hive-metastore                  | PRIMARY KEY (CD_ID) 
hive-metastore                  | ) ENGINE=InnoDB DEFAULT CHARSET=latin1;
hive-metastore                  | No rows affected (0.006 seconds)
hive-metastore                  | 34/506       /!40101 SET character_set_client = @saved_cs_client /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 35/506       
hive-metastore                  | 36/506       --
hive-metastore                  | 37/506       -- Table structure for table COLUMNS_V2
hive-metastore                  | 38/506       --
hive-metastore                  | 39/506       
hive-metastore                  | 40/506       /!40101 SET @saved_cs_client     = @@character_set_client /;
hive-metastore                  | No rows affected (0 seconds)
hive-metastore                  | 41/506       /!40101 SET character_set_client = utf8 /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 42/506       CREATE TABLE IF NOT EXISTS COLUMNS_V2 ( 
hive-metastore                  | CD_ID bigint(20) NOT NULL, 
hive-metastore                  | COMMENT varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, 
hive-metastore                  | COLUMN_NAME varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, 
hive-metastore                  | TYPE_NAME MEDIUMTEXT DEFAULT NULL, 
hive-metastore                  | INTEGER_IDX int(11) NOT NULL, 
hive-metastore                  | PRIMARY KEY (CD_ID,COLUMN_NAME), 
hive-metastore                  | KEY COLUMNS_V2_N49 (CD_ID), 
hive-metastore                  | CONSTRAINT COLUMNS_V2_FK1 FOREIGN KEY (CD_ID) REFERENCES CDS (CD_ID) 
hive-metastore                  | ) ENGINE=InnoDB DEFAULT CHARSET=latin1;
hive-metastore                  | No rows affected (0.007 seconds)
hive-metastore                  | 43/506       /!40101 SET character_set_client = @saved_cs_client /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 44/506       
hive-metastore                  | 45/506       --
hive-metastore                  | 46/506       -- Table structure for table DATABASE_PARAMS
hive-metastore                  | 47/506       --
hive-metastore                  | 48/506       
hive-metastore                  | 49/506       /!40101 SET @saved_cs_client     = @@character_set_client /;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 50/506       /!40101 SET character_set_client = utf8 /;
hive-metastore                  | No rows affected (0 seconds)
hive-metastore                  | 51/506       CREATE TABLE IF NOT EXISTS DATABASE_PARAMS ( 
hive-metastore                  | DB_ID bigint(20) NOT NULL, 
hive-metastore                  | PARAM_KEY varchar(180) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, 
hive-metastore                  | PARAM_VALUE varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, 
hive-metastore                  | PRIMARY KEY (DB_ID,PARAM_KEY), 
hive-metastore                  | KEY DATABASE_PARAMS_N49 (DB_ID), 
hive-metastore                  | CONSTRAINT DATABASE_PARAMS_FK1 FOREIGN KEY (DB_ID) REFERENCES DBS (DB_ID) 
hive-metastore                  | ) ENGINE=InnoDB DEFAULT CHARSET=latin1;
hive-metastore                  | No rows affected (0.006 seconds)
hive-metastore                  | 52/506       /!40101 SET character_set_client = @saved_cs_client */;
hive-metastore                  | No rows affected (0.001 seconds)
hive-metastore                  | 53/506       
hive-metastore                  | 54/506       CREATE TABLE CTLGS ( 
hive-metastore                  | CTLG_ID BIGINT PRIMARY KEY, 
hive-metastore                  | NAME VARCHAR(256), 
hive-metastore                  | DESC VARCHAR(4000), 
hive-metastore                  | LOCATION_URI VARCHAR(4000) NOT NULL, 
hive-metastore                  | UNIQUE KEY UNIQUE_CATALOG (NAME) 
hive-metastore                  | ) ENGINE=InnoDB DEFAULT CHARSET=latin1;
hive-metastore                  | Warning: Table 'ctlgs' already exists (state=42S01,code=1050)
hive-metastore                  | java.sql.SQLWarning: Table 'ctlgs' already exists
hive-metastore                  |  at com.mysql.cj.protocol.a.NativeProtocol.convertShowWarningsToSQLWarnings(NativeProtocol.java:2065)
hive-metastore                  |  at com.mysql.cj.jdbc.StatementImpl.getWarnings(StatementImpl.java:1733)
hive-metastore                  |  at sqlline.Commands.execute(Commands.java:849)
hive-metastore                  |  at sqlline.Commands.sql(Commands.java:733)
hive-metastore                  |  at sqlline.SqlLine.dispatch(SqlLine.java:795)
hive-metastore                  |  at sqlline.SqlLine.runCommands(SqlLine.java:1706)
hive-metastore                  |  at sqlline.Commands.run(Commands.java:1317)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore                  |  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore                  |  at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore                  |  at sqlline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:38)
hive-metastore                  |  at sqlline.SqlLine.dispatch(SqlLine.java:791)
hive-metastore                  |  at sqlline.SqlLine.initArgs(SqlLine.java:595)
hive-metastore                  |  at sqlline.SqlLine.begin(SqlLine.java:643)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.runSqlLine(MetastoreSchemaTool.java:1034)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.runSqlLine(MetastoreSchemaTool.java:1007)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.doInit(MetastoreSchemaTool.java:596)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.doInit(MetastoreSchemaTool.java:574)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.run(MetastoreSchemaTool.java:1273)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.main(MetastoreSchemaTool.java:1178)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore                  |  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore                  |  at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore                  |  at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
hive-metastore                  |  at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
hive-metastore                  | Error: Table 'ctlgs' already exists (state=42S01,code=1050)
hive-metastore                  | java.sql.SQLSyntaxErrorException: Table 'ctlgs' already exists
hive-metastore                  |  at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:120)
hive-metastore                  |  at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
hive-metastore                  |  at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
hive-metastore                  |  at com.mysql.cj.jdbc.StatementImpl.executeInternal(StatementImpl.java:764)
hive-metastore                  |  at com.mysql.cj.jdbc.StatementImpl.execute(StatementImpl.java:648)
hive-metastore                  |  at sqlline.Commands.execute(Commands.java:823)
hive-metastore                  |  at sqlline.Commands.sql(Commands.java:733)
hive-metastore                  |  at sqlline.SqlLine.dispatch(SqlLine.java:795)
hive-metastore                  |  at sqlline.SqlLine.runCommands(SqlLine.java:1706)
hive-metastore                  |  at sqlline.Commands.run(Commands.java:1317)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore                  |  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore                  |  at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore                  |  at sqlline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:38)
hive-metastore                  |  at sqlline.SqlLine.dispatch(SqlLine.java:791)
hive-metastore                  |  at sqlline.SqlLine.initArgs(SqlLine.java:595)
hive-metastore                  |  at sqlline.SqlLine.begin(SqlLine.java:643)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.runSqlLine(MetastoreSchemaTool.java:1034)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.runSqlLine(MetastoreSchemaTool.java:1007)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.doInit(MetastoreSchemaTool.java:596)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.doInit(MetastoreSchemaTool.java:574)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.run(MetastoreSchemaTool.java:1273)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.main(MetastoreSchemaTool.java:1178)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore                  |  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore                  |  at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore                  |  at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
hive-metastore                  |  at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
hive-metastore                  | Aborting command set because "force" is false and command failed: "CREATE TABLE CTLGS ( 
hive-metastore                  | CTLG_ID BIGINT PRIMARY KEY, 
hive-metastore                  | NAME VARCHAR(256), 
hive-metastore                  | DESC VARCHAR(4000), 
hive-metastore                  | LOCATION_URI VARCHAR(4000) NOT NULL, 
hive-metastore                  | UNIQUE KEY UNIQUE_CATALOG (NAME) 
hive-metastore                  | ) ENGINE=InnoDB DEFAULT CHARSET=latin1;"
hive-metastore                  | Closing: com.mysql.cj.jdbc.ConnectionImpl
hive-metastore                  | Schema initialization FAILED! Metastore state would be inconsistent !!
hive-metastore                  | Underlying cause: java.io.IOException : Schema script failed, errorcode OTHER
hive-metastore                  | Use --verbose for detailed stacktrace.
hive-metastore                  | *** schemaTool failed ***
hive-metastore                  | 2022-05-23 16:35:31,397 shutdown-hook-0 INFO Log4j appears to be running in a Servlet environment, but there's no log4j-web module available. If you want better web container support, please add the log4j-web JAR to your web archive or server lib directory.
hive-metastore                  | 2022-05-23 16:35:31,409 shutdown-hook-0 INFO Log4j appears to be running in a Servlet environment, but there's no log4j-web module available. If you want better web container support, please add the log4j-web JAR to your web archive or server lib directory.
hive-metastore                  | 2022-05-23 16:35:31,435 shutdown-hook-0 WARN Unable to register Log4j shutdown hook because JVM is shutting down. Using SimpleLogger
hive-metastore                  | 2022-05-23 16:35:31: Starting Metastore Server
hive-metastore                  | SLF4J: Class path contains multiple SLF4J bindings.
hive-metastore                  | SLF4J: Found binding in [jar:file:/opt/apache-hive-metastore-3.0.0-bin/lib/log4j-slf4j-impl-2.8.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
hive-metastore                  | SLF4J: Found binding in [jar:file:/opt/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
hive-metastore                  | SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
hive-metastore                  | SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
hive-metastore                  | 2022-05-23 16:35:36,681 main INFO Log4j appears to be running in a Servlet environment, but there's no log4j-web module available. If you want better web container support, please add the log4j-web JAR to your web archive or server lib directory.
hive-metastore                  | Loading class com.mysql.jdbc.Driver'. This is deprecated. The new driver class is com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.
hive-metastore                  | MetaException(message:Version information not found in metastore.)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.RetryingHMSHandler.(RetryingHMSHandler.java:84)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:93)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:8541)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:8536)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:8806)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:8723)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore                  |  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore                  |  at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore                  |  at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
hive-metastore                  |  at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
hive-metastore                  | Caused by: MetaException(message:Version information not found in metastore.)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:8820)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:8798)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore                  |  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore                  |  at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
hive-metastore                  |  at com.sun.proxy.$Proxy31.verifySchema(Unknown Source)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMSForConf(HiveMetaStore.java:684)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:677)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:754)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:525)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore                  |  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore                  |  at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.RetryingHMSHandler.(RetryingHMSHandler.java:80)
hive-metastore                  |  ... 11 more
hive-metastore                  | Exception in thread "main" MetaException(message:Version information not found in metastore.)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.RetryingHMSHandler.(RetryingHMSHandler.java:84)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:93)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:8541)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:8536)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:8806)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:8723)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore                  |  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore                  |  at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore                  |  at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
hive-metastore                  |  at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
hive-metastore                  | Caused by: MetaException(message:Version information not found in metastore.)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:8820)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:8798)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore                  |  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore                  |  at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
hive-metastore                  |  at com.sun.proxy.$Proxy31.verifySchema(Unknown Source)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMSForConf(HiveMetaStore.java:684)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:677)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:754)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:525)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore                  |  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore                  |  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore                  |  at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
hive-metastore                  |  at org.apache.hadoop.hive.metastore.RetryingHMSHandler.(RetryingHMSHandler.java:80)
hive-metastore                  |  ... 11 more
hive-metastore                  | 2022-05-23 16:35:40,492 shutdown-hook-0 INFO Log4j appears to be running in a Servlet environment, but there's no log4j-web module available. If you want better web container support, please add the log4j-web JAR to your web archive or server lib directory.
hive-metastore                  | 2022-05-23 16:35:40,496 shutdown-hook-0 INFO Log4j appears to be running in a Servlet environment, but there's no log4j-web module available. If you want better web container support, please add the log4j-web JAR to your web archive or server lib directory.
hive-metastore                  | 2022-05-23 16:35:40,512 shutdown-hook-0 WARN Unable to register Log4j shutdown hook because JVM is shutting down. Using SimpleLogger

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.