|NO.Z.00017|——————————|Deployment|——|Hadoop&OLAP数据库管理系统.v17|——|Kylin.v08|Kylin部署配置|

一、Kylin安装环境准备：依赖环境

软件	版本
Hive	2.3.7
Hadoop	2.9.2
HBase	1.3.1
Zookeeper	3.4.14
Kafka	1.0.2
Spark	2.4.5

二、集群规划

server		Hadoop01	hadoop02	hadoop03
HDFS	NameNode	?
HDFS	DataNode	?	?	?
Yarn	ResourceManager			?
	NodeManager	?	?	?
	JobHistoryServer	?
HBase	Hmaster	?
HBase	HRegionServer	?	?	?
Hive	Hive		?
Hive	HiveMetastore			?
Zookeeper		?	?	?
Kafka		?	?	?
Kylin			?

三、HBase配置文件参数

### --- 注意：要求hbase的hbase.zookeeper.quorum值必须只能是host1、host2、...
### --- 不允许出现host:2181；hbase-site.xml文件：

~~~     # 修改hbase配置文件
[root@hadoop01 ~]# vim /opt/yanqi/servers/hbase-1.3.1/conf/hbase-site.xml



        
        
                hbase.rootdir
                hdfs://hadoop01:9000/hbase
        

        
        
                hbase.cluster.distributed
                true
        

        
        
                hbase.zookeeper.quorum
                hadoop01,hadoop02,hadoop03

四、Kylin配置资源准备

### --- 下载kylin版本包并解压到安装目录

~~~     # 下载kylin版本包
[root@hadoop01 software]# wget https://archive.apache.org/dist/kylin/apache-kylin-3.1.1/apache-kylin-3.1.1-bin-hbase1x.tar.gz
~~~     # 解压版本包
[root@hadoop01 software]# tar -zxvf apache-kylin-3.1.1-bin-hbase1x.tar.gz -C ../servers/
~~~     # 修改配置目录名称
[root@hadoop01 ~]# cd /opt/yanqi/servers/
[root@hadoop01 servers]# mv apache-kylin-3.1.1-bin-hbase1x kylin-3.1.1

### --- 添加环境变量，并使之生效

~~~     # 配置kylin系统环境变量
[root@hadoop01 ~]# vim /etc/profile
##KYLIN_HOME
export KYLIN_HOME=/opt/yanqi/servers/kylin-3.1.1
export PATH=$PATH:$KYLIN_HOME/bin

~~~     # 使环境变量生效

[root@hadoop01 ~]# source /etc/profile

五、kylin安装部署

### --- 增加kylin依赖组件的配置

~~~     # 添加kylin依赖组件
[root@hadoop01 ~]# cd $KYLIN_HOME/conf

[root@hadoop01 conf]# ln -s $HADOOP_HOME/etc/hadoop/hdfs-site.xml hdfs-site.xml
[root@hadoop01 conf]# ln -s $HADOOP_HOME/etc/hadoop/core-site.xml core-site.xml
[root@hadoop01 conf]# ln -s $HBASE_HOME/conf/hbase-site.xml hbase-site.xml
[root@hadoop01 conf]# ln -s $HIVE_HOME/conf/hive-site.xml hive-site.xml
[root@hadoop01 conf]# ln -s $SPARK_HOME/conf/spark-defaults.conf spark-defaults.conf

### --- 修改 kylin.sh

~~~     # 修改kylin.sh配置文件
[root@hadoop01 ~]# vim $KYLIN_HOME/bin/kylin.sh
~~~第21~24行添加如下内容：
export HADOOP_HOME=/opt/yanqi/servers/hadoop-2.9.2
export HIVE_HOME=/opt/yanqi/servers/hive-2.3.7
export HBASE_HOME=/opt/yanqi/servers/hbase-1.3.1
export SPARK_HOME=/opt/yanqi/servers/spark-2.4.5

### --- 检查依赖

[root@hadoop01 ~]# $KYLIN_HOME/bin/check-env.sh
 ~~~输出参数
 Retrieving hadoop conf dir...
...................................................[PASS]
KYLIN_HOME is set to /opt/yanqi/servers/kylin-3.1.1
Checking HBase
...................................................[PASS]
Checking hive
...................................................[PASS]
Checking hadoop shell
...................................................[PASS]
Checking hdfs working dir
...................................................[PASS]
Retrieving Spark dependency...
...................................................[PASS]
Retrieving Flink dependency...
Optional dependency flink not found, if you need this; set FLINK_HOME, or run bin/download-flink.sh
...................................................[PASS]
Retrieving kafka dependency...
...................................................[PASS]

Checking environment finished successfully. To check again, run 'bin/check-env.sh' manually.

六、启动集群

### --- 启动 zookeeper（Hadoop01）

~~~     # 启动zookeeper集群
[root@hadoop01 ~]# ./zk.sh start

### --- 启动 HDFS（Hadoop01）

~~~     # 启动hdfs服务：Hadoop01
[root@hadoop01 ~]# start-dfs.sh

### --- 启动 YARN （Hadoop01）

~~~     # 启动yarn服务：Hadoop01
[root@hadoop01 ~]# start-yarn.sh

### --- 启动 HBase（Hadoop01）

~~~     # 启动HBase服务：Hadoop01
[root@hadoop01 ~]# start-hbase.sh

### --- 启动 metastore（Hadoop01、Hadoop03）

~~~     # 启动hive-metastore服务：Hadoop01、Hadoop03
[root@hadoop01 ~]# nohup hive --service metastore &
~~~     # 查看metastore进程
[root@hadoop01 ~]# lsof -i:9083

### --- 启动Yarn history server（Hadoop01）

~~~     # 启动yarn history server：Hadoop01
[root@hadoop01 ~]# mr-jobhistory-daemon.sh start historyserver

### --- 启动 kylin（Hadoop01）

~~~     # 启动kylin服务：Hadoop01
[root@hadoop01 ~]# kylin.sh start

七、访问kylin-UI管理界面：登录 Kylin Web界面

URL	http://hadoop01:7070/kylin
默认用户名	ADMIN
默认密码	KYLIN 备注：用户名和密码都必须是大写

八、通过Chrome访问：http://hadoop01:7070/kylin：Kylin初始界面九、Kylin管理界面

附录一：报错处理一：

### --- 报错想象

[root@hadoop01 ~]# $KYLIN_HOME/bin/check-env.sh
/opt/yanqi/servers/kylin-3.1.1/bin/check-port-availability.sh: line 30: netstat: command not found

### --- 报错分析

net-tools工具未安装

### --- 解决方案

[root@hadoop01 ~]#  yum -y install net-tools

Walter Savage Landor:strove with none,for none was worth my strife.Nature I loved and, next to Nature, Art:I warm'd both hands before the fire of life.It sinks, and I am ready to depart ——W.S.Landor

dov005-olap

|NO.Z.00017|——————————|Deployment|——|Hadoop&OLAP数据库管理系统.v17|——|Kylin.v08|Kylin部署配置|

相关

标签